CoChat
Sign Up
PreprintCited by 16Topic ModelingAI-based Problem Solving and PlanningInformation Retrieval and Search Behavior

Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics

Open access
Du, Yiming, Huang, Wenyu, Zheng, Danna, Wang, Zhaowei, Montella, Sebastien, Lapata, Mirella, Wong, Kam-Fai, Pan, Jeff Z.·2025·arXiv
DOI 10.48550/arxiv.2505.00675arXiv 2505.00675
Open this paper in CoChat — free accountOpen PDF

Abstract

Memory is fundamental to large language model (LLM)-based agents, but existing surveys emphasize application-level use (e.g., personalized dialogue), while overlooking the atomic operations governing memory dynamics. This work categorizes memory into parametric (implicit in model weights) and contextual (explicit external data, structured/unstructured) forms, and defines six core operations: Consolidation, Updating, Indexing, Forgetting, Retrieval, and Condensation. Mapping these dimensions reveals four key research topics: long-term, long-context, parametric modification, and multi-source memory. The taxonomy provides a structured view of memory-related research, benchmarks, and tools, clarifying functional interactions in LLM-based agents and guiding future advancements. The datasets, papers, and tools are publicly available at https://github.com/Elvin-Yiming-Du/Survey_Memory_in_AI.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2505.00675

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Episodic memory allows agents to recall prior actions and feedback.

    “Episodic memory allows agents to recall prior actions and feedback, semantic memory encodes structured domain knowledge, and vector memory enables similarity-based retrieval [227].”

    From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [227]

    Section 4.1.1 (Management; page not provided) describes episodic what-where-when memories for action planning and says agents store past observations and decisions for future access. A separate passage on memory-grounded generation describes retrieving feedback memories, but our copy does not specifically say that episodic memory lets agents recall feedback from prior actions. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Semantic memory encodes structured domain knowledge.

    “Episodic memory allows agents to recall prior actions and feedback, semantic memory encodes structured domain knowledge, and vector memory enables similarity-based retrieval [227].”

    From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [227]

    The Introduction (page unavailable) describes contextual structured memory as using knowledge graphs, tables, or ontologies and storing curated knowledge. It does not identify this category as semantic memory, so the specific attribution to semantic memory is not established by our copy. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

  • Vector memory enables similarity-based retrieval.

    “Episodic memory allows agents to recall prior actions and feedback, semantic memory encodes structured domain knowledge, and vector memory enables similarity-based retrieval [227].”

    From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [227]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 184

  1. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774. · arXiv
  2. Muhammad Adnan, Akhil Arunkumar, Gaurav Jain, Prashant J. Nair, Ilya Soloveychik, and Purushotham Kamath. 2024. Keyformer: Kv cache reduction through key tokens selection for efficient generative inference. In Proceedings of Machine Learning and Systems, volume 6, pages 114-127.
  3. Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. 2023. Qwen-vl: A versatile vision-language model for understanding, localiza- tion, text reading, and beyond. arXiv preprint arXiv:2308.12966. · arXiv
  4. Zhiwei Cao, Qian Cao, Yu Lu, Ningxin Peng, Luyang Huang, Shanbo Cheng, and Jinsong Su. 2024. Retain- ing key information under high compression ratios: Query-guided compressor for LLMs. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12685-12695, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  5. Jiaao Chen and Diyi Yang. 2023. Unlearn what you want to forget: Efficient unlearning for llms. In Pro- ceedings of the 2023 Conference on Empirical Meth- ods in Natural Language Processing, pages 12041- 12052.
  6. Mingda Chen, Yang Li, Karthik Padthe, Rulin Shao, Ali- cia Sun, Luke Zettlemoyer, Gargi Ghosh, and Wen- tau Yih. 2024a. Improving factuality with explicit working memory. arXiv preprint arXiv:2412.18069. · arXiv
  7. Nuo Chen, Hongguang Li, Juhua Huang, Baoyuan Wang, and Jia Li. 2024b. Compress to impress: Unleashing the potential of compressive memory in real-world long-term conversations. arXiv preprint arXiv:2402.11975. · arXiv
  8. Wenhu Chen, Zhihao He, Yu Su, Yunyao Yu, William Wang, and Xifeng Yan. 2021. Hybridqa: A dataset of multi-hop question answering over tabular and textual data. In Proceedings of the International Conference on Learning Representations (ICLR).
  9. Yilong Chen, Guoxia Wang, Junyuan Shang, Shiyao Cui, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun, Dianhai Yu, and Hua Wu. 2024c. NACL: A general and effective KV cache eviction frame- work for LLM at inference time. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7913-7926, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  10. Xin Cheng, Xun Wang, Xingxing Zhang, Tao Ge, Si- Qing Chen, Furu Wei, Huishuai Zhang, and Dongyan Zhao. 2024. xrag: Extreme context compression for retrieval-augmented generation with one token. arXiv preprint arXiv:2405.13792. · arXiv
  11. Tsz Ting Chung, Leyang Cui, Lemao Liu, Xinting Huang, Shuming Shi, and Dit-Yan Yeung. 2024. Selection-p: Self-supervised task-agnostic prompt compression for faithfulness and transferability. In Findings of the Association for Computational Lin- guistics: EMNLP 2024, pages 11057-11070, Miami, Florida, USA. Association for Computational Lin- guistics. · DOI
  12. Nelson Cowan. 2001. The magical number 4 in short- term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24(1):87- 114.
  13. Bhavana Dalvi Mishra, Oyvind Tafjord, and Peter Clark. 2022. Towards teachable reasoning systems: Using a dynamic memory of user feedback for continual sys- tem improvement. In Proceedings of the 2022 Con- ference on Empirical Methods in Natural Language Processing, pages 9465-9480, Abu Dhabi, United Arab Emirates. Association for Computational Lin- guistics.
  14. Payel Das, Subhajit Chaudhury, Elliot Nelson, Igor Melnyk, Sarathkrishna Swaminathan, Sihui Dai, Au- rélie C. Lozano, Georgios Kollias, Vijil Chenthama- rakshan, Jirí Navrátil, Soham Dan, and Pin-Yu Chen. 2024. Larimar: Large language models with episodic memory control. In ICML.
  15. Ronald L Davis and Yi Zhong. 2017. The biology of forgetting-a perspective. Neuron, 95(3):490-503.
  16. N De Cao, W Aziz, and I Titov. 2021. Editing fac- tual knowledge in language models. In EMNLP 2021-2021 Conference on Empirical Methods in Nat- ural Language Processing, Proceedings, pages 6491- 6506.
  17. Harry Dong, Xinyu Yang, Zhenyu Zhang, Zhangyang Wang, Yuejie Chi, and Beidi Chen. 2024. Get more with LESS: Synthesizing recurrence with KV cache compression for efficient LLM inference. In Proceed- ings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 11437-11452.
  18. PMLR.
  19. Qingxiu Dong, Damai Dai, Yifan Song, Jingjing Xu, Zhifang Sui, and Lei Li. 2022. Calibrating factual knowledge in pretrained language models. In Find- ings of the Association for Computational Linguistics: EMNLP 2022, pages 5937-5947.
  20. Matthijs Douze, Alexandr Guzhva, Chengqi Deng, Jeff Johnson, Gergely Szilvasy, Pierre-Emmanuel Mazaré, Maria Lomeli, Lucas Hosseini, and Hervé Jégou. 2024. The faiss library. arXiv preprint arXiv:2401.08281. · arXiv
  21. Danny Driess, Fei Xia, Mehdi SM Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, et al. 2023. Palm-e: An embodied multimodal language model. arXiv preprint arXiv:2303.03378. · arXiv
  22. Xinya Du, Sha Li, and Heng Ji. 2022. Dynamic global memory for document-level argument extraction. In Proceedings of the 60th Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers), pages 5264-5275, Dublin, Ireland. As- sociation for Computational Linguistics. · DOI
  23. Yiming Du, Hongru Wang, Zhengyi Zhao, Bin Liang, Baojun Wang, Wanjun Zhong, Zezhong Wang, and Kam-Fai Wong. 2024. Perltqa: A personal long-term memory dataset for memory classification, retrieval, and synthesis in question answering. arXiv preprint arXiv:2402.16288. · arXiv
  24. Zhihua Duan and Jialin Wang. 2024. Explo- ration of llm multi-agent application implementa- tion based on langgraph+ crewai. arXiv preprint arXiv:2411.18241. · arXiv
  25. Yadin Dudai, Avi Karni, and Jan Born. 2015. The con- solidation and transformation of memory. Neuron, 88(1):20-32.
  26. Ritam Dutt, Kasturi Bhattacharjee, Rashmi Gangadhara- iah, Dan Roth, and Carolyn Rose. 2022. Perkgqa: Question answering over personalized knowledge graphs. In Findings of the Association for Computa- tional Linguistics: NAACL 2022, pages 253-268.
  27. Junfeng Fang, Houcheng Jiang, Kun Wang, Yunshan Ma, Jie Shi, Xiang Wang, Xiangnan He, and Tat- Seng Chua. 2025. Alphaedit: Null-space constrained model editing for language models. In The Thirteenth International Conference on Learning Representa- tions.
  28. Junfeng Fang, Houcheng Jiang, Kun Wang, Yunshan Ma, Xiang Wang, Xiangnan He, and Tat-seng Chua. 2024. Alphaedit: Null-space constrained knowl- edge editing for language models. arXiv preprint arXiv:2410.02355. · arXiv
  29. Yujie Feng, Xu Chu, Yongxin Xu, Guangyuan Shi, Bo Liu, and Xiao-Ming Wu. 2024. TaSL: Continual dialog state tracking via task skill localization and consolidation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Lin- guistics (Volume 1: Long Papers), pages 1266-1279, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  30. Nicholas T Franklin, Kenneth A Norman, Charan Ran- ganath, Jeffrey M Zacks, and Samuel J Gershman. 2020. Structured event memory: A neuro-symbolic model of event cognition. Psychological Review, 127(3):327-361.
  31. Tingchen Fu, Xueliang Zhao, Chongyang Tao, Ji-Rong Wen, and Rui Yan. 2022. There are a thousand hamlets in a thousand people's eyes: Enhancing knowledge-grounded dialogue with personal memory. arXiv preprint arXiv:2204.02624. · arXiv
  32. Yu Fu, Zefan Cai, Abedelkadir Asi, Wayne Xiong, Yue Dong, and Wen Xiao. 2025. Not all heads matter: A head-level KV cache compression method with integrated retrieval and reasoning. In The Thirteenth International Conference on Learning Representa- tions.
  33. Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, and Jianfeng Gao. 2024. Model tells you what to discard: Adaptive KV cache compression for LLMs. In The Twelfth International Conference on Learning Representations.
  34. Bernal Jiménez Gutiérrez, Yiheng Shu, Yu Gu, Michi- hiro Yasunaga, and Yu Su. 2024. Hipporag: Neu- robiologically inspired long-term memory for large language models. In The Thirty-eighth Annual Con- ference on Neural Information Processing Systems.
  35. Kaiqiao Han, Tianqing Fang, Zhaowei Wang, Yangqiu Song, and Mark Steedman. 2025. Concept-reversed Winograd schema challenge: Evaluating and improv- ing robust reasoning in large language models via abstraction. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Asso- ciation for Computational Linguistics: Human Lan- guage Technologies (Volume 2: Short Papers), pages 229-243, Albuquerque, New Mexico. Association for Computational Linguistics.
  36. Bo He, Hengduo Li, Young Kyun Jang, Menglin Jia, Xuefei Cao, Ashish Shah, Abhinav Shrivastava, and Ser-Nam Lim. 2024a. Ma-lmm: Memory-augmented large multimodal model for long-term video under- standing. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 13504-13514.
  37. Junqing He, Kunhao Pan, Xiaoqun Dong, Zhuoyang Song, LiuYiBo LiuYiBo, Qianguosun Qianguosun, Yuxin Liang, Hao Wang, Enming Zhang, and Jiaxing Zhang. 2024b. Never lost in the middle: Master- ing long-context question answering with position- agnostic decompositional training. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13628-13642, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  38. Yang He, Ruijie Fang, Isil Dillig, and Yuepeng Wang. 2025. Graphiti: Bridging graph and relational database queries. arXiv preprint arXiv:2504.03182. · arXiv
  39. Zihong He, Weizhe Lin, Hao Zheng, Fan Zhang, Matt W. Jones, Laurence Aitchison, Xuhai Xu, Miao Liu, Per Ola Kristensson, and Junxiao Shen. 2024c. Human-inspired perspectives: A survey on ai long- term memory. arXiv preprint arXiv:2411.00489. · arXiv
  40. Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa. 2020. Constructing a multi-hop qa dataset for comprehensive evaluation of reasoning steps. arXiv preprint arXiv:2011.01060. · arXiv
  41. Ruixin Hong, Hongming Zhang, Xiaoman Pan, Dong Yu, and Changshui Zhang. 2024. Abstraction-of- thought makes language models better reasoners. In Findings of the Association for Computational Lin- guistics: EMNLP 2024, pages 1993-2027, Miami, Florida, USA. Association for Computational Lin- guistics. · DOI
  42. Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, Michael W. Mahoney, Yakun Sophia Shao, Kurt Keutzer, and Amir Gholami. 2024. Kvquant: To- wards 10 million context length llm inference with kv cache quantization. In Advances in Neural Infor- mation Processing Systems, volume 37, pages 1270- 1303.
  43. Zhijian Hou, Lei Ji, Difei Gao, Wanjun Zhong, Kun Yan, Chao Li, Wing-Kwong Chan, Chong-Wah Ngo, Nan Duan, and Mike Zheng Shou. 2023. Groundnlq@ ego4d natural language queries chal- lenge 2023. arXiv preprint arXiv:2306.15255. · arXiv
  44. Qiushi Huang, Shuai Fu, Xubo Liu, Wenwu Wang, Tom Ko, Yu Zhang, and Lilian Tang. 2024. Learning retrieval augmentation for personalized dialogue gen- eration. arXiv preprint arXiv:2406.18847. · arXiv
  45. Yunpeng Huang, Jingwei Xu, Junyu Lai, Zixu Jiang, Taolue Chen, Zenan Li, Yuan Yao, Xiaoxing Ma, Li- juan Yang, Hao Chen, et al. 2023b. Advancing trans- former architecture in long-context large language models: A comprehensive survey. arXiv preprint arXiv:2311.12351. · arXiv
  46. Kai Tzu iunn Ong, Namyoung Kim, Minju Gwak, Hyungjoo Chae, Taeyoon Kwon, Yohan Jo, Seung won Hwang, Dongha Lee, and Jinyoung Yeo. 2025. Towards lifelong dialogue agents via timeline-based memory management. In Proceedings of the 2025 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Mexico City, Mexico. Asso- ciation for Computational Linguistics.
  47. Gautier Izacard, Mathilde Caron, Lucas Hosseini, Se- bastian Riedel, Piotr Bojanowski, Armand Joulin, and Edouard Grave. 2021. Unsupervised dense in- formation retrieval with contrastive learning. arXiv preprint arXiv:2112.09118. · arXiv
  48. Jihyoung Jang, Minseong Boo, and Hyounghun Kim. 2023. Conversation chronicles: Towards diverse tem- poral and relational dynamics in multi-session con- versations. arXiv preprint arXiv:2310.13420. · arXiv
  49. Yunah Jang, Kang-il Lee, Hyunkyung Bae, Hwanhee Lee, and Kyomin Jung. 2024. IterCQR: Iterative con- versational query reformulation with retrieval guid- ance. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Com- putational Linguistics: Human Language Technolo- gies (Volume 1: Long Papers), pages 8121-8138, Mexico City, Mexico. Association for Computational Linguistics. · DOI
  50. Jiabao Ji, Yujian Liu, Yang Zhang, Gaowen Liu, Ra- mana Kompella, Sijia Liu, and Shiyu Chang. 2024. Reversing the forget-retain objectives: An efficient llm unlearning framework from logit difference. Ad- vances in Neural Information Processing Systems, 37:12581-12611.
  51. Jinghan Jia, Jiancheng Liu, Yihua Zhang, Parikshit Ram, Nathalie Baracaldo Angel, and Sijia Liu. 2024a. Wa- gle: Strategic weight attribution for effective and modular unlearning in large language models. In An- nual Conference on Neural Information Processing Systems.
  52. Jinghan Jia, Yihua Zhang, Yimeng Zhang, Jiancheng Liu, Bharat Runwal, James Diffenderfer, Bhavya Kailkhura, and Sijia Liu. 2024b. Soul: Unlocking the power of second-order optimization for llm un- learning. arXiv preprint arXiv:2404.18239. · arXiv
  53. Xun Jiang, Feng Li, Han Zhao, Jiaying Wang, Jun Shao, Shihao Xu, Shu Zhang, Weiling Chen, Xavier Tang, Yize Chen, Mengyue Wu, Weizhi Ma, Mengdi Wang, and Tianqiao Chen. 2024b. Long term memory: The foundation of ai self-evolution. arXiv preprint arXiv:2410.15665. · arXiv
  54. Bowen Jin, Jinsung Yoon, Jiawei Han, and Sercan O Arik. 2025. Long-context LLMs meet RAG: Over- coming challenges for long inputs in RAG. In The Thirteenth International Conference on Learning Representations.
  55. Zhuoran Jin, Pengfei Cao, Chenhao Wang, Zhitao He, Hongbang Yuan, Jiachun Li, Yubo Chen, Kang Liu, and Jun Zhao. 2024. RWKU: Benchmarking real- world knowledge unlearning for large language mod- els. In The Thirty-eight Conference on Neural In- formation Processing Systems Datasets and Bench- marks Track.
  56. Christopher Kiley and Colleen M Parks. 2022. Mech- anisms of memory updating: State dependency vs. reconsolidation. Journal of cognition, 5(1):7.
  57. Jiho Kim, Woosog Chay, Hyeonji Hwang, Daeun Kyung, Hyunseung Chung, Eunbyeol Cho, Yohan Jo, and Edward Choi. 2024a. Dialsim: A real-time simulator for evaluating long-term multi-party dia- logue understanding of conversational agents. arXiv preprint arXiv:2406.13144. · arXiv
  58. Seo Hyun Kim, Keummin Ka, Yohan Jo, Seung-won Hwang, Dongha Lee, and Jinyoung Yeo. 2024b. Ever-evolving memory by blending and refining the past. arXiv preprint arXiv:2403.04787. · arXiv
  59. James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Ag- nieszka Grabska-Barwinska, et al. 2017. Over- coming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences, 114(13):3521-3526.
  60. Dharshan Kumaran, Demis Hassabis, and James L Mc- Clelland. 2016. What learning systems do intelligent agents need? complementary learning systems theory updated. Trends in Cognitive Sciences, 20(7):512- 534.
  61. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Red- field, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Ken- ton Lee, et al. 2019. Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics, 7:453- 466.
  62. Dongkyu Lee, Chandana Satya Prakash, Jack FitzGer- ald, and Jens Lehmann. 2024a. Matter: Memory- augmented transformer using heterogeneous knowl- edge sources. In Findings of the Association for Computational Linguistics: ACL 2024, pages 16110- 16121.
  63. Kuang-Huei Lee, Xinyun Chen, Hiroki Furuta, John Canny, and Ian Fischer. 2024b. A human-inspired reading agent with gist memory of very long contexts. In Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 26396-26415.
  64. PMLR.
  65. Kuang-Huei Lee, Xinyun Chen, Hiroki Furuta, John Canny, and Ian Fischer. 2024c. A human-inspired reading agent with gist memory of very long contexts. arXiv preprint arXiv:2402.09727. · arXiv
  66. Mingcong Lei, Yiming Zhao, Ge Wang, Zhixin Mai, Shuguang Cui, Yatong Han, and Jinke Ren. 2025. Stma: A spatio-temporal memory agent for long- horizon embodied task planning. arXiv preprint arXiv:2502.10177. · arXiv
  67. Hao Li, Chenghao Yang, An Zhang, Yang Deng, Xiang Wang, and Tat-Seng Chua. 2024a. Hello again! llm- powered personalized agent for long-term dialogue. arXiv preprint arXiv:2406.05925. · arXiv
  68. Nathaniel Li, Alexander Pan, Anjali Gopal, Sum- mer Yue, Daniel Berrios, Alice Gatti, Justin D Li, Ann-Kathrin Dombrowski, Shashwat Goel, Gabriel Mukobi, et al. 2024b. The wmdp benchmark: mea- suring and reducing malicious use with unlearning. In Proceedings of the 41st International Conference on Machine Learning, pages 28525-28550.
  69. Xingxuan Li, Ruochen Zhao, Yew Ken Chia, Bosheng Ding, Shafiq Joty, Soujanya Poria, and Lidong Bing. 2023. Chain-of-knowledge: Grounding large language models via dynamic knowledge adapt- ing over heterogeneous sources. arXiv preprint arXiv:2305.13269. · arXiv
  70. Yongqi Li, Wenjie Wang, Leigang Qu, Liqiang Nie, Wenjie Li, and Tat-Seng Chua. 2024d. Generative cross-modal retrieval: Memorizing images in mul- timodal language models for retrieval and beyond. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 11851-11861, Bangkok, Thai- land. Association for Computational Linguistics. · DOI
  71. Yuhong Li, Yingbing Huang, Bowen Yang, Bharat Venkitesh, Acyr Locatelli, Hanchen Ye, Tianle Cai, Patrick Lewis, and Deming Chen. 2024e. Snapkv: Llm knows what you are looking for before genera- tion. In Advances in Neural Information Processing Systems, volume 37, pages 22947-22970.
  72. Zaijing Li, Yuquan Xie, Rui Shao, Gongwei Chen, Dongmei Jiang, and Liqiang Nie. 2024f. Optimus- 1: Hybrid multimodal memory empowered agents excel in long-horizon tasks. arXiv preprint arXiv:2408.03615. · arXiv
  73. Zhuoqun Li, Xuanang Chen, Haiyang Yu, Hongyu Lin, Yaojie Lu, Qiaoyu Tang, Fei Huang, Xianpei Han, Le Sun, and Yongbin Li. 2024g. Structrag: Boosting knowledge intensive reasoning of llms via inference- time hybrid information structurization. In The Thir- teenth International Conference on Learning Repre- sentations.
  74. Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, et al. 2024a. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437. · arXiv
  75. Chris Liu, Yaxuan Wang, Jeffrey Flanigan, and Yang Liu. 2024b. Large language model unlearning via embedding-corrupted prompts. Advances in Neural Information Processing Systems, 37:118198-118266.
  76. Jiahong Liu, Zexuan Qiu, Zhongyang Li, Quanyu Dai, Jieming Zhu, Minda Hu, Menglin Yang, and Irwin King. 2025a. A survey of personalized large lan- guage models: Progress and future directions. arXiv preprint arXiv:2502.11528. · arXiv
  77. Minqian Liu, Shiyu Chang, and Lifu Huang. 2022a. Incremental prompting: Episodic memory prompt for lifelong event detection. arXiv preprint arXiv:2204.07275. · arXiv
  78. Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paran- jape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. 2024d. Lost in the middle: How language models use long contexts. Transactions of the Asso- ciation for Computational Linguistics, 12:157-173.
  79. Shuai Liu, Hyundong J Cho, Marjorie Freedman, Xuezhe Ma, and Jonathan May. 2023b. Recap: retrieval-enhanced context-aware prefix encoder for personalized dialogue response generation. arXiv preprint arXiv:2306.07206. · arXiv
  80. Zhenghao Liu, Chenyan Xiong, Yuanhuiyi Lv, Zhiyuan Liu, and Ge Yu. 2022b. Universal vision-language dense retrieval: Learning a unified representation space for multi-modal retrieval. arXiv preprint arXiv:2209.00179. · arXiv
  81. Zhenghao Liu, Chenyan Xiong, Yuanhuiyi Lv, Zhiyuan Liu, and Ge Yu. 2023c. Universal vision-language dense retrieval: Learning a unified representation space for multi-modal retrieval. In Proceedings of ICLR.
  82. Zheyuan Liu, Guangyao Dou, Zhaoxuan Tan, Yijun Tian, and Meng Jiang. 2024e. Towards safer large language models through machine unlearning. In Findings of the Association for Computational Lin- guistics ACL 2024, pages 1817-1829.
  83. Zichang Liu, Aditya Desai, Fangshuo Liao, Weitao Wang, Victor Xie, Zhaozhuo Xu, Anastasios Kyril- lidis, and Anshumali Shrivastava. 2023d. Scis- sorhands: Exploiting the persistence of importance hypothesis for LLM KV cache compression at test time. In Thirty-seventh Conference on Neural Infor- mation Processing Systems.
  84. Zirui Liu, Jiayi Yuan, Hongye Jin, Shaochen Zhong, Zhaozhuo Xu, Vladimir Braverman, Beidi Chen, and Xia Hu. 2024f. KIVI: A tuning-free asymmetric 2bit quantization for KV cache. In Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 32332-32344.
  85. PMLR.
  86. Junru Lu, Siyu An, Mingbao Lin, Gabriele Pergola, Yu- lan He, Di Yin, Xing Sun, and Yunsheng Wu. 2023. Memochat: Tuning llms to use memos for consis- tent long-range open-domain conversation. arXiv preprint arXiv:2308.08239. · arXiv
  87. Aru Maekawa, Hidetaka Kamigaito, Kotaro Funakoshi, and Manabu Okumura. 2023. Generative replay in- spired by hippocampal memory indexing for contin- ual language learning. In Proceedings of the 17th Conference of the European Chapter of the Associa- tion for Computational Linguistics, pages 930-942.
  88. Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, and Yuwei Fang. 2024. Evaluating very long-term conver- sational memory of llm agents. arXiv preprint arXiv:2402.17753. · arXiv
  89. Pratyush Maini, Zhili Feng, Avi Schwarzschild, Zachary Chase Lipton, and J Zico Kolter. 2024. TOFU: A task of fictitious unlearning for LLMs. In First Conference on Language Modeling.
  90. Karttikeya Mangalam, Raiymbek Akshulakov, and Ji- tendra Malik. 2023. Egoschema: A diagnostic bench- mark for very long-form video language understand- ing. In Advances in Neural Information Processing Systems (NeurIPS).
  91. James L McClelland, Bruce L McNaughton, and Ran- dall C O'Reilly. 1995. Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connec- tionist models of learning and memory. Psychologi- cal Review, 102(3):419-457.
  92. Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa De- hghani, Vinh Q Tran, Jinfeng Rao, Marc Najork, Emma Strubell, and Donald Metzler. 2022. Dsi++: Updating transformer memory with new documents. arXiv preprint arXiv:2212.09744. · arXiv
  93. Daniel Mela, Aitor González-Agirre, Javier Hernando, and Marta Villegas. 2024. Mass-editing memory with attention in transformers: A cross-lingual ex- ploration of knowledge. In Findings of the Associa- tion for Computational Linguistics ACL 2024, pages 5831-5847.
  94. Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2022a. Locating and editing factual as- sociations in gpt. Advances in neural information processing systems, 35:17359-17372.
  95. Kevin Meng, Arnab Sen Sharma, Alex Andonian, Yonatan Belinkov, and David Bau. 2022b. Mass- editing memory in a transformer. arXiv preprint arXiv:2210.07229. · arXiv
  96. Kevin Meng, Arnab Sen Sharma, Alex J Andonian, Yonatan Belinkov, and David Bau. 2023. Mass- editing memory in a transformer. In The Eleventh International Conference on Learning Representa- tions.
  97. Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2017. Pointer sentinel mixture mod- els. In International Conference on Learning Repre- sentations.
  98. Marvin Minsky. 1980. K-lines: A theory of memory. Cognitive Science, 4(2):117-133. · DOI
  99. Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D Manning. 2022a. Fast model editing at scale. In International Conference on Learning Representations.
  100. Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D Manning. 2022b. Fast model editing at scale. In International Conference on Learning Representations.
  101. Eric Mitchell, Charles Lin, Antoine Bosselut, Christo- pher D Manning, and Chelsea Finn. 2022c. Memory- based model editing at scale. In International Con- ference on Machine Learning, pages 15817-15831.
  102. PMLR.
  103. Cicero Nogueira dos Santos, James Lee-Thorp, Isaac Noble, Chung-Ching Chang, and David Uthus. 2024. Memory augmented language models through mix- ture of word experts. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 4425-4438, Mexico City, Mexico. Association for Computational Linguistics. · DOI
  104. Junyeong Park, Junmo Cho, and Sungjin Ahn. 2025. Mr.steve: Instruction-following agents in minecraft with what-where-when memory. In International Conference on Learning Representations (ICLR). Ac- cepted as a poster at ICLR 2025.
  105. Martin Pawelczyk, Seth Neel, and Himabindu Lakkaraju. 2023. In-context unlearning: Language models as few shot unlearners. arXiv preprint arXiv:2310.07579. · arXiv
  106. Martin Pawelczyk, Seth Neel, and Himabindu Lakkaraju. 2024. In-context unlearning: Language models as few-shot unlearners. In International Con- ference on Machine Learning, pages 40034-40050.
  107. PMLR.
  108. USVSN Sai Prashanth, Alvin Deng, Kyle O'Brien, Jyothir SV, Mohammad Aflah Khan, Jaydeep Borkar, Christopher A Choquette-Choo, Jacob Ray Fuehne, Stella Biderman, Tracy Ke, et al. 2024. Re- cite, reconstruct, recollect: Memorization in lms as a multifaceted phenomenon. arXiv preprint arXiv:2406.17746. · arXiv
  109. Hongjin Qian, Peitian Zhang, Zheng Liu, Kelong Mao, and Zhicheng Dou. 2024. Memorag: Moving to- wards next-gen rag via memory-inspired knowledge discovery. arXiv preprint arXiv:2409.05591. · arXiv
  110. Zhangcheng Qiang, Weiqing Wang, and Kerry Taylor. 2023. Agent-om: Leveraging llm agents for ontology matching. arXiv preprint arXiv:2312.00326. · arXiv
  111. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sas- try, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learn- ing transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 8748-8763. PMLR.
  112. Jack W. Rae, Anna Potapenko, Siddhant M. Jayaku- mar, Chloe Hillier, and Timothy P. Lillicrap. 2020. Compressive transformers for long-range sequence modelling. In International Conference on Learning Representations.
  113. Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, and Daniel Chalef. 2025. Zep: A tempo- ral knowledge graph architecture for agent memory. arXiv preprint arXiv:2501.13956. · arXiv
  114. Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta, and Pranav Khaitan. 2020. Towards scalable multi-domain conversational agents: The schema-guided dialogue dataset. In Proceedings of the AAAI Conference on Artificial Intelligence, vol- ume 34, pages 8689-8696.
  115. Steven Ritter, Jane X Wang, Zeb Kurth-Nelson, Sid- dhant Jayakumar, Charles Blundell, and Timothy Lill- icrap. 2018. Meta-learning through hebbian plasticity in random networks. In Advances in Neural Informa- tion Processing Systems (NeurIPS), volume 31.
  116. Alireza Salemi, Sheshera Mysore, Michael Bendersky, and Hamed Zamani. 2023. Lamp: When large lan- guage models meet personalization. arXiv preprint arXiv:2304.11406. · arXiv
  117. Mohammad Reza Samsami, Artem Zholus, Janarthanan Rajendran, and Sarath Chandar. 2024. Mastering memory tasks with world models. In The Twelfth In- ternational Conference on Learning Representations.
  118. Gabriel Sarch, Lawrence Jang, Michael Tarr, William W Cohen, Kenneth Marino, and Katerina Fragkiadaki. 2024. Vlm agents generate their own memories: Dis- tilling experience into embodied programs of thought. Advances in Neural Information Processing Systems, 37:75942-75985.
  119. Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christo- pher Ré, Ion Stoica, and Ce Zhang. 2023. Flexgen: high-throughput generative inference of large lan- guage models with a single gpu. In Proceedings of the 40th International Conference on Machine Learn- ing, ICML'23. JMLR.org.
  120. Haizhou Shi and Hao Wang. 2023. A unified approach to domain incremental learning with memory: The- ory and algorithm. Advances in Neural Information Processing Systems, 36:15027-15059.
  121. Weijia Shi, Jaechan Lee, Yangsibo Huang, Sadhika Malladi, Jieyu Zhao, Ari Holtzman, Daogao Liu, Luke Zettlemoyer, Noah A Smith, and Chiyuan Zhang. 2024. Muse: Machine unlearning six-way evaluation for language models. arXiv preprint arXiv:2407.06460. · arXiv
  122. Larry R Squire, Lisa Genzel, John T Wixted, and Richard G Morris. 2015. Memory consolida- tion. Cold Spring Harbor perspectives in biology, 7(8):a021766.
  123. Jianlin Su, Murtadha Ahmed, Bo Wen, Luo Ao, Min- gren Zhu, and Yunfeng Liu. 2024. Naive Bayes- based context extension for large language models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 7791-7807, Mexico City, Mexico. Association for Computational Lin- guistics. · DOI
  124. Xin Su, Tiep Le, Steven Bethard, and Phillip Howard. 2023. Semi-structured chain-of-thought: Inte- grating multiple sources of knowledge for im- proved language model reasoning. arXiv preprint arXiv:2311.08505. · arXiv
  125. Hao Sun, Hengyi Cai, Bo Wang, Yingyan Hou, Xiaochi Wei, Shuaiqiang Wang, Yan Zhang, and Dawei Yin. 2024. Towards verifiable text generation with evolv- ing memory and self-reflection. In Proceedings of the 2024 Conference on Empirical Methods in Natu- ral Language Processing, pages 8211-8227, Miami, Florida, USA. Association for Computational Lin- guistics.
  126. Alon Talmor and Jonathan Berant. 2018. The web as a knowledge-base for answering complex questions. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies, pages 641-651. Association for Computational Lin- guistics.
  127. Hexiang Tan, Fei Sun, Wanli Yang, Yuanzhuo Wang, Qi Cao, and Xueqi Cheng. 2024a. Blinded by gen- erated contexts: How language models merge gen- erated and retrieved contexts for open-domain qa? arXiv e-prints, pages arXiv-2401.
  128. Niket Tandon, Aman Madaan, Peter Clark, and Yiming Yang. 2021. Learning to repair: Repairing model out- put errors after deployment using a dynamic memory of feedback. arXiv preprint arXiv:2112.09737. · arXiv
  129. Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, and Song Han. 2024. QUEST: Query- aware sparsity for efficient long-context LLM in- ference. In Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 47901-47911.
  130. PMLR.
  131. Yihong Tang, Bo Wang, Miao Fang, Dongming Zhao, Kun Huang, Ruifang He, and Yuexian Hou. 2023a. Enhancing personalized dialogue generation with contrastive latent variables: Combining sparse and dense persona. arXiv preprint arXiv:2305.11482. · arXiv
  132. Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2021. Long range arena : A benchmark for efficient transformers. In International Conference on Learning Representa- tions.
  133. Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng, Qing- bin Liu, Mengru Wang, Dianbo Sui, Xi Chen, Hua- jun Chen, and Ningyu Zhang. 2024. To forget or not? towards practical knowledge unlearning for large language models. In Findings of the Associ- ation for Computational Linguistics: EMNLP 2024, pages 1524-1537.
  134. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023. Llama: Open and effi- cient foundation language models. arXiv preprint arXiv:2302.13971. · arXiv
  135. Bingbing Wang, Yiming Du, Bin Liang, Zhixin Bai, Min Yang, Baojun Wang, Kam-Fai Wong, and Ruifeng Xu. 2025a. A new formula for sticker retrieval: Re- ply with stickers in multi-modal and multi-session conversation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 25327- 25335.
  136. Jane X Wang, Zeb Kurth-Nelson, Dharshan Kumaran, Dhruva Tirumala, Hubert Soyer, Joel Z Leibo, Demis Hassabis, and Matthew Botvinick. 2021. Dual- system episodic control: Integrating episodic mem- ory and reinforcement learning. Nature Human Be- haviour, 5(3):293-307.
  137. Liyuan Wang, Xingxing Zhang, Hang Su, and Jun Zhu. 2024b. A comprehensive survey of continual learn- ing: Theory, method and application. IEEE Transac- tions on Pattern Analysis and Machine Intelligence.
  138. Liyuan Wang, Xingxing Zhang, Kuo Yang, Longhui Yu, Chongxuan Li, Lanqing Hong, Shifeng Zhang, Zhenguo Li, Yi Zhong, and Jun Zhu. 2022. Memory replay with data compression for continual learning. arXiv preprint arXiv:2202.06592. · arXiv
  139. Peng Wang, Zexi Li, Ningyu Zhang, Ziwen Xu, Yunzhi Yao, Yong Jiang, Pengjun Xie, Fei Huang, and Hua- jun Chen. 2024c. Wise: Rethinking the knowledge memory for lifelong model editing of large language models. Advances in Neural Information Processing Systems, 37:53764-53797.
  140. Qingyue Wang, Yanhe Fu, Yanan Cao, Shuai Wang, Zhiliang Tian, and Liang Ding. 2025c. Recur- sively summarizing enables long-term dialogue mem- ory in large language models. Neurocomputing, 639:130193. · DOI · Paper page
  141. Shang Wang, Tianqing Zhu, Dayong Ye, and Wan- lei Zhou. 2024e. When machine unlearning meets retrieval-augmented generation (rag): Keep secret or forget knowledge? arXiv preprint arXiv:2410.15267. · arXiv
  142. Siyuan Wang, Zhongyu Wei, Yejin Choi, and Xiang Ren. 2024f. Symbolic working memory enhances language models for complex rule application. arXiv preprint arXiv:2408.13654. · arXiv
  143. Song Wang, Yaochen Zhu, Haochen Liu, Zaiyi Zheng, Chen Chen, and Jundong Li. 2024g. Knowledge editing for large language models: A survey. ACM Computing Surveys, 57(3):1-37.
  144. Yaxuan Wang, Jiaheng Wei, Chris Yuhao Liu, Jinlong Pang, Quan Liu, Ankit Shah, Yujia Bao, Yang Liu, and Wei Wei. 2025d. LLM unlearning via loss ad- justment with only forget data. In The Thirteenth International Conference on Learning Representa- tions.
  145. Yaxuan Wang, Jiaheng Wei, Chris Yuhao Liu, Jinlong Pang, Quan Liu, Ankit Parag Shah, Yujia Bao, Yang Liu, and Wei Wei. 2024h. Llm unlearning via loss adjustment with only forget data. arXiv preprint arXiv:2410.11143. · arXiv
  146. Yike Wang, Shangbin Feng, Heng Wang, Weijia Shi, Vidhisha Balachandran, Tianxing He, and Yu- lia Tsvetkov. 2023a. Resolving knowledge con- flicts in large language models. arXiv preprint arXiv:2310.00935. · arXiv
  147. Ying Wang, Yanlai Yang, and Mengye Ren. 2023b. Life- longmemory: Leveraging llms for answering queries in long-form egocentric videos. arXiv preprint arXiv:2312.05269. · arXiv
  148. Yu Wang, Yifan Gao, Xiusi Chen, Haoming Jiang, Shiyang Li, Jingfeng Yang, Qingyu Yin, Zheng Li, Xian Li, Bing Yin, et al. 2024i. Memoryllm: towards self-updatable large language models. In Proceed- ings of the 41st International Conference on Machine Learning, pages 50453-50466.
  149. Yu Wang, Chi Han, Tongtong Wu, Xiaoxin He, Wangchunshu Zhou, Nafis Sadeq, Xiusi Chen, Zexue He, Wei Wang, Gholamreza Haffari, et al. 2024j. Towards lifespan cognitive systems. arXiv preprint arXiv:2409.13265. · arXiv
  150. Yutong Wang, Jiali Zeng, Xuebo Liu, Derek F. Wong, Fandong Meng, Jie Zhou, and Min Zhang. 2025e. Delta: An online document-level translation agent based on multi-level memory. In International Con- ference on Learning Representations (ICLR).
  151. Zhaowei Wang, Wei Fan, Qing Zong, Hongming Zhang, Sehyun Choi, Tianqing Fang, Xin Liu, Yangqiu Song, Ginny Wong, and Simon See. 2024k. AbsInstruct: Eliciting abstraction ability from LLMs through ex- planation tuning with plausibility estimation. In Pro- ceedings of the 62nd Annual Meeting of the Associa- tion for Computational Linguistics (Volume 1: Long Papers), pages 973-994, Bangkok, Thailand. Associ- ation for Computational Linguistics. · DOI
  152. Zhaowei Wang, Haochen Shi, Weiqi Wang, Tianqing Fang, Hongming Zhang, Sehyun Choi, Xin Liu, and Yangqiu Song. 2024l. AbsPyramid: Benchmarking the abstraction ability of language models with a uni- fied entailment graph. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 3991-4010, Mexico City, Mexico. Association for Computational Linguistics. · DOI
  153. Di Wu, Hongwei Wang, Wenhao Yu, Yuwei Zhang, Kai- Wei Chang, and Dong Yu. 2024a. Longmemeval: Benchmarking chat assistants on long-term interac- tive memory. arXiv preprint arXiv:2410.10813. · arXiv
  154. Xinwei Wu, Junzhuo Li, Minghui Xu, Weilong Dong, Shuangzhi Wu, Chao Bian, and Deyi Xiong. 2023. Depn: Detecting and editing privacy neurons in pre- trained language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Lan- guage Processing, pages 2875-2886.
  155. Yichen Wu, Hong Wang, Peilin Zhao, Yefeng Zheng, Ying Wei, and Long-Kai Huang. 2024b. Mitigating catastrophic forgetting in online continual learning by modeling previous task interrelations via pareto optimization. In Forty-first International Conference on Machine Learning.
  156. Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. 2024. Efficient streaming lan- guage models with attention sinks. In The Twelfth International Conference on Learning Representa- tions.
  157. Fangyuan Xu, Weijia Shi, and Eunsol Choi. 2024a. RE- COMP: Improving retrieval-augmented LMs with context compression and selective augmentation. In The Twelfth International Conference on Learning Representations.
  158. Jing Xu, Arthur Szlam, and Jason Weston. 2021. Be- yond goldfish memory: Long-term open-domain con- versation. arXiv preprint arXiv:2107.07567. · arXiv
  159. Rongwu Xu, Zehan Qi, Zhijiang Guo, Cunxiang Wang, Hongru Wang, Yue Zhang, and Wei Xu. 2024b. Knowledge conflicts for llms: A survey. arXiv preprint arXiv:2403.08319. · arXiv
  160. Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Jun- tao Tan, and Yongfeng Zhang. 2025. A-mem: Agentic memory for llm agents. arXiv preprint arXiv:2502.12110. · arXiv
  161. Xinchao Xu, Zhibin Gou, Wenquan Wu, Zheng-Yu Niu, Hua Wu, Haifeng Wang, and Shihang Wang. 2022. Long time no see! open-domain conversa- tion with long-term persona memory. arXiv preprint arXiv:2203.05797. · arXiv
  162. Yao Xu, Shizhu He, Jiabei Chen, Zihao Wang, Yangqiu Song, Hanghang Tong, Guang Liu, Kang Liu, and Jun Zhao. 2024c. Generate-on-graph: Treat llm as both agent and kg in incomplete knowl- edge graph question answering. arXiv preprint arXiv:2404.14741. · arXiv
  163. Hongkang Yang, Zehao Lin, Wenjin Wang, Hao Wu, Zhiyu Li, Bo Tang, Wenqiang Wei, Jinbo Wang, Zeyun Tang, Shichao Song, et al. 2024. memory 3 : Language modeling with explicit memory. arXiv preprint arXiv:2407.01178. · arXiv
  164. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Ben- gio, William W Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018. Hotpotqa: A dataset for diverse, explainable multi-hop question answer- ing. arXiv preprint arXiv:1809.09600. · arXiv
  165. Yuanshun Yao, Xiaojun Xu, and Yang Liu. 2024. Large language model unlearning. Advances in Neural Information Processing Systems, 37:105425-105475.
  166. Wen-tau Yih, Ming-Wei Chang, Xiaodong He, and Jian- feng Gao. 2016. The value of semantic parse labeling for knowledge base question answering. In Proceed- ings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2019-2029. Association for Computational Linguistics.
  167. Peter Young, Alice Lai, Micah Hodosh, and Julia Hock- enmaier. 2014. From image descriptions to visual denotations: New similarity metrics for semantic in- ference over event descriptions. Transactions of the Association for Computational Linguistics, 2:67-78.
  168. Xihang Yue, Linchao Zhu, and Yi Yang. 2024. FragRel: Exploiting fragment-level relations in the external memory of large language models. In Findings of the Association for Computational Linguistics: ACL 2024, pages 16348-16361, Bangkok, Thailand. As- sociation for Computational Linguistics. · DOI
  169. Ao Zhang, Yuan Yao, Wei Ji, Zhiyuan Liu, and Tat-Seng Chua. 2023a. Next-chat: An lmm for chat, detection and segmentation. arXiv preprint arXiv:2311.04498. · arXiv
  170. Ao Zhang, Yuan Yao, Wei Ji, Zhiyuan Liu, and Tat-Seng Chua. 2023b. Next-chat: An lmm for chat, detection and segmentation. arXiv preprint arXiv:2311.04498. · arXiv
  171. Kai Zhang, Yangyang Kang, Fubang Zhao, and Xi- aozhong Liu. 2023c. Llm-based medical assistant personalization with short-and long-term memory coordination. arXiv preprint arXiv:2309.11696. · arXiv
  172. Ningyu Zhang, Yunzhi Yao, Bozhong Tian, Peng Wang, Shumin Deng, Mengru Wang, Zekun Xi, Shengyu Mao, Jintian Zhang, Yuansheng Ni, et al. 2024b. A comprehensive study of knowledge editing for large language models. arXiv preprint arXiv:2401.01286. · arXiv
  173. Taolin Zhang, Qizhou Chen, Dongyang Li, Chengyu Wang, Xiaofeng He, Longtao Huang, Jun Huang, et al. 2024c. Dafnet: Dynamic auxiliary fusion for sequential model editing in large language models. In Findings of the Association for Computational Linguistics ACL 2024, pages 1588-1602.
  174. Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, and Ji- Rong Wen. 2024d. A survey on the memory mech- anism of large language model based agents. arXiv preprint arXiv:2404.13501. · arXiv
  175. Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuan- dong Tian, Christopher Re, Clark Barrett, Zhangyang Wang, and Beidi Chen. 2023d. H2o: Heavy-hitter oracle for efficient generative inference of large lan- guage models. In Thirty-seventh Conference on Neu- ral Information Processing Systems.
  176. Wenting Zhao, Ye Liu, Tong Niu, Yao Wan, Philip Yu, Shafiq Joty, Yingbo Zhou, and Semih Yavuz. 2024a. DIVKNOWQA: Assessing the reasoning ability of LLMs via open-domain question answering over knowledge base and text. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 51-68, Mexico City, Mexico. Associa- tion for Computational Linguistics. · DOI
  177. Wenting Zhao, Ye Liu, Tong Niu, Yao Wan, Philip S. Yu, Shafiq Joty, Yingbo Zhou, and Semih Yavuz. 2024b. DIVKNOWQA: Assessing the reasoning ability of LLMs via open-domain question answering over knowledge base and text. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 51-68. Association for Computational Linguistics. · DOI
  178. Zhengyi Zhao, Shubo Zhang, Yiming Du, Bin Liang, Baojun Wang, Zhongyang Li, Binyang Li, and Kam- Fai Wong. 2025. Eventweave: A dynamic framework for capturing core and supporting events in dialogue systems. arXiv preprint arXiv:2503.23078. · arXiv
  179. Ce Zheng, Lei Li, Qingxiu Dong, Yuxuan Fan, Zhiyong Wu, Jingjing Xu, and Baobao Chang. 2023. Can we edit factual knowledge by in-context learning? In Proceedings of the 2023 Conference on Empiri- cal Methods in Natural Language Processing, pages 4862-4876.
  180. Longtao Zheng, Rundong Wang, Xinrun Wang, and Bo An. 2024. Synapse: Trajectory-as-exemplar prompting with memory for computer control. In Proceedings of the International Conference on Learning Representations (ICLR).
  181. Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang. 2024. Memorybank: Enhancing large language models with long-term memory. In Pro- ceedings of the AAAI Conference on Artificial Intelli- gence, volume 38, pages 19724-19731.
  182. Zexuan Zhong, Zhengxuan Wu, Christopher D Manning, Christopher Potts, and Danqi Chen. 2023. Mquake: Assessing knowledge editing in language models via multi-hop questions. In Proceedings of the 2023 Con- ference on Empirical Methods in Natural Language Processing, pages 15686-15702.
  183. Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, and Yongping Xiong. 2024. Vista: Visualized text em- bedding for universal multi-modal retrieval. In Pro- ceedings of the 62nd Annual Meeting of the Associa- tion for Computational Linguistics (Volume 1: Long Papers), pages 3185-3200.
  184. Yun Zhu, Jia-Chen Gu, Caitlin Sikora, Ho Ko, Yinxiao Liu, Chu-Cheng Lin, Lei Shu, Liangchen Luo, Lei Meng, Bang Liu, and Jindong Chen. 2025. Acceler- ating inference of retrieval-augmented generation via sparse context selection. In The Thirteenth Interna- tional Conference on Learning Representations.

Cited by

Sorted by citations

Related

Authors
Du, Y., Huang, W., Zheng, D., Wang, Z., Montella, S., Lapata, M., Wong, K.-F., & Pan, J. Z.
Affiliations
  • Chinese University of Hong Kong (HK)
  • University of Edinburgh (GB)
  • Hong Kong University of Science and Technology (HK)
  • Huawei Technologies (China) (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2505.00675
arXiv
2505.00675
OpenAlex
W6892020006
Cited by
1
References
0
Citations by year
2025: 1
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, public-domain)
  • arXiv (Cornell University) (public-domain)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords
LLM agents, parametric memory, contextual memory, memory consolidation, memory updating, forgetting, retrieval, long-term memory

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review