Larimar: Large Language Models with Episodic Memory Control
Open accessAbstract
Efficient and accurate updating of knowledge stored in Large Language Models (LLMs) is one of the most pressing research challenges today. This paper presents Larimar - a novel, brain-inspired architecture for enhancing LLMs with a distributed episodic memory. Larimar's memory allows for dynamic, one-shot updates of knowledge without the need for computationally expensive re-training or fine-tuning. Experimental results on multiple fact editing benchmarks demonstrate that Larimar attains accuracy comparable to most competitive baselines, even in the challenging sequential editing setup, but also excels in speed - yielding speed-ups of 8-10x depending on the base LLM - as well as flexibility due to the proposed architecture being simple, LLM-agnostic, and hence general. We further provide mechanisms for selective fact forgetting, information leakage prevention, and input context length generalization with Larimar and show their effectiveness. Our code is available at https://github.com/IBM/larimar
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Non-parametric episodic memory is widely employed in AI systems; it involves utilizing event-specific data to support task execution and offers experiential knowledge, functioning as an extension to the inherently limited context of AI systems.
“In contrast, non-parametric episodic memory is widely employed in AI systems. It involves utilizing event-specific data to support task execution. This memory type offers experiential knowledge, functioning as an extension to the inherently limited context of AI systems [187, 190, 191], which can enhance the system's capabilities across a range of applications.”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [190]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredSome AI long-term memory research is directly inspired by human long-term memory, while other studies align with human long-term memory processing mechanisms without intentional imitation.
“some AI long-term memory research is directly inspired by human long-term memory [245, 11, 14, 190, 191], while other studies align with human long-term memory processing mechanisms without intentional imitation.”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [190]
Larimar focuses on fast and efficient learning of contextual information and differs from the proposed work in its focus on memory updates and adaptation rather than long-term retrieval.
“Larimar [5] is another recent approach that focuses on fast and efficient learning of contextual information. While Larimar shares the goal of improving context-awareness, it differs from your work in its focus on memory updates and adaptation rather than long-term retrieval.”
From Memory-Augmented Architecture for Long-Term Context Handling in Large Language Models (2026) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 36
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018. · arXiv
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learn- ing with a unified text-to-text transformer. The Journal of Machine Learning Research, 21(1):5485-5551, 2020.
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Sub- biah, Jared D Kaplan, Prafulla Dhariwal, Arvind Nee- lakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Ad- vances in neural information processing systems, 33: 1877-1901, 2020.
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.
- Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. Language models as knowledge bases? In Pro- ceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th Interna- tional Joint Conference on Natural Language Process- ing (EMNLP-IJCNLP), pages 2463-2473, 2019.
- Cem Anil, Yuhuai Wu, Anders Johan Andreassen, Aitor Lewkowycz, Vedant Misra, Vinay Venkatesh Ramasesh, Ambrose Slone, Guy Gur-Ari, Ethan Dyer, and Behnam Neyshabur. Exploring length generalization in large language models. In Alice H. Oh, Alekh Agar- wal, Danielle Belgrave, and Kyunghyun Cho, editors, Advances in Neural Information Processing Systems, 2022. URL https://openreview.net/forum? id=zSkYVeX7bC4.
- James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska- Barwinska, et al. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences, 114(13):3521-3526, 2017.
- William P Dempsey, Zhuowei Du, Anna Nadtochiy, Colton D Smith, Karl Czajkowski, Andrey Andreev, Drew N Robson, Jennifer M Li, Serina Applebaum, Thai V Truong, et al. Regional synapse gain and loss accompany memory formation in larval zebrafish. Pro- ceedings of the National Academy of Sciences, 119(3): e2107661119, 2022.
- Livia Autore, James D O'Leary, Clara Ortega-de San Luis, and Tomás J Ryan. Adaptive expression of engrams by retroactive interference. bioRxiv, pages 2023-03, 2023.
- Máté Lengyel and Peter Dayan. Hippocampal contribu- tions to control: the third way. Advances in neural infor- mation processing systems, 20, 2007.
- Dharshan Kumaran, Demis Hassabis, and James L McClel- land. What learning systems do intelligent agents need? complementary learning systems theory updated. Trends in cognitive sciences, 20(7):512-534, 2016.
- Weinan Sun, Madhu Advani, Nelson Spruston, Andrew Saxe, and James E Fitzgerald. Organizing memories for generalization in complementary learning systems. Na- ture neuroscience, 26(8):1438-1448, 2023.
- Steve Ramirez, Xu Liu, Pei-Ann Lin, Junghyup Suh, Michele Pignatelli, Roger L Redondo, Tomás J Ryan, and Susumu Tonegawa. Creating a false memory in the hippocampus. Science, 341(6144):387-391, 2013.
- Kha Pham, Hung Le, Man Ngo, Truyen Tran, Bao Ho, and Svetha Venkatesh. Generative pseudo-inverse mem- ory. In International Conference on Learning Represen- tations, 2021.
- Diederik P Kingma and Max Welling. Auto-encoding vari- ational bayes. arXiv preprint arXiv:1312.6114, 2013. · arXiv
- Eric Mitchell, Charles Lin, Antoine Bosselut, Christo- pher D Manning, and Chelsea Finn. Memory-based model editing at scale. In International Conference On Machine Learning, Vol 162. JMLR-JOURNAL MA- CHINE LEARNING RESEARCH, 2022.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners. OpenAI blog, 1(8): 9, 2019.
- Yunzhi Yao, Peng Wang, Bozhong Tian, Siyuan Cheng, Zhoubo Li, Shumin Deng, Huajun Chen, and Ningyu Zhang. Editing large language models: Prob- lems, methods, and opportunities. arXiv preprint arXiv:2305.13172, 2023. · arXiv
- Kevin Meng, David Bau, Alex Andonian, and Yonatan Be- linkov. Locating and editing factual associations in gpt. Advances in Neural Information Processing Systems, 35: 17359-17372, 2022a.
- Thomas Hartvigsen, Swami Sankaranarayanan, Hamid Palangi, Yoon Kim, and Marzyeh Ghassemi. Aging with grace: Lifelong model editing with discrete key-value adaptors. arXiv preprint arXiv:2211.11031, 2022. · arXiv
- Silvy HP Collin, Branka Milivojevic, and Christian F Doeller. Memory hierarchies map onto the hippocam- pal long axis in humans. Nature neuroscience, 18(11): 1562-1564, 2015.
- Jason Weston, Sumit Chopra, and Antoine Bordes. Mem- ory networks. arXiv preprint arXiv:1410.3916, 2014. · arXiv
- Alex Graves, Greg Wayne, and Ivo Danihelka. Neural tur- ing machines. arXiv preprint arXiv:1410.5401, 2014. · arXiv
- Pentti Kanerva. Sparse distributed memory. MIT press, 1988.
- Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. Generalization through memorization: Nearest neighbor language models. arXiv preprint arXiv:1911.00172, 2019. · arXiv
- Ningyu Zhang, Yunzhi Yao, Bozhong Tian, Peng Wang, Shumin Deng, Mengru Wang, Zekun Xi, Shengyu Mao, Jintian Zhang, Yuansheng Ni, et al. A comprehensive study of knowledge editing for large language models. arXiv preprint arXiv:2401.01286, 2024. · arXiv
- Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, and Zhang Xiong. Transformer-patcher: One mistake worth one neuron. In The Eleventh In- ternational Conference on Learning Representations, 2023. URL https://openreview.net/forum? id=4oYUGeGBPm.
- Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D Manning. Fast model editing at scale. arXiv preprint arXiv:2110.11309, 2021. · arXiv
- Nicola De Cao, Wilker Aziz, and Ivan Titov. Editing factual knowledge in language models. arXiv preprint arXiv:2104.08164, 2021. · arXiv
- Kevin Meng, Arnab Sen Sharma, Alex Andonian, Yonatan Belinkov, and David Bau. Mass-editing memory in a transformer. arXiv preprint arXiv:2210.07229, 2022b. · arXiv
- Peter Hase, Mohit Bansal, Been Kim, and Asma Ghan- deharioun. Does localization inform editing? surpris- ing differences in causality-based localization vs. knowl- edge editing in language models. In Thirty-seventh Conference on Neural Information Processing Systems, 2023. URL https://openreview.net/forum? id=EldbUlZtbd.
- Akshat Gupta, Anurag Rao, and Gopala Anumanchipalli. Model editing at scale leads to gradual and catastrophic forgetting. arXiv preprint arXiv:2401.07453, 2024. · arXiv
- Charles Yu, Sullam Jeoung, Anish Kasi, Pengfei Yu, and Heng Ji. Unlearning bias in language models by par- titioning gradients. In Findings of the Association for Computational Linguistics: ACL 2023, pages 6032- 6048, 2023.
- Jiaao Chen and Diyi Yang. Unlearn what you want to forget: Efficient unlearning for llms. arXiv preprint arXiv:2310.20150, 2023. · arXiv
- Martin Pawelczyk, Seth Neel, and Himabindu Lakkaraju. In-context unlearning: Language models as few shot un- learners. arXiv preprint arXiv:2310.07579, 2023. · arXiv
- Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Baobao Chang, and Furu Wei. Knowledge neurons in pretrained transformers. arXiv preprint arXiv:2104.08696, 2021. · arXiv
Cited by
Sorted by citations
A Survey of Context Engineering for Large Language Models
Mei, L., Yao, J., Ge, Y., Wang, Y., Bi, B., Cai, Y., Liu, J., Li, M., Li, Z.-Z., Zhang, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.13334 · Cited by 13 · see citing works
Yager, K. G. (2024) · Digital Discovery · doi:10.1039/d4dd00178h · Cited by 12 · see citing works
Towards large language models with human-like episodic memory
Dong, C., Lu, Q., Norman, K. A., & Michelmann, S. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.06.016 · Cited by 10 · see citing works
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3 · see citing works
“…of human long-term memory, including storage, retrieval, and forgetting processes; some AI long-term memory research is directly inspired by human long-term memory [239, 11, 14, 184, 185], while other studies align with human long-term memory processing mechanisms without intentional imitation.”
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Luo, J., Tian, Y., Cao, C., Luo, Z., Lin, H., Li, K., Kong, C., Yang, R., & Ma, J. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.2069 · Cited by 3 · see citing works
“…from the design of storage toward the optimization of retrieval, including retrieval based on semantic proximity (Melz, 2023; Liu et al., 2024; Das et al., 2024) as well as weighted retrieval that incorporates temporal decay and scores for importance (Zhong et al., 2023; Park et al., 2023).”
MIRIX: Multi-Agent Memory System for LLM-Based Agents
Wang, Y., & Chen, X. (2025) · arXiv · doi:10.48550/arxiv.2507.07957 · Cited by 2 · see citing works
“These memory components can reside in various latent forms, including model parameters[30], external memory matrices [8, 21], hidden states [2, 10, 28, 31], soft prompts [3], and key-value caches [38, 9, 16, 37].”
MemGym: a Long-Horizon Memory Environment for LLM Agents
Xu, W., Wang, Y., Mei, K., Liang, K., Wang, Z., Jin, M., Zhang, H., Zhang, S.-X., Hua, W., Sahu, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2605.20833
Memory-Augmented Architecture for Long-Term Context Handling in Large Language Models
Shinwari, H. U. K., & Usama, M. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3701680
“…2) RAG [11], a retrieval-augmented model; 3) Compressive Transformers [8], which uses compression for memory; 4) CAMELoT [10]; 5) Larimar [9]; 6) memorizing transformers [7]; 7) RecurrentGPT [6], which uses summarization; 8) MemoryBank [5]; and 9) LongMem [4], a strong recent baseline…”
Agentic Correlates of Consciousness and the Pursuit of Artificial General Intelligence
Gray, S., Tambouratzis, G., Venugopal, S., Raghavan, S., Tong, R. J., & Han, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-00686-8_21
Memory-Augmented Architecture for Long-Term Context Handling in Large Language Models
Shinwari, H. U. K., & Usama, M. (2025) · arXiv
- Authors
- Das, P., Chaudhury, S., Nelson, E., Melnyk, I., Swaminathan, S., Dai, S., Lozano, A., Kollias, G., Chenthamarakshan, V., Jiří, Navrátil, Dan, S., & Chen, P.-Y.
- Affiliations
- Princeton University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2403.11901
- OpenAlex
- W4392971664
- Cited by
- 3
- References
- 0
- Citations by year
- 2025: 2 · 2024: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, episodic memory, brain-inspired architecture, distributed memory, data loss prevention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
