Empowering Working Memory for Large Language Model Agents
Open accessAbstract
Large language models (LLMs) have achieved impressive linguistic capabilities. However, a key limitation persists in their lack of human-like memory faculties. LLMs exhibit constrained memory retention across sequential interactions, hindering complex reasoning. This paper explores the potential of applying cognitive psychology's working memory frameworks, to enhance LLM architecture. The limitations of traditional LLM memory designs are analyzed, including their isolation of distinct dialog episodes and lack of persistent memory links. To address this, an innovative model is proposed incorporating a centralized Working Memory Hub and Episodic Buffer access to retain memories across episodes. This architecture aims to provide greater continuity for nuanced contextual reasoning during intricate tasks and collaborative scenarios. While promising, further research is required into optimizing episodic memory encoding, storage, prioritization, retrieval, and security. Overall, this paper provides a strategic blueprint for developing LLM agents with more sophisticated, human-like memory capabilities, highlighting memory mechanisms as a vital frontier in artificial general intelligence.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Agentic AI incorporates memory subsystems to preserve and persist knowledge across task cycles or agent sessions.
“Unlike traditional agents, Agentic AI incorporates memory subsystems to preserve and persist knowledge across task cycles or agent sessions [165, 166].”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [165]
Agents respond to environmental or user input, but response latency caused by repeated LLM inference calls, coupled with narrow contextual memory windows, inhibits real-time adaptability.
“Agents do respond to environmental or user input, but response latency caused by repeated LLM inference calls [198,199], coupled with narrow contextual memory windows [165,200], inhibits real-time adaptability.”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [165]
Agentic AI incorporates memory subsystems to preserve and persist knowledge across task cycles or agent sessions.
“Agentic AI incorporates memory subsystems to preserve and persist knowledge across task cycles or agent sessions [167], [168].”
From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [167]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 12
- Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language Models are Few-Shot Learners (arXiv:2005.14165). arXiv. https://doi.org/10.48550/arXiv.2005.14165 · DOI · Paper page
- Cornago, S., Ramakrishna, S., & Low, J. S. C. (2023). How can Transformers and large language models like ChatGPT help LCA practitioners? Resources, Conservation and Recycling, 196, 107062. https://doi.org/10.1016/j.resconrec.2023.107062 · DOI
- Graves, A., Wayne, G., & Danihelka, I. (2014). Neural Turing Machines (arXiv:1410.5401). arXiv. https://doi.org/10.48550/arXiv.1410.5401 · DOI · Paper page
- Rillig, M. C., Ågerstrand, M., Bi, M., Gould, K. A., & Sauerland, U. (2023). Risks and Benefits of Large Language Models for the Environment. Environmental Science & Technology, 57(9), 3464-3466. https://doi.org/10.1021/acs.est.3c01106 · DOI
- Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015). End-To -End Memory Networks (arXiv:1503.08895). arXiv. https://doi.org/10.48550/arXiv.1503.08895 · DOI · Paper page
- Wang, K., Lu, Y., Santacroce, M., Gong, Y., Zhang, C., & Shen, Y. (2023). Adapting LLM Agents Through Communication (arXiv:2310.01444). arXiv. https://doi.org/10.48550/arXiv.2310.01444 · DOI
- Wang, Q., Ding, L., Cao, Y., Tian, Z., Wang, S., Tao, D., & Guo, L. (2023). Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models (arXiv:2308.15022). arXiv. https://doi.org/10.48550/arXiv.2308.15022 · DOI · Paper page
- Wang, W., Dong, L., Cheng, H., Liu, X., Yan, X., Gao, J., & Wei, F. (2023). Augmenting Language Models with Long-Term Memory (arXiv:2306.07174). arXiv. https://doi.org/10.48550/arXiv.2306.07174 · DOI · Paper page
- Weston, J., Chopra, S., & Bordes, A. (2015). Memory Networks (arXiv:1410.3916). arXiv. https://doi.org/10.48550/arXiv.1410.3916 · DOI
- Zhang, K., Zhao, F., Kang, Y., & Liu, X. (2023). Memory-Augmented LLM Personalization with Short-and Long-Term Memory Coordination (arXiv:2309.11696). arXiv. https://doi.org/10.48550/arXiv.2309.11696 · DOI · Paper page
- Zhou, W., Jiang, Y. E., Cui, P., Wang, T., Xiao, Z., Hou, Y., Cotterell, R., & Sachan, M. (2023). RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text (arXiv:2305.13304). arXiv. https://doi.org/10.48550/arXiv.2305.13304 · DOI · Paper page
- Zhu, D., Yang, N., Wang, L., Song, Y., Wu, W., Wei, F., & Li, S. (2023). PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training (arXiv:2309.10400). arXiv. https://doi.org/10.48550/arXiv.2309.10400 · DOI
Cited by
Sorted by citations
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 244 · see citing works
“This structured coordination allows for more complex goal pur-11”
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15161 · Cited by 186 · see citing works
A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
Su, H., Luo, J., Liu, C., Yang, X., Zhang, Y., Dong, Y., & Zhu, J. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3688650 · Cited by 11 · see citing works
The AI Hippocampus: How Far are We From Human Memory?
Jia, Z., Li, J., Kang, Y., Wang, Y., Wu, T., Wang, Q., Wang, X., Zhang, S., Shen, J., Li, Q., et al. (2026) · arXiv · doi:10.48550/arxiv.2601.09113
Self-citationPiao, J., Yan, Y., Zhang, J., Li, N., Yan, J., Lan, X., Lu, Z., Zheng, Z., Wang, J. Y., Zhou, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.08691 · Cited by 43 · see citing works
“These works borrow the memory and reasoning mechanism of humankind [43, 114] to design various internal mechanisms on the basis of large language models as brains.”
Self-citation
- Authors
- Guo, J., Li, N., Qi, J., Yang, H., Li, R., Feng, Y., Zhang, S., & Xu, M.
- Affiliations
- Tsinghua University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2312.17259
- OpenAlex
- W4390489503
- Cited by
- 4
- References
- 0
- Citations by year
- 2025: 2 · 2024: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- LLM agents, working memory, episodic buffer, episodic memory, LLM architecture, contextual reasoning, artificial general intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
