The DOI matches its Crossref record; 206 of the 206 references it cites were found in a registry or an index.
Lifelong Learning of Large Language Model Based Agents: A Roadmap
Abstract
Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models (LLMs) have demonstrated impressive capabilities in natural language processing, existing LLM agents are typically designed for static systems and lack the ability to adapt over time in response to new challenges. This survey is the first to systematically summarize the potential techniques for incorporating lifelong learning into LLM-based agents. We categorize the core components of these agents into three modules: the perception module for multimodal input integration, the memory module for storing and retrieving evolving knowledge, and the action module for grounded interactions with the dynamic environment. We highlight how these pillars collectively enable continuous adaptation, mitigate catastrophic forgetting, and improve long-term performance. This survey provides a roadmap for researchers and practitioners working to develop lifelong learning capabilities in LLM agents, offering insights into emerging trends, evaluation metrics, and application scenarios.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Empirically, this kind of reviewer setup has been shown to reduce hallucinations in LLM-generated answers [47,48].”
From A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis (2026) · cites this paper as [47]
In the citing paper
“Zheng et al. (2025) outlined strategies for incorporating lifelong learning into agent architecture by dividing the system into a perception module (to handle new modalities), a memory module (to accumulate evolving knowledge), and an action module (to adapt behaviors) [47].”
From A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis (2026) · cites this paper as [47]
In the citing paper
“An agent adopting a poorly designed memory architecture can suffer from factual contradictions, catastrophic forgetting, or unacceptable latencies during continuous execution [6, 38].”
From Are We Ready For An Agent-Native Memory System? (2026) · cites this paper as [38]
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Yang, A., Li, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Gao, C., Huang, C., Lv, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.09388 · Cited by 17,283
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · cited 1×
“In industrial applications such as robotics and autonomous vehicles, deep lifelong learning methods—including Elastic Weight Consolidation (EWC) [36]—have enabled systems to adapt to new tasks while preserving previously acquired skills, thereby supporting long-term autonomy and operational…”
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
Knowledge Distillation: A Survey
Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01453-z · Cited by 3,931 · cited 1×
“Additionally, by combining knowledge distillation [63], [64], [65] and regularization methods, some studies [62], [66], [67], [68] leverage the high-performance capability of the teacher model in one modality to transfer its knowledge to the student model through constraint-based mapping.”
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770 · cited 3×
“Whilehumanscannaturallyintegratenewknowledge whileretainingtheold,currentAIsystemsfacetwomainchal-lengesinlifelonglearning: catastrophic forgetting [6] and loss of plasticity [7], [8].”
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126 · cited 1×
“Restrictions apply. safety-critical domains such as healthcare [186] or autonomous systems.”
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.00352 · Cited by 2,825
Research works printed but not linked: 5
- Zhou, 2024, WebArena: A realistic web environment for building autonomous agents
- Ding, 2020, CogLTX: Applying bert to long texts, 33, 12792
- Lu, 2021, Container: Context aggregation network, 34, 1960
- Zhang, 2024, CPPO: Continual learning for reinforcement learning with human feedback
- Raman, 2022, Planning with large language models via corrective re-prompting
Cited by
A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents
Huang, W.-C., Zhang, W., Liang, Y., Bei, Y., Chen, Y., Feng, T., Pan, X., Tan, Z., Wang, Y., Wei, T., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.06052 · Cited by 70
From System 1 to System 2: A Survey of Reasoning Large Language Models
Zhang, D., Li, Z., Zhang, M.-L., Zhang, J., Liu, Z., Yao, Y., Xu, H., Zheng, J., Chen, X., Zhang, Y., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3637037 · Cited by 611
“However, standard LLMs are prone to catastrophic forgetting, where updates for new tasks overwrite previous capabilities, and often struggle with domain shifts in reasoning contexts [244].”
Self-citationDeep Reinforcement Learning in the Era of Foundation Models: A Survey
Mienye, I. D., Esenogho, E., & Modisane, C. (2026) · Computers · doi:10.3390/computers15010040 · Cited by 13
A Holistic Review of Agentic AI Frameworks, Applications, and Research Trajectories
Peykani, P., Ghanidel, S., Javadi-Sisi, I., Snåšel, V., & Mirjalili, S. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10675-8 · Cited by 6
A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis
Spieser, J., Balapour, A., Meller, J., Patra, K. C., & Shamsaei, B. (2026) · Methods and Protocols · doi:10.3390/mps9020033 · Cited by 5
“Empirically, this kind of reviewer setup has been shown to reduce hallucinations in LLM-generated answers [47,48].”
Influential
Metadata
- Authors
- Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q.
- Affiliations
- South China University of Technology (CN)
- Mohamed bin Zayed University of Artificial Intelligence (AE)
- Tencent (China) (CN)
- Tencent AI Lab, Bellevue, WA, USA
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2026-05
- Volume
- 48
- Issue
- 5
- Pages
- 5552-5571
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W7118167202
- Cited by
- 7
- References
- 98
- Citations by year
- 2026: 5
- FWCI
- 4.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (62272173, 62273109)
- Natural Science Foundation of Guangdong Province (2024A1515010089, 2022A1515010179)
- Science and Technology Planning Project of Guangdong Province (2023A0505050106)
- National Key R&D Program of China (2023YFA1011601)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- lifelong learning, continual learning, LLM agents, artificial general intelligence, catastrophic forgetting, memory modules, multisensory perception, knowledge retrieval, long-term performance
- MeSH terms
- Large Language Models, Artificial Intelligence, Humans, Language, Learning, Natural Language Processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Lifelong Learning of Large Language Model Based Agents: A Roadmap. https://app.cochat.ai/papers/10.1109/tpami.2025.3650546
- The paper
- Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q. (2026). Lifelong Learning of Large Language Model Based Agents: A Roadmap. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2025.3650546
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.