Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 206 of the 206 references it cites were found in a registry or an index.

Lifelong Learning of Large Language Model Based Agents: A Roadmap

Zheng, Junhao, Shi, Chengming, Cai, Xidi, Li, Qiuke, Zhang, Duzhen, Li, Chenxing, Yu, Dong, Ma, Qianli · 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models (LLMs) have demonstrated impressive capabilities in natural language processing, existing LLM agents are typically designed for static systems and lack the ability to adapt over time in response to new challenges. This survey is the first to systematically summarize the potential techniques for incorporating lifelong learning into LLM-based agents. We categorize the core components of these agents into three modules: the perception module for multimodal input integration, the memory module for storing and retrieving evolving knowledge, and the action module for grounded interactions with the dynamic environment. We highlight how these pillars collectively enable continuous adaptation, mitigate catastrophic forgetting, and improve long-term performance. This survey provides a roadmap for researchers and practitioners working to develop lifelong learning capabilities in LLM agents, offering insights into emerging trends, evaluation metrics, and application scenarios.

Overview

Integrity signals

Registry

Crossref · 10.1109/tpami.2025.3650546

Cites

206 of 206 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 98 references

Research works printed but not linked: 5

  1. Zhou, 2024, WebArena: A realistic web environment for building autonomous agents
  2. Ding, 2020, CogLTX: Applying bert to long texts, 33, 12792
  3. Lu, 2021, Container: Context aggregation network, 34, 1960
  4. Zhang, 2024, CPPO: Continual learning for reinforcement learning with human feedback
  5. Raman, 2022, Planning with large language models via corrective re-prompting

Cited by

See all 10

Metadata

Authors
Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q.
Affiliations
  • South China University of Technology (CN)
  • Mohamed bin Zayed University of Artificial Intelligence (AE)
  • Tencent (China) (CN)
  • Tencent AI Lab, Bellevue, WA, USA
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2026-05
Volume
48
Issue
5
Pages
5552-5571
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W7118167202
Cited by
7
References
98
Citations by year
2026: 5
FWCI
4.77
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (62272173, 62273109)
  • Natural Science Foundation of Guangdong Province (2024A1515010089, 2022A1515010179)
  • Science and Technology Planning Project of Guangdong Province (2023A0505050106)
  • National Key R&D Program of China (2023YFA1011601)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
Keywords
lifelong learning, continual learning, LLM agents, artificial general intelligence, catastrophic forgetting, memory modules, multisensory perception, knowledge retrieval, long-term performance
MeSH terms
Large Language Models, Artificial Intelligence, Humans, Language, Learning, Natural Language Processing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Lifelong Learning of Large Language Model Based Agents: A Roadmap. https://app.cochat.ai/papers/10.1109/tpami.2025.3650546
The paper
Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q. (2026). Lifelong Learning of Large Language Model Based Agents: A Roadmap. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2025.3650546

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.