CoChat
Sign Up
PreprintCited by 4Domain Adaptation and Few-Shot LearningTopic ModelingData Stream Mining Techniques

The Future of Continual Learning in the Era of Foundation Models: Three Key Directions

Open access
Bell, Jack, Quarantiello, Luigi, Coleman, Eric Nuertey, Li, Lanpei, Li, Malio, Madeddu, Mauro, Piccoli, Elia, Lomonaco, Vincenzo·2025·arXiv
DOI 10.48550/arxiv.2506.03320arXiv 2506.03320
Open this paper in CoChat — free accountOpen PDF

Abstract

Continual learning--the ability to acquire, retain, and refine knowledge over time--has always been fundamental to intelligence, both human and artificial. Historically, different AI paradigms have acknowledged this need, albeit with varying priorities: early expert and production systems focused on incremental knowledge consolidation, while reinforcement learning emphasised dynamic adaptation. With the rise of deep learning, deep continual learning has primarily focused on learning robust and reusable representations over time to solve sequences of increasingly complex tasks. However, the emergence of Large Language Models (LLMs) and foundation models has raised the question: Do we still need continual learning when centralised, monolithic models can tackle diverse tasks with access to internet-scale knowledge? We argue that continual learning remains essential for three key reasons: (i) continual pre-training is still necessary to ensure foundation models remain up to date, mitigating knowledge staleness and distribution shifts while integrating new information; (ii) continual fine-tuning enables models to specialise and personalise, adapting to domain-specific tasks, user preferences, and real-world constraints without full retraining, avoiding the need for computationally expensive long context-windows; (iii) continual compositionality offers a scalable and modular approach to intelligence, enabling the orchestration of foundation models and agents to be dynamically composed, recombined, and adapted. While continual pre-training and fine-tuning are explored as niche research directions, we argue it is continual compositionality that will mark the rebirth of continual learning. The future of AI will not be defined by a single static model but by an ecosystem of continually evolving and interacting models, making continual learning more relevant than ever.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2506.03320

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • As the field enters the 'second half', the central challenge becomes real utility in long-horizon, dynamic, and user-dependent settings such as agentic coding, deep research, and computer use.

    “As the field enters the 'second half,' the central challenge becomes real utility in long-horizon, dynamic, and user-dependent settings such as agentic coding, deep research, and computer use, where LLM-based agents face context explosion beyond fixed context windows and must continuously accumulate, manage, and selectively reuse large volumes of information across extended interactions.”

    From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Bell et al., 2025

    Section 5 (p. 14) identifies adaptation to dynamic real-world environments as a major challenge, and Section 4.3.3 (p. 14) discusses agents responding to user tasks and accumulating reusable experience. Our copy does not frame this as the field’s “second half” or identify agentic coding, deep research, and computer use as the settings that define the central challenge. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Catastrophic forgetting of continual memorization is inherent in LLMs.

    “Self-evolving agents must continuously adapt to new tasks while retaining previously acquired knowledge, a challenge exacerbated by the catastrophic forgetting phenomenon (Ghosal et al., 2024) of continual memorization (Chen et al., 2024b) inherent in LLMs (Bell et al., 2025).”

    From A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence (2025) · cites this paper as Bell et al., 2025

    Section 4.1.2 (p. 7) describes catastrophic forgetting as a critical challenge when foundation models are continually updated, and Section 4.2.2 (p. 10) says continual fine-tuning methods experience it. The paper does not specifically identify forgetting of “continual memorization” as inherent in LLMs; the Introduction (p. 2) instead notes their reduced propensity for catastrophic forgetting. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 100

  1. [2][2] G. Ditzler, M. Roveri, C. Alippi, R. Polikar, Learning in nonstationary environments: A survey, IEEE Computational Intelligence Magazine 10 (2015) 12-25. -
  2. [5][5] F. Giannini, G. Ziffer, A. Cossu, V. Lomonaco, Streaming Continual Learning for Unified Adaptive Intelligence in Dynamic Environments, IEEE Intelligent Systems 39 (2024) 81-85. URL: https://ieeexplore.ieee.org/document/10779199/?arnumber=10779199. doi: 10.1109/MIS.2024. 3479469 , conference Name: IEEE Intelligent Systems. - · DOI
  3. [6][6] W. Li, F. Qi, R. Yan, H. Zhang, W. Lei, J. Tang, J. Luo, Continual Learning meets Multimodal Foundation Models: Fundamentals and Advances, in: Proceedings of the 1st on Continual Learning meets Multimodal Foundation Models: Fundamentals and Advances, ACMMM CL'24, Association for Computing Machinery, New York, NY, USA, 2024, pp. 1-4. URL: https://dl.acm. org/doi/10.1145/3688859.3690083. doi: 10.1145/3688859.3690083 . - · DOI
  4. [8][8] J. Zheng, C. Shi, X. Cai, Q. Li, D. Zhang, C. Li, D. Yu, Q. Ma, Lifelong Learning of Large Language Model based Agents: A Roadmap, 2025. URL: http://arxiv.org/abs/2501.07278. doi: 10.48550/ arXiv.2501.07278 , arXiv:2501.07278 [cs]. - · arXiv
  5. [9][9] H. Shi, Z. Xu, H. Wang, W. Qin, W. Wang, Y. Wang, Z. Wang, S. Ebrahimi, H. Wang, Continual learning of large language models: A comprehensive survey, arXiv preprint arXiv:2404.16789 (2024). - · arXiv
  6. [14][14] Z. Cai, B. Chang, W. Han, Human-in-the-loop through chain-of-thought, arXiv preprint arXiv:2306.07932 (2023). - · arXiv
  7. [17][17] L. Hong, S. E. Page, Groups of diverse problem solvers can outperform groups of high-ability problem solvers, Proceedings of the National Academy of Sciences 101 (2004) 16385-16389. -
  8. [18][18] T. Lesort, V. Lomonaco, A. Stoian, D. Maltoni, D. Filliat, N. Díaz-Rodríguez, Continual Learning for Robotics: Definition, Framework, Learning Strategies, Opportunities and Challenges, 2019. URL: http://arxiv.org/abs/1907.00182. doi: 10.48550/arXiv.1907.00182 , arXiv:1907.00182 [cs]. - · DOI
  9. [20][20] R. Ratcliff, Connectionist models of recognition memory: constraints imposed by learning and 21. forgetting functions., Psychological review 97 (1990) 285. -
  10. [21][21] R. K. Srivastava, J. Masci, S. Kazerounian, F. Gomez, J. Schmidhuber, Compete to Compute, in: C. J. Burges, L. Bottou, M. Welling, Z. Ghahramani, K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems, volume 26, Curran Associates, Inc., 2013. URL: https://proceedings. neurips.cc/paper\_files/paper/2013/file/8f1d43620bc6bb580df6e80b0dc05c48-Paper.pdf. -
  11. [23][23] Z. Li, D. Hoiem, Learning without Forgetting, 2017. URL: http://arxiv.org/abs/1606.09282. doi: 10. 48550/arXiv.1606.09282 , arXiv:1606.09282 [cs]. - · arXiv
  12. [25][25] L. Wang, X. Zhang, H. Su, J. Zhu, A comprehensive survey of continual learning: Theory, method and application, IEEE Transactions on Pattern Analysis and Machine Intelligence (2024). -
  13. [26][26] B. Wickramasinghe, G. Saha, K. Roy, Continual learning: A review of techniques, challenges, and future directions, IEEE Transactions on Artificial Intelligence 5 (2023) 2526-2546. -
  14. [28][28] A. A. Rusu, N. C. Rabinowitz, G. Desjardins, H. Soyer, J. Kirkpatrick, K. Kavukcuoglu, R. Pascanu, R. Hadsell, Progressive Neural Networks, 2022. URL: http://arxiv.org/abs/1606.04671. doi: 10. 48550/arXiv.1606.04671 , arXiv:1606.04671 [cs]. - · arXiv
  15. [29][29] A. Mallya, S. Lazebnik, PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning, 2018. URL: http://arxiv.org/abs/1711.05769. doi: 10.48550/arXiv.1711.05769 , arXiv:1711.05769 [cs]. - · DOI
  16. [30][30] A. Mallya, D. Davis, S. Lazebnik, Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights, 2018. URL: http://arxiv.org/abs/1801.06519. doi: 10.48550/arXiv. 1801.06519 , arXiv:1801.06519 [cs]. - · DOI
  17. [32][32] J. Serrà, D. Surís, M. Miron, A. Karatzoglou, Overcoming catastrophic forgetting with hard attention to the task, 2018. URL: http://arxiv.org/abs/1801.01423. doi: 10.48550/arXiv.1801. 01423 , arXiv:1801.01423 [cs]. - · DOI
  18. [33][33] M. Wortsman, V. Ramanujan, R. Liu, A. Kembhavi, M. Rastegari, J. Yosinski, A. Farhadi, Supermasks in Superposition, in: Advances in Neural Information Processing Systems, volume 33, Curran Associates, Inc., 2020, pp. 15173-15184. URL: https://proceedings.neurips.cc/paper/2020/ hash/ad1f8bb9b51f023cdc80cf94bb615aa9-Abstract.html. -
  19. [36][36] S.-A. Rebuffi, A. Kolesnikov, G. Sperl, C. H. Lampert, iCaRL: Incremental Classifier and Representation Learning, 2017. URL: http://arxiv.org/abs/1611.07725. doi: 10.48550/arXiv.1611.07725 , arXiv:1611.07725 [cs]. - · DOI
  20. [37][37] L. Pellegrini, G. Graffieti, V. Lomonaco, D. Maltoni, Latent Replay for Real-Time Continual Learning, 2020. URL: http://arxiv.org/abs/1912.01100. doi: 10.48550/arXiv.1912.01100 , 39. arXiv:1912.01100 [cs]. - · DOI
  21. [39][39] G. M. Van de Ven, A. S. Tolias, Three scenarios for continual learning, arXiv preprint arXiv:1904.07734 (2019). - · arXiv
  22. [40][40] J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, 2019. URL: http://arxiv.org/abs/1810.04805. doi: 10.48550/ arXiv.1810.04805 , arXiv:1810.04805 [cs]. - · arXiv
  23. [44][44] C. Zhou, Q. Li, C. Li, J. Yu, Y. Liu, G. Wang, K. Zhang, C. Ji, Q. Yan, L. He, et al., A comprehensive survey on pretrained foundation models: A history from bert to chatgpt, International Journal of Machine Learning and Cybernetics (2024) 1-65. -
  24. [45][45] Y. Yang, J. Zhou, X. Ding, T. Huai, S. Liu, Q. Chen, Y. Xie, L. He, Recent advances of foundation language models-based continual learning: A survey, ACM Computing Surveys 57 (2025) 1-38. -
  25. [46][46] A. Plaat, A. Wong, S. Verberne, J. Broekens, N. v. Stein, T. Back, Reasoning with Large Language Models, a Survey, 2024. URL: http://arxiv.org/abs/2407.11511. doi: 10.48550/arXiv.2407. 11511 , arXiv:2407.11511 [cs] version: 1. - · DOI
  26. [47][47] J. Hoffmann, S. Borgeaud, A. Mensch, E. Buchatskaya, T. Cai, E. Rutherford, D. d. L. Casas, L. A. Hendricks, J. Welbl, A. Clark, T. Hennigan, E. Noland, K. Millican, G. v. d. Driessche, B. Damoc, A. Guy, S. Osindero, K. Simonyan, E. Elsen, J. W. Rae, O. Vinyals, L. Sifre, Training ComputeOptimal Large Language Models, 2022. URL: http://arxiv.org/abs/2203.15556. doi: 10.48550/ arXiv.2203.15556 , arXiv:2203.15556 [cs]. - · arXiv
  27. [51][51] Y. Sun, X. Wang, Z. Liu, J. Miller, A. A. Efros, M. Hardt, Test-Time Training for Out-of-Distribution Generalization (2019). URL: https://openreview.net/forum?id=HyezmlBKwr. -
  28. [54][54] T. Raheja, N. Pochhi, Foundation models meet continual learning: Recent advances, challenges, and future directions, in: NeurIPS 2024 Workshop on Scalable Continual Learning for Lifelong Foundation Models, 2024. -
  29. [55][55] Y. Shen, K. Song, X. Tan, D. Li, W. Lu, Y. Zhuang, HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face, 2023. URL: http://arxiv.org/abs/2303.17580. doi: 10.48550/ arXiv.2303.17580 , arXiv:2303.17580 [cs]. - · arXiv
  30. [56][56] K. Roth, V. Udandarao, S. Dziadzio, A. Prabhu, M. Cherti, O. Vinyals, O. Hénaff, S. Albanie, M. Bethge, Z. Akata, A practitioner's guide to continual multimodal pretraining, arXiv preprint arXiv:2408.14471 (2024). - · arXiv
  31. [58][58] J. Parmar, S. Satheesh, M. Patwary, M. Shoeybi, B. Catanzaro, Reuse, don't retrain: A recipe for continued pretraining of language models, arXiv preprint arXiv:2407.07263 (2024). - · arXiv
  32. [60][60] A. Golatkar, A. Achille, S. Soatto, Eternal sunshine of the spotless net: Selective forgetting in deep networks, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 9304-9312. -
  33. [61][61] L. Wang, X. Zeng, J. Guo, K.-F. Wong, G. Gottlob, Selective forgetting: Advancing machine unlearning techniques and evaluation in language models, in: Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, 2025, pp. 843-851. -
  34. [62][62] H. Zhao, B. Ni, J. Fan, Y. Wang, Y. Chen, G. Meng, Z. Zhang, Continual forgetting for pre-trained vision models, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 28631-28642. -
  35. [63][63] B. Zhu, G. Cui, Y. Chen, Y. Qin, L. Yuan, C. Fu, Y. Deng, Z. Liu, M. Sun, M. Gu, Removing backdoors in pre-trained models by regularized continual pre-training, Transactions of the Association for Computational Linguistics 11 (2023) 1608-1623. -
  36. [64][64] M. Brinner, T. A. Mustafa, S. Zarrieß, Enhancing domain-specific encoder models with llmgenerated data: How to leverage ontologies, and how to do without them, arXiv preprint arXiv:2503.22006 (2025). - · arXiv
  37. [65][65] C.-A. Li, H.-Y. Lee, Examining forgetting in continual pre-training of aligned large language models, arXiv preprint arXiv:2401.03129 (2024). - · arXiv
  38. [66][66] S. V. Mehta, D. Patil, S. Chandar, E. Strubell, An empirical investigation of the role of pre-training in lifelong learning, Journal of Machine Learning Research 24 (2023) 1-50. -
  39. [67][67] T. Wu, L. Luo, Y.-F. Li, S. Pan, T.-T. Vu, G. Haffari, Continual learning for large language models: A survey, arXiv preprint arXiv:2402.01364 (2024). - · arXiv
  40. [68][68] H. Zhu, Y. Wei, X. Liang, C. Zhang, Y. Zhao, Ctp: Towards vision-language continual pretraining 71. via compatible momentum contrast and topology preservation, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 22257-22267. -
  41. [69][69] G. Zhang, L. Wang, G. Kang, L. Chen, Y. Wei, Slca: Slow learner with classifier alignment for continual learning on a pre-trained model, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 19148-19158. -
  42. [70][70] Ç. Yıldız, N. K. Ravichandran, N. Sharma, M. Bethge, B. Ermis, Investigating continual pretraining in large language models: Insights and implications, arXiv preprint arXiv:2402.17400 (2024). - · arXiv
  43. [71][71] Y. Guo, J. Fu, H. Zhang, D. Zhao, Y. Shen, Efficient continual pre-training by mitigating the stability gap, arXiv preprint arXiv:2406.14833 (2024). - · arXiv
  44. [73][73] M. Mendieta, B. Han, X. Shi, Y. Zhu, C. Chen, Towards geospatial foundation models via continual pretraining, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 16806-16816. -
  45. [74][74] N. D. Noce, M. Resta, D. Bacciu, Sequential continual pre-training for neural machine translation, in: 32nd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN, 2024. URL: https://doi.org/10.14428/esann/2024.ES2024-165. - · DOI
  46. [75][75] Y. Xie, K. Aggarwal, A. Ahmad, Efficient continual pre-training for building domain specific large language models, in: Findings of the Association for Computational Linguistics ACL 2024, 2024, pp. 10184-10201. -
  47. [76][76] O. Ostapenko, T. Lesort, P. Rodriguez, M. R. Arefin, A. Douillard, I. Rish, L. Charlin, Continual learning with foundation models: An empirical study of latent replay, in: Conference on lifelong learning agents, PMLR, 2022, pp. 60-91. -
  48. [77][77] N. Houlsby, A. Giurgiu, S. Jastrzebski, B. Morrone, Q. de Laroussilhe, A. Gesmundo, M. Attariyan, S. Gelly, Parameter-efficient transfer learning for nlp, 2019. URL: https://arxiv.org/abs/1902.00751. arXiv:1902.00751 . - · arXiv
  49. [78][78] E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, W. Chen, Lora: Low-rank adaptation of large language models, 2021. URL: https://arxiv.org/abs/2106.09685. arXiv:2106.09685 . - · arXiv
  50. [79][79] D. Aggarwal, S. Damle, N. Goyal, S. Lokam, S. Sitaram, Exploring continual fine-tuning for enhancing language ability in large language model, 2024. URL: https://arxiv.org/abs/2410.16006. arXiv:2410.16006 . - · arXiv
  51. [80][80] S. Beaulieu, L. Frati, T. Miconi, J. Lehman, K. O. Stanley, J. Clune, N. Cheney, Learning to continually learn, 2020. URL: https://arxiv.org/abs/2002.09571. arXiv:2002.09571 . - · arXiv
  52. [81][81] X. Zhang, L. Bai, X. Yang, J. Liang, C-lora: Continual low-rank adaptation for pre-trained models, 2025. URL: https://arxiv.org/abs/2502.17920. arXiv:2502.17920 . - · arXiv
  53. [82][82] T. Fan, Y. Kang, G. Ma, W. Chen, W. Wei, L. Fan, Q. Yang, Fate-llm: A industrial grade federated learning framework for large language models, 2023. URL: https://arxiv.org/abs/2310.10049. arXiv:2310.10049 . - · arXiv
  54. [83][83] J. Liu, J. Ren, R. Jin, Z. Zhang, Y. Zhou, P. Valduriez, D. Dou, Fisher information-based efficient curriculum federated learning with large language models, 2024. URL: https://arxiv.org/abs/2410. 00131. arXiv:2410.00131 . - · arXiv
  55. [84][84] A. Soutif-Cormerais, A. Carta, A. Cossu, J. Hurtado, V. Lomonaco, J. Van de Weijer, H. Hemati, A comprehensive empirical evaluation on online continual learning, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 3518-3528. -
  56. [86][86] H. Du, S. Liu, L. Zheng, Y. Cao, A. Nakamura, L. Chen, Privacy in fine-tuning large language models: Attacks, defenses, and future directions, 2025. URL: https://arxiv.org/abs/2412.16504. arXiv:2412.16504 . - · arXiv
  57. [87][87] Z. Wang, Z. Zhang, C.-Y. Lee, H. Zhang, R. Sun, X. Ren, G. Su, V. Perot, J. Dy, T. Pfister, Learning to prompt for continual learning, 2022. URL: https://arxiv.org/abs/2112.08654. arXiv:2112.08654 . - · arXiv
  58. [88][88] J. S. Smith, L. Karlinsky, V. Gutta, P. Cascante-Bonilla, D. Kim, A. Arbelle, R. Panda, R. Feris, Z. Kira, Coda-prompt: Continual decomposed attention-based prompting for rehearsal-free continual learning, 2023. URL: https://arxiv.org/abs/2211.13218. arXiv:2211.13218 . - · arXiv
  59. [89][89] H. Chen, J. Li, N. Gazagnadou, W. Zhuang, C. Chen, L. Lyu, Dual low-rank adaptation for continual learning with pre-trained models, 2024. URL: https://arxiv.org/abs/2411.00623. arXiv:2411.00623 . - · arXiv
  60. [90][90] W. Zhang, Y. Huang, T. Zhang, Q. Zou, W.-S. Zheng, R. Wang, Adapter learning in pretrained feature extractor for continual learning of diseases, 2023. URL: https://arxiv.org/abs/2304.09042. arXiv:2304.09042 . - · arXiv
  61. [91][91] X. Gao, S. Dong, Y. He, Q. Wang, Y. Gong, Beyond prompt learning: Continual adapter for efficient rehearsal-free continual learning, 2024. URL: https://arxiv.org/abs/2407.10281. arXiv:2407.10281 . - · arXiv
  62. [92][92] P. Yadav, D. Tam, L. Choshen, C. Raffel, M. Bansal, Ties-merging: Resolving interference when merging models, 2023. URL: https://arxiv.org/abs/2306.01708. arXiv:2306.01708 . - · arXiv
  63. [93][93] L. Yu, B. Yu, H. Yu, F. Huang, Y. Li, Language models are super mario: Absorbing abilities from homologous models as a free lunch, 2024. URL: https://arxiv.org/abs/2311.03099. arXiv:2311.03099 . - · arXiv
  64. [94][94] D. Marczak, B. Twardowski, T. Trzciński, S. Cygert, Magmax: Leveraging model merging for seamless continual learning, 2024. URL: https://arxiv.org/abs/2407.06322. arXiv:2407.06322 . - · arXiv
  65. [95][95] E. Yang, L. Shen, Z. Wang, G. Guo, X. Chen, X. Wang, D. Tao, Representation surgery for multi-task model merging, 2024. URL: https://arxiv.org/abs/2402.02705. arXiv:2402.02705 . - · arXiv
  66. [96][96] E. N. Coleman, L. Quarantiello, J. Hurtado, V. Lomonaco, Adaptive LoRA merging for efficient domain incremental learning, in: Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning, 2024. URL: https://openreview.net/forum?id=tlB5eonGEk. -
  67. [97][97] C. Finn, P. Abbeel, S. Levine, Model-agnostic meta-learning for fast adaptation of deep networks, 2017. URL: https://arxiv.org/abs/1703.03400. arXiv:1703.03400 . - · arXiv
  68. [98][98] R. Zhang, R. Qiang, S. A. Somayajula, P. Xie, Autolora: Automatically tuning matrix ranks in low-rank adaptation based on meta learning, 2024. URL: https://arxiv.org/abs/2403.09113. arXiv:2403.09113 . - · arXiv
  69. [99][99] W. Li, L. Zou, M. Tang, Q. Yu, W. Li, C. Li, META-LORA: Memory-efficient sample reweighting for fine-tuning large language models, in: O. Rambow, L. Wanner, M. Apidianaki, H. Al-Khalifa, B. D. Eugenio, S. Schockaert (Eds.), Proceedings of the 31st International Conference on Computational Linguistics, Association for Computational Linguistics, Abu Dhabi, UAE, 2025, pp. 8504-8517. URL: https://aclanthology.org/2025.coling-main.568/. -
  70. [100][100] L. Palazzo, M. Pennisi, F. P. Salanitri, G. Bellitto, S. Palazzo, C. Spampinato, Fedrewind: Rewinding continual model exchange for decentralized federated learning, 2024. URL: https://arxiv.org/abs/ 2411.09842. arXiv:2411.09842 . - · arXiv
  71. [102][102] A. Srivastava, A. Rastogi, A. Rao, A. A. M. Shoeb, A. Abid, A. Fisch, A. R. Brown, A. Santoro, A. Gupta, A. Garriga-Alonso, et al., Beyond the imitation game: Quantifying and extrapolating the capabilities of language models, arXiv preprint arXiv:2206.04615 (2022). - · arXiv
  72. [103][103] C. Luo, Has llm reached the scaling ceiling yet? unified insights into llm regularities and constraints, arXiv preprint arXiv:2412.16443 (2024). - · arXiv
  73. [104][104] K.-T. Tran, D. Dao, M.-D. Nguyen, Q.-V. Pham, B. O'Sullivan, H. D. Nguyen, Multi-agent collaboration mechanisms: A survey of llms, arXiv preprint arXiv:2501.06322 (2025). - · arXiv
  74. [106][106] B. Liu, X. Li, J. Zhang, J. Wang, T. He, S. Hong, H. Liu, S. Zhang, K. Song, K. Zhu, Y. Cheng, S. Wang, X. Wang, Y. Luo, H. Jin, P. Zhang, O. Liu, J. Chen, H. Zhang, Z. Yu, H. Shi, B. Li, D. Wu, F. Teng, X. Jia, J. Xu, J. Xiang, Y. Lin, T. Liu, T. Liu, Y. Su, H. Sun, G. Berseth, J. Nie, I. Foster, L. Ward, Q. Wu, - Y. Gu, M. Zhuge, X. Tang, H. Wang, J. You, C. Wang, J. Pei, Q. Yang, X. Qi, C. Wu, Advances and challenges in foundation agents: From brain-inspired intelligence to evolutionary, collaborative, and safe systems, 2025. URL: https://arxiv.org/abs/2504.01990. arXiv:2504.01990 . - · arXiv
  75. [107][107] J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou, et al., Chain-ofthought prompting elicits reasoning in large language models, Advances in neural information processing systems 35 (2022) 24824-24837. -
  76. [109][109] b. ichter, A. Brohan, Y. Chebotar, C. Finn, K. Hausman, A. Herzog, D. Ho, J. Ibarz, A. Irpan, E. Jang, R. Julian, D. Kalashnikov, S. Levine, Y. Lu, C. Parada, K. Rao, P. Sermanet, A. T. Toshev, V. Vanhoucke, F. Xia, T. Xiao, P. Xu, M. Yan, N. Brown, M. Ahn, O. Cortes, N. Sievers, C. Tan, S. Xu, D. Reyes, J. Rettinghouse, J. Quiambao, P. Pastor, L. Luu, K.-H. Lee, Y. Kuang, S. Jesmonth, N. J. Joshi, K. Jeffrey, R. J. Ruano, J. Hsu, K. Gopalakrishnan, B. David, A. Zeng, C. K. Fu, Do as i can, not as i say: Grounding language in robotic affordances, in: K. Liu, D. Kulic, J. Ichnowski (Eds.), Proceedings of The 6th Conference on Robot Learning, volume 205 of Proceedings of Machine Learning Research , PMLR, 2023, pp. 287-318. URL: https://proceedings.mlr.press/v205/ichter23a. html. -
  77. [110][110] B. Xu, Z. Peng, B. Lei, S. Mukherjee, Y. Liu, D. Xu, Rewoo: Decoupling reasoning from observations for efficient augmented language models, CoRR abs/2305.18323 (2023). URL: https://doi.org/10. 48550/arXiv.2305.18323. - · arXiv
  78. [111][111] S. S. Raman, V. Cohen, E. Rosen, I. Idrees, D. Paulius, S. Tellex, Planning with large language models via corrective re-prompting, in: NeurIPS 2022 Foundation Models for Decision Making Workshop, 2022. URL: https://openreview.net/forum?id=cMDMRBe1TKs. -
  79. [112][112] S. Yao, D. Yu, J. Zhao, I. Shafran, T. Griffiths, Y. Cao, K. Narasimhan, Tree of thoughts: Deliberate problem solving with large language models, Advances in neural information processing systems 36 (2023) 11809-11822. -
  80. [113][113] N. Du, Y. Huang, A. M. Dai, S. Tong, D. Lepikhin, Y. Xu, M. Krikun, Y. Zhou, A. W. Yu, O. Firat, et al., Glam: Efficient scaling of language models with mixture-of-experts, in: International conference on machine learning, PMLR, 2022, pp. 5547-5569. -
  81. [114][114] B. Lin, Z. Tang, Y. Ye, J. Cui, B. Zhu, P. Jin, J. Huang, J. Zhang, Y. Pang, M. Ning, et al., Moe-llava: Mixture of experts for large vision-language models, arXiv preprint arXiv:2401.15947 (2024). - · arXiv
  82. [115][115] F. Xue, Z. Zheng, Y. Fu, J. Ni, Z. Zheng, W. Zhou, Y. You, Openmoe: An early effort on open mixture-of-experts language models, arXiv preprint arXiv:2402.01739 (2024). - · arXiv
  83. [116][116] D. Dai, C. Deng, C. Zhao, R. Xu, H. Gao, D. Chen, J. Li, W. Zeng, X. Yu, Y. Wu, et al., Deepseekmoe: Towards ultimate expert specialization in mixture-of-experts language models, arXiv preprint arXiv:2401.06066 (2024). - · arXiv
  84. [117][117] K. A. Fischer, Reflective linguistic programming (rlp): A stepping stone in socially-aware agi (socialagi), arXiv preprint arXiv:2305.12647 (2023). - · arXiv
  85. [118][118] C. Li, J. Wang, K. Zhu, Y. Zhang, W. Hou, J. Lian, X. Xie, Emotionprompt: Leveraging psychology for large language models enhancement via emotional stimulus, arXiv preprint arXiv:2307.11760 (2023). - · arXiv
  86. [119][119] X. Wang, S. Zhang, S. Li, K. Li, K. Kallidromitis, Y. Kato, K. Kozuka, T. Darrell, Segllm: Multi-round reasoning segmentation with large language models, in: The Thirteenth International Conference on Learning Representations, ???? -
  87. [120][120] Z. Zhou, X. Zhang, S. Tan, L. Zhang, C. Li, Collaborative evolution: Multi-round learning between large and small language models for emergent fake news detection, in: Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, 2025, pp. 1210-1218. -
  88. [121][121] Q. Wu, G. Bansal, J. Zhang, Y. Wu, B. Li, E. Zhu, L. Jiang, X. Zhang, S. Zhang, J. Liu, et al., Autogen: Enabling next-gen llm applications via multi-agent conversation, arXiv preprint arXiv:2308.08155 (2023). - · arXiv
  89. [122][122] G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, A. Anandkumar, Voyager: An 127. open-ended embodied agent with large language models, Transactions on Machine Learning Research (2024). URL: https://openreview.net/forum?id=ehfRiF0R3a. -
  90. [123][123] X. Zhu, Y. Chen, H. Tian, C. Tao, W. Su, C. Yang, G. Huang, B. Li, L. Lu, X. Wang, Y. Qiao, Z. Zhang, J. Dai, Ghost in the minecraft: Generally capable agents for open-world environments via large language models with text-based knowledge and memory, 2023. URL: https://arxiv.org/abs/2305. 17144. arXiv:2305.17144 . - · arXiv
  91. [124][124] C. Zhang, Z. Yang, J. Liu, Y. Han, X. Chen, Z. Huang, B. Fu, G. Yu, Appagent: Multimodal agents as smartphone users, arXiv preprint arXiv:2312.13771 (2023). - · arXiv
  92. [125][125] A. Madaan, N. Tandon, P. Clark, Y. Yang, Memory-assisted prompt editing to improve gpt-3 after deployment, in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022, pp. 2833-2861. -
  93. [127][127] G. Li, H. Hammoud, H. Itani, D. Khizbullin, B. Ghanem, Camel: Communicative agents for" mind" exploration of large language model society, Advances in Neural Information Processing Systems 36 (2023) 51991-52008. -
  94. [128][128] H. Liu, Y. Zhou, B. Liu, J. Zhao, R. Yao, Z. Shao, Incremental learning with neural networks for computer vision: a survey, Artificial intelligence review 56 (2023) 4557-4589. -
  95. [129][129] K. Khetarpal, M. Riemer, I. Rish, D. Precup, Towards continual reinforcement learning: A review and perspectives, Journal of Artificial Intelligence Research 75 (2022) 1401-1476. -
  96. [130][130] J. Gou, B. Yu, S. J. Maybank, D. Tao, Knowledge distillation: A survey, International Journal of Computer Vision 129 (2021) 1789-1819. -
  97. [131][131] C. Yang, Y. Zhu, W. Lu, Y. Wang, Q. Chen, C. Gao, B. Yan, Y. Chen, Survey on knowledge distillation for large language models: methods, evaluation, and application, ACM Transactions on Intelligent Systems and Technology (2024). -
  98. [132][132] A. Carta, A. Cossu, V. Lomonaco, D. Bacciu, Ex-model: Continual learning from a stream of trained models, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 3790-3799. -
  99. [133][133] Z. Kenton, T. Everitt, L. Weidinger, I. Gabriel, V. Mikulik, G. Irving, Alignment of language agents, arXiv preprint arXiv:2103.14659 (2021). - · arXiv
  100. [134][134] W. Du, Z. M. Kim, V. Raheja, D. Kumar, D. Kang, Read, revise, repeat: A system demonstration for human-in-the-loop iterative text revision, in: Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022), 2022, pp. 96-108.

Cited by

Sorted by citations

Related

Authors
Bell, J., Quarantiello, L., Coleman, E. N., Li, L., Li, M., Madeddu, M., Piccoli, E., & Lomonaco, V.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2506.03320
arXiv
2506.03320
OpenAlex
W4416071974
Cited by
2
References
0
Citations by year
2026: 2
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
European Commission
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
Keywords
continual learning, foundation models, large language models, continual pre-training, continual fine-tuning, distribution shift, agent orchestration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review