CoChat
Sign Up
PreprintCited by 7Domain Adaptation and Few-Shot LearningAI-based Problem Solving and PlanningTopic Modeling

Lifelong Learning of Large Language Model based Agents: A Roadmap

Open access
Zheng, Junhao, Shi, Chengming, Cai, Xidi, Li, Qiuke, Zhang, Duzhen, Li, Chenxing, Yu, Dong, Ma, Qianli·2025·arXiv
DOI 10.48550/arxiv.2501.07278arXiv 2501.07278
Open this paper in CoChat — free account

Abstract

Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models (LLMs) have demonstrated impressive capabilities in natural language processing, existing LLM agents are typically designed for static systems and lack the ability to adapt over time in response to new challenges. This survey is the first to systematically summarize the potential techniques for incorporating lifelong learning into LLM-based agents. We categorize the core components of these agents into three modules: the perception module for multimodal input integration, the memory module for storing and retrieving evolving knowledge, and the action module for grounded interactions with the dynamic environment. We highlight how these pillars collectively enable continuous adaptation, mitigate catastrophic forgetting, and improve long-term performance. This survey provides a roadmap for researchers and practitioners working to develop lifelong learning capabilities in LLM agents, offering insights into emerging trends, evaluation metrics, and application scenarios. Relevant literature and resources are available at \href{this url}{https://github.com/qianlima-lab/awesome-lifelong-llm-agent}.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2501.07278

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 328

  1. [1][1] J. Zheng, S. Qiu, C. Shi, and Q. Ma, 'Towards lifelong learning of large language models: A survey,' ArXiv preprint , vol. abs/2406.06391, 2024. [Online]. Available: https://arxiv.org/ abs/2406.06391 - · arXiv
  2. [3][3] M. De Lange, R. Aljundi, M. Masana, S. Parisot, X. Jia, A. Leonardis, G. Slabaugh, and T. Tuytelaars, 'A continual learning survey: Defying forgetting in classification tasks,' IEEE transactions on pattern analysis and machine intelligence , vol. 44, no. 7, pp. 3366-3385, 2021. -
  3. [4][4] L. Wang, X. Zhang, H. Su, and J. Zhu, 'A comprehensive survey of continual learning: theory, method and application,' IEEE Transactions on Pattern Analysis and Machine Intelligence , 2024. -
  4. [6][6] M. McCloskey and N. J. Cohen, 'Catastrophic interference in connectionist networks: The sequential learning problem,' in Psychology of learning and motivation . Elsevier, 1989, vol. 24, pp. 109-165. -
  5. [7][7] S. Dohare, J. F. Hernandez-Garcia, Q. Lan, P. Rahman, A. R. Mahmood, and R. S. Sutton, 'Loss of plasticity in deep continual learning,' Nature , vol. 632, no. 8026, pp. 768-774, 2024. -
  6. [8][8] Z. Abbas, R. Zhao, J. Modayil, A. White, and M. C. Machado, 'Loss of plasticity in continual deep reinforcement learning,' in Conference on Lifelong Learning Agents . PMLR, 2023, pp. 620-636. -
  7. [9][9] A. Robins, 'Catastrophic forgetting, rehearsal and pseudorehearsal,' Connection Science , vol. 7, no. 2, pp. 123-146, 1995. -
  8. [10][10] Z. Z. Wang, J. Mao, D. Fried, and G. Neubig, 'Agent workflow memory,' ArXiv preprint , vol. abs/2409.07429, 2024. [Online]. Available: https://arxiv.org/abs/2409.07429 - · arXiv
  9. [11][11] T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, 'Language models are few-shot learners,' in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., 2020. [Online]. Available: https://proceedings.neurips.cc/paper/2020/hash/ 1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html -
  10. [12][12] J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , 'Gpt-4 technical report,' ArXiv preprint , vol. abs/2303.08774, 2023. [Online]. Available: https://arxiv.org/ abs/2303.08774 - · arXiv
  11. [13][13] L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, Y. Lin et al. , 'A survey on large language model based autonomous agents,' Frontiers of Computer Science , vol. 18, no. 6, p. 186345, 2024. -
  12. [14][14] Z. Xi, W. Chen, X. Guo, W. He, Y. Ding, B. Hong, M. Zhang, J. Wang, S. Jin, E. Zhou et al. , 'The rise and potential of large language model based agents: A survey,' ArXiv preprint , vol. abs/2309.07864, 2023. [Online]. Available: https://arxiv.org/abs/2309.07864 - · arXiv
  13. [15][15] X. Liu, B. Qin, D. Liang, G. Dong, H. Lai, H. Zhang, H. Zhao, I. L. Iong, J. Sun, J. Wang et al. , 'Autoglm: Autonomous foundation agents for guis,' ArXiv preprint , vol. abs/2411.00820, 2024. [Online]. Available: https://arxiv.org/abs/2411.00820 - · arXiv
  14. [17][17] W. Pian, S. Deng, S. Mo, Y. Guo, and Y. Tian, 'Modalityinconsistent continual learning of multimodal large language models,' ArXiv preprint , vol. abs/2412.13050, 2024. [Online]. Available: https://arxiv.org/abs/2412.13050 - · arXiv
  15. [18][18] L. Jang, Y. Li, C. Ding, J. Lin, P. P. Liang, D. Zhao, R. Bonatti, and K. Koishida, 'Videowebarena: Evaluating long context multimodal agents with video understanding web tasks,' ArXiv preprint , vol. abs/2410.19100, 2024. [Online]. Available: https://arxiv.org/abs/2410.19100 - · arXiv
  16. [19][19] J. Y. Koh, R. Lo, L. Jang, V. Duvvur, M. C. Lim, P.-Y. Huang, G. Neubig, S. Zhou, R. Salakhutdinov, and D. Fried, 'Visualwebarena: Evaluating multimodal agents on realistic visual web tasks,' ArXiv preprint , vol. abs/2401.13649, 2024. [Online]. Available: https://arxiv.org/abs/2401.13649 - · arXiv
  17. [20][20] X. Liu, T. Zhang, Y. Gu, I. L. Iong, Y. Xu, X. Song, S. Zhang, H. Lai, X. Liu, H. Zhao et al. , 'Visualagentbench: Towards large multimodal models as visual foundation agents,' ArXiv preprint , vol. abs/2408.06327, 2024. [Online]. Available: https://arxiv.org/abs/2408.06327 - · arXiv
  18. [21][21] S. Zhou, F. F. Xu, H. Zhu, X. Zhou, R. Lo, A. Sridhar, X. Cheng, T. Ou, Y. Bisk, D. Fried, U. Alon, and G. Neubig, 'Webarena: A realistic web environment for building autonomous agents,' in The Twelfth International Conference on Learning Representations , 2024. [Online]. Available: https://openreview.net/forum?id= oKn9c6ytLx -
  19. [22][22] X. Liu, H. Yu, H. Zhang, Y. Xu, X. Lei, H. Lai, Y. Gu, H. Ding, K. Men, K. Yang et al. , 'Agentbench: Evaluating llms as agents,' ArXiv preprint , vol. abs/2308.03688, 2023. [Online]. Available: https://arxiv.org/abs/2308.03688 - · arXiv
  20. [23][23] A. Drouin, M. Gasse, M. Caccia, I. H. Laradji, M. Del Verme, T. Marty, L. Boisvert, M. Thakkar, Q. Cappart, D. Vazquez et al. , 'Workarena: How capable are web agents at solving common knowledge work tasks?' ArXiv preprint , vol. abs/2403.07718, 2024. [Online]. Available: https://arxiv.org/abs/2403.07718 - · arXiv
  21. [24][24] T. Wu, L. Luo, Y.-F. Li, S. Pan, T.-T. Vu, and G. Haffari, 'Continual learning for large language models: A survey,' ArXiv preprint , vol. abs/2402.01364, 2024. [Online]. Available: https://arxiv.org/abs/2402.01364 - · arXiv
  22. [25][25] H. Shi, Z. Xu, H. Wang, W. Qin, W. Wang, Y. Wang, Z. Wang, S. Ebrahimi, and H. Wang, 'Continual learning of large language models: A comprehensive survey,' ArXiv preprint , vol. abs/2404.16789, 2024. [Online]. Available: https: //arxiv.org/abs/2404.16789 - · arXiv
  23. [26][26] Z. Ke and B. Liu, 'Continual learning of natural language processing tasks: A survey,' ArXiv preprint , vol. abs/2211.12701, 2022. [Online]. Available: https://arxiv.org/abs/2211.12701 - · arXiv
  24. [27][27] D.-W. Zhou, H.-L. Sun, J. Ning, H.-J. Ye, and D.-C. Zhan, 'Continual learning with pre-trained models: A survey,' ArXiv preprint , vol. abs/2401.16386, 2024. [Online]. Available: https://arxiv.org/abs/2401.16386 - · arXiv
  25. [28][28] M. Biesialska, K. Biesialska, and M. R. Costa-juss` a, 'Continual lifelong learning in natural language processing: A survey,' in Proceedings of the 28th International Conference on Computational Linguistics , D. Scott, N. Bel, and C. Zong, Eds. Barcelona, Spain (Online): International Committee on Computational Linguistics, 2020, pp. 6523-6541. [Online]. Available: https: //aclanthology.org/2020.coling-main.574 -
  26. [29][29] G. I. Parisi, R. Kemker, J. L. Part, C. Kanan, and S. Wermter, 'Continual lifelong learning with neural networks: A review,' Neural networks , vol. 113, pp. 54-71, 2019. -
  27. [30][30] Y. Li, H. Wen, W. Wang, X. Li, Y. Yuan, G. Liu, J. Liu, W. Xu, X. Wang, Y. Sun et al. , 'Personal llm agents: Insights and survey about the capability, efficiency and security,' ArXiv preprint , vol. abs/2401.05459, 2024. [Online]. Available: https://arxiv.org/abs/2401.05459 - · arXiv
  28. [31][31] Y. Cheng, C. Zhang, Z. Zhang, X. Meng, S. Hong, W. Li, Z. Wang, Z. Wang, F. Yin, J. Zhao et al. , 'Exploring large language model based intelligent agents: Definitions, methods, and prospects,' ArXiv preprint , vol. abs/2401.03428, 2024. [Online]. Available: https://arxiv.org/abs/2401.03428 - · arXiv
  29. [32][32] X. Li, S. Wang, S. Zeng, Y. Wu, and Y. Yang, 'A survey on llm-based multi-agent systems: workflow, infrastructure, and challenges,' Vicinagearth , vol. 1, no. 1, p. 9, 2024. -
  30. [33][33] D. Zhang, L. Chen, S. Zhang, H. Xu, Z. Zhao, and K. Yu, 'Large language models are semi-parametric reinforcement learning agents,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing - Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ f6b22ac37beb5da61efd4882082c9ecd-Abstract-Conference.html -
  31. [34][34] G. A. Carpenter and S. Grossberg, 'The art of adaptive pattern recognition by a self-organizing neural network,' Computer , vol. 21, no. 3, pp. 77-88, 1988. -
  32. [35][35] R. M. French, 'Catastrophic forgetting in connectionist networks,' Trends in cognitive sciences , vol. 3, no. 4, pp. 128-135, 1999. -
  33. [36][36] J. L. McClelland, B. L. McNaughton, and R. C. O'Reilly, 'Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory.' Psychological review , vol. 102, no. 3, p. 419, 1995. -
  34. [37][37] D. Hassabis, D. Kumaran, C. Summerfield, and M. Botvinick, 'Neuroscience-inspired artificial intelligence,' Neuron , vol. 95, no. 2, pp. 245-258, 2017. -
  35. [38][38] R. Ratcliff, 'Connectionist models of recognition memory: constraints imposed by learning and forgetting functions.' Psychological review , vol. 97, no. 2, p. 285, 1990. -
  36. [39][39] S. Grossberg, 'Competitive learning: From interactive activation to adaptive resonance,' Cognitive science , vol. 11, no. 1, pp. 23-63, 1987. -
  37. [40][40] S. Thrun, 'Lifelong learning algorithms,' in Learning to learn . Springer, 1998, pp. 181-209. -
  38. [41][41] J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. GrabskaBarwinska et al. , 'Overcoming catastrophic forgetting in neural networks,' Proceedings of the national academy of sciences , vol. 114, no. 13, pp. 3521-3526, 2017. -
  39. [42][42] Z. Li and D. Hoiem, 'Learning without forgetting,' IEEE transactions on pattern analysis and machine intelligence , vol. 40, no. 12, pp. 2935-2947, 2017. -
  40. [43][43] D. Rolnick, A. Ahuja, J. Schwarz, T. P. Lillicrap, and G. Wayne, 'Experience replay for continual learning,' in Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada , H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch´ eBuc, E. B. Fox, and R. Garnett, Eds., 2019, pp. 348358. [Online]. Available: https://proceedings.neurips.cc/paper/ 2019/hash/fa7cdfad1a5aaf8370ebeda47a1ff1c3-Abstract.html -
  41. [44][44] A. Mallya and S. Lazebnik, 'Packnet: Adding multiple tasks to a single network by iterative pruning,' in 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018 . IEEE Computer Society, 2018, pp. 7765-7773. [Online]. Available: http://openaccess.thecvf.com/content cvpr 2018/html/ Mallya PackNet Adding Multiple CVPR 2018 paper.html -
  42. [45][45] S. V. Mehta, D. Patil, S. Chandar, and E. Strubell, 'An empirical investigation of the role of pre-training in lifelong learning,' Journal of Machine Learning Research , vol. 24, no. 214, pp. 1-50, 2023. -
  43. [46][46] A. Razdaibiedina, Y. Mao, R. Hou, M. Khabsa, M. Lewis, and A. Almahairi, 'Progressive prompts: Continual learning for language models,' in The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023 . OpenReview.net, 2023. [Online]. Available: https: //openreview.net/pdf?id=UJTgQBc91 -
  44. [47][47] N. Houlsby, A. Giurgiu, S. Jastrzebski, B. Morrone, Q. de Laroussilhe, A. Gesmundo, M. Attariyan, and S. Gelly, 'Parameter-efficient transfer learning for NLP,' in Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA , ser. Proceedings of Machine Learning Research, K. Chaudhuri and R. Salakhutdinov, Eds., vol. 97. PMLR, 2019, pp. 2790-2799. [Online]. Available: http://proceedings.mlr.press/v97/houlsby19a.html -
  45. [48][48] P. S. H. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. K¨ uttler, M. Lewis, W. Yih, T. Rockt¨ aschel, S. Riedel, and D. Kiela, 'Retrieval-augmented generation for knowledge-intensive NLP tasks,' in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., 2020. [Online]. - [Available: https://proceedings.neurips.cc/paper/2020/hash/ 6b493230205f780e1bc26945df7481e5-Abstract.html](https://proceedings.neurips.cc/paper/2020/hash/6b493230205f780e1bc26945df7481e5-Abstract.html) -
  46. [49][49] X. Jin, D. Zhang, H. Zhu, W. Xiao, S.-W. Li, X. Wei, A. Arnold, and X. Ren, 'Lifelong pretraining: Continually adapting language models to emerging corpora,' in Proceedings of BigScience Episode #5 -Workshop on Challenges & Perspectives in Creating Large Language Models , A. Fan, S. Ilic, T. Wolf, and M. Gall´ e, Eds. virtual+Dublin: Association for Computational Linguistics, 2022, pp. 1-16. [Online]. Available: https://aclanthology.org/2022. bigscience-1.1 -
  47. [50][50] Y. Luo, Z. Yang, F. Meng, Y. Li, J. Zhou, and Y. Zhang, 'An empirical study of catastrophic forgetting in large language models during continual fine-tuning,' ArXiv preprint , vol. abs/2308.08747, 2023. [Online]. Available: https://arxiv.org/ abs/2308.08747 - · arXiv
  48. [51][51] Z. Zhang, M. Fang, L. Chen, and M.-R. Namazi-Rad, 'CITB: A benchmark for continual instruction tuning,' in Findings of the Association for Computational Linguistics: EMNLP 2023 , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 9443-9455. [Online]. Available: https://aclanthology.org/2023.findings-emnlp.633 -
  49. [52][52] T. Shen, R. Jin, Y. Huang, C. Liu, W. Dong, Z. Guo, X. Wu, Y. Liu, and D. Xiong, 'Large language model alignment: A survey,' ArXiv preprint , vol. abs/2309.15025, 2023. [Online]. Available: https://arxiv.org/abs/2309.15025 - · arXiv
  50. [53][53] J. Jang, S. Ye, S. Yang, J. Shin, J. Han, G. Kim, S. J. Choi, and M. Seo, 'Towards continual knowledge learning of language models,' in The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 . OpenReview.net, 2022. [Online]. Available: https: //openreview.net/forum?id=vfsRB5MImo9 -
  51. [54][54] S. Wang, Y. Zhu, H. Liu, Z. Zheng, C. Chen, and J. Li, 'Knowledge editing for large language models: A survey,' ACM Computing Surveys , 2023. -
  52. [56][56] Z. Zhang, X. Bo, C. Ma, R. Li, X. Chen, Q. Dai, J. Zhu, Z. Dong, and J.-R. Wen, 'A survey on the memory mechanism of large language model based agents,' ArXiv preprint , vol. abs/2404.13501, 2024. [Online]. Available: https://arxiv.org/abs/2404.13501 - · arXiv
  53. [57][57] J. Lu, S. An, M. Lin, G. Pergola, Y. He, D. Yin, X. Sun, and Y. Wu, 'Memochat: Tuning llms to use memos for consistent long-range open-domain conversation,' ArXiv preprint , vol. abs/2308.08239, 2023. [Online]. Available: https://arxiv.org/abs/2308.08239 - · arXiv
  54. [58][58] N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao, 'Reflexion: language agents with verbal reinforcement learning,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ 1b44b878bb782e6954cd888628510e90-Abstract-Conference.html -
  55. [59][59] T. Schick, J. Dwivedi-Yu, R. Dess` ı, R. Raileanu, M. Lomeli, E. Hambro, L. Zettlemoyer, N. Cancedda, and T. Scialom, 'Toolformer: Language models can teach themselves to use tools,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ d842425e4bf79ba039352da0f658a906-Abstract-Conference.html -
  56. [60][60] C. Hu, J. Fu, C. Du, S. Luo, J. Zhao, and H. Zhao, 'Chatdb: Augmenting llms with databases as their symbolic memory,' ArXiv preprint , vol. abs/2306.03901, 2023. [Online]. Available: https://arxiv.org/abs/2306.03901 - · arXiv
  57. [61][61] G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar, 'Voyager: An open-ended embodied - agent with large language models,' 2023. [Online]. Available: https://arxiv.org/abs/2305.16291 - · arXiv
  58. [62][62] X. Zhu, Y. Chen, H. Tian, C. Tao, W. Su, C. Yang, G. Huang, B. Li, L. Lu, X. Wang, Y. Qiao, Z. Zhang, and J. Dai, 'Ghost in the minecraft: Generally capable agents for open-world environments via large language models with text-based knowledge and memory,' 2023. [Online]. Available: https://arxiv.org/abs/2305.17144 - · arXiv
  59. [63][63] H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozi` ere, N. Goyal, E. Hambro, F. Azhar et al. , 'Llama: Open and efficient foundation language models. arxiv 2023,' ArXiv preprint , vol. abs/2302.13971, 2023. [Online]. Available: https://arxiv.org/abs/2302.13971 - · arXiv
  60. [64][64] K. Yang, Y. Liu, S. Chaudhary, R. Fakoor, P. Chaudhari, G. Karypis, and H. Rangwala, 'Agentoccam: A simple yet strong baseline for llm-based web agents,' ArXiv preprint , vol. abs/2410.13825, 2024. [Online]. Available: https: //arxiv.org/abs/2410.13825 - · arXiv
  61. [65][65] L. Zheng, R. Wang, X. Wang, and B. An, 'Synapse: Trajectory-asexemplar prompting with memory for computer control,' in The Twelfth International Conference on Learning Representations , 2023. -
  62. [66][66] I. Gur, H. Furuta, A. Huang, M. Safdari, Y. Matsuo, D. Eck, and A. Faust, 'A real-world webagent with planning, long context understanding, and program synthesis,' ArXiv preprint , vol. abs/2307.12856, 2023. [Online]. Available: https://arxiv.org/abs/2307.12856 - · arXiv
  63. [67][67] X. Deng, Y. Gu, B. Zheng, S. Chen, S. Stevens, B. Wang, H. Sun, and Y. Su, 'Mind2web: Towards a generalist agent for the web,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/ hash/5950bf290a1570ea401bf98882128160-Abstract-Datasets and Benchmarks.html -
  64. [68][68] P. Shaw, M. Joshi, J. Cohan, J. Berant, P. Pasupat, H. Hu, U. Khandelwal, K. Lee, and K. Toutanova, 'From pixels to UI actions: Learning to follow instructions via graphical user interfaces,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ 6c52a8a4fadc9129c6e1d1745f2dfd0f-Abstract-Conference.html -
  65. [69][69] H. Furuta, K.-H. Lee, O. Nachum, Y. Matsuo, A. Faust, S. S. Gu, and I. Gur, 'Multimodal web navigation with instruction-finetuned foundation models,' ArXiv preprint , vol. abs/2305.11854, 2023. [Online]. Available: https://arxiv.org/ abs/2305.11854 - · arXiv
  66. [70][70] W. Hong, W. Wang, Q. Lv, J. Xu, W. Yu, J. Ji, Y. Wang, Z. Wang, Y. Dong, M. Ding et al. , 'Cogagent: A visual language model for gui agents,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 14 281-14 290. -
  67. [71][71] J. Pan, Y. Zhang, N. Tomlin, Y. Zhou, S. Levine, and A. Suhr, 'Autonomous evaluation and refinement of digital agents,' ArXiv preprint , vol. abs/2404.06474, 2024. [Online]. Available: https://arxiv.org/abs/2404.06474 - · arXiv
  68. [72][72] B. Zheng, B. Gou, J. Kil, H. Sun, and Y. Su, 'Gpt-4v (ision) is a generalist web agent, if grounded,' ArXiv preprint , vol. abs/2401.01614, 2024. [Online]. Available: https: //arxiv.org/abs/2401.01614 - · arXiv
  69. [73][73] Z. Wang, S. Cai, A. Liu, Y. Jin, J. Hou, B. Zhang, H. Lin, Z. He, Z. Zheng, Y. Yang et al. , 'Jarvis-1: Open-world multi-task agents with memory-augmented multimodal language models,' ArXiv preprint , vol. abs/2311.05997, 2023. [Online]. Available: https://arxiv.org/abs/2311.05997 - · arXiv
  70. [74][74] Y. Dong, X. Zhu, Z. Pan, L. Zhu, and Y. Yang, 'VillagerAgent: A graph-based multi-agent framework for coordinating complex task dependencies in Minecraft,' in Findings of the Association for Computational Linguistics: ACL 2024 , L.-W. Ku, A. Martins, and V. Srikumar, Eds. Bangkok, Thailand: Association for Computational Linguistics, 2024, pp. 16 290-16 314. [Online]. Available: https://aclanthology.org/2024.findings-acl.964 -
  71. [75][75] Z. Wang, S. Cai, G. Chen, A. Liu, X. Ma, and Y. Liang, 'Describe, explain, plan and select: Interactive planning with - large language models enables open-world multi-task agents,' ArXiv preprint , vol. abs/2302.01560, 2023. [Online]. Available: https://arxiv.org/abs/2302.01560 - · arXiv
  72. [76][76] J. Urbanek, A. Fan, S. Karamcheti, S. Jain, S. Humeau, E. Dinan, T. Rockt¨ aschel, D. Kiela, A. Szlam, and J. Weston, 'Learning to speak and act in a fantasy text adventure game,' in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , K. Inui, J. Jiang, V. Ng, and X. Wan, Eds. Hong Kong, China: Association for Computational Linguistics, 2019, pp. 673-683. [Online]. Available: https://aclanthology.org/D19-1062 -
  73. [77][77] Y. Li, J. He, X. Zhou, Y. Zhang, and J. Baldridge, 'Mapping natural language instructions to mobile UI action sequences,' in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , D. Jurafsky, J. Chai, N. Schluter, and J. Tetreault, Eds. Online: Association for Computational Linguistics, 2020, pp. 8198-8210. [Online]. Available: https://aclanthology.org/2020.acl-main.729 -
  74. [78][78] Z. Zhang and A. Zhang, 'You only look at screens: Multimodal chain-of-action agents,' ArXiv preprint , vol. abs/2309.11436, 2023. [Online]. Available: https://arxiv.org/abs/2309.11436 - · arXiv
  75. [79][79] A. Jaegle, F. Gimeno, A. Brock, O. Vinyals, A. Zisserman, and J. Carreira, 'Perceiver: General perception with iterative attention,' in Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event , ser. Proceedings of Machine Learning Research, M. Meila and T. Zhang, Eds., vol. 139. PMLR, 2021, pp. 4651-4664. [Online]. Available: http://proceedings.mlr.press/v139/jaegle21a.html -
  76. [80][80] H. Akbari, L. Yuan, R. Qian, W. Chuang, S. Chang, Y. Cui, and B. Gong, 'VATT: transformers for multimodal self-supervised learning from raw video, audio and text,' in Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual , M. Ranzato, A. Beygelzimer, Y. N. Dauphin, P. Liang, and J. W. Vaughan, Eds., 2021, pp. 24 206-24 221. [Online]. Available: https://proceedings.neurips.cc/paper/ 2021/hash/cb3213ada48302953cb0f166464ab356-Abstract.html -
  77. [82][82] X. Wang, B. Zhuang, and Q. Wu, 'Modaverse: Efficiently transforming modalities with llms,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 26 606-26 616. -
  78. [83][83] H. Tan and M. Bansal, 'Vokenization: Improving language understanding with contextualized, visual-grounded supervision,' in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , B. Webber, T. Cohn, Y. He, and Y. Liu, Eds. Online: Association for Computational Linguistics, 2020, pp. 2066-2080. [Online]. Available: https://aclanthology.org/2020.emnlp-main.162 -
  79. [84][84] Z. Tang, J. Cho, H. Tan, and M. Bansal, 'Vidlankd: Improving language understanding via video-distilled knowledge transfer,' in Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual , M. Ranzato, A. Beygelzimer, Y. N. Dauphin, P. Liang, and J. W. Vaughan, Eds., 2021, pp. 24 468-24 481. [Online]. Available: https://proceedings.neurips.cc/paper/2021/hash/ ccdf3864e2fa9089f9eca4fc7a48ea0a-Abstract.html -
  80. [87][87] C. Chen, U. Jain, C. Schissler, S. V. A. Gari, Z. Al-Halah, V. K. Ithapu, P. Robinson, and K. Grauman, 'Soundspaces: Audio- - visual navigation in 3d environments,' in Computer Vision-ECCV 2020: 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part VI 16 . Springer, 2020, pp. 17-36. -
  81. [88][88] X. Chen, J. Zhang, X. Wang, N. Zhang, T. Wu, Y. Wang, Y. Wang, and H. Chen, 'Continual multimodal knowledge graph construction,' ArXiv preprint , vol. abs/2305.08698, 2023. [Online]. Available: https://arxiv.org/abs/2305.08698 - · arXiv
  82. [90][90] Y. Zhang, L. Shao, and C. G. M. Snoek, 'Repetitive activity counting by sight and sound,' in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021 . Computer Vision Foundation / IEEE, 2021, pp. 14 070-14 079. [Online]. Available: https://openaccess.thecvf. com/content/CVPR2021/html/Zhang Repetitive Activity Counting by Sight and Sound CVPR 2021 paper.html -
  83. [91][91] M. Ma, J. Ren, L. Zhao, S. Tulyakov, C. Wu, and X. Peng, 'SMIL: multimodal learning with severely missing modality,' in ThirtyFifth AAAI Conference on Artificial Intelligence, AAAI 2021, ThirtyThird Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021 . AAAI Press, 2021, pp. 2302-2310. [Online]. Available: https://ojs.aaai.org/index.php/AAAI/article/view/16330 -
  84. [92][92] J. Yu, H. Xiong, L. Zhang, H. Diao, Y. Zhuge, L. Hong, D. Wang, H. Lu, Y. He, and L. Chen, 'Llms can evolve continually on modality for x-modal reasoning,' ArXiv preprint , vol. abs/2410.20178, 2024. [Online]. Available: https: //arxiv.org/abs/2410.20178 - · arXiv
  85. [93][93] J. Yu, Y. Zhuge, L. Zhang, P. Hu, D. Wang, H. Lu, and Y. He, 'Boosting continual learning of vision-language models via mixture-of-experts adapters,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 219-23 230. -
  86. [94][94] J. Zhao, R. Li, and Q. Jin, 'Missing modality imagination network for emotion recognition with uncertain missing modalities,' in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , C. Zong, F. Xia, W. Li, and R. Navigli, Eds. Online: Association for Computational Linguistics, 2021, pp. 2608-2618. [Online]. Available: https://aclanthology.org/2021.acl-long.203 -
  87. [96][96] Y. Zhang, H. Doughty, and C. Snoek, 'Learning unseen modality interaction,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ abb4847bbd60f38b1b7649d26c7a0067-Abstract-Conference.html -
  88. [98][98] R. Lin and H. Hu, 'MissModal: Increasing robustness to missing modality in multimodal sentiment analysis,' Transactions of the Association for Computational Linguistics , vol. 11, pp. 1686-1702, 2023. [Online]. Available: https: //aclanthology.org/2023.tacl-1.94 -
  89. [100][100] J. He, H. Guo, M. Tang, and J. Wang, 'Continual instruction - tuning for large multimodal models,' ArXiv preprint , vol. abs/2311.16206, 2023. [Online]. Available: https://arxiv.org/ abs/2311.16206 - · arXiv
  90. [101][101] D. Zhu, Z. Sun, Z. Li, T. Shen, K. Yan, S. Ding, K. Kuang, and C. Wu, 'Model tailor: Mitigating catastrophic forgetting in multi-modal large language models,' ArXiv preprint , vol. abs/2402.12048, 2024. [Online]. Available: https: //arxiv.org/abs/2402.12048 - · arXiv
  91. [102][102] Z. Ni, L. Wei, S. Tang, Y. Zhuang, and Q. Tian, 'Continual visionlanguage representation learning with off-diagonal information,' in International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA , ser. Proceedings of Machine Learning Research, A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett, Eds., vol. 202. PMLR, 2023, pp. 26129-26149. [Online]. Available: https://proceedings.mlr.press/v202/ni23c.html -
  92. [104][104] X. Zhang, F. Zhang, and C. Xu, 'VQACL: A novel visual question answering continual learning setting,' in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023 . IEEE, 2023, pp. 19 102-19 112. [Online]. Available: https://doi.org/10.1109/ CVPR52729.2023.01831 -
  93. [105][105] F. Sarfraz, B. Zonooz, and E. Arani, 'Beyond unimodal learning: The importance of integrating multiple modalities for lifelong learning,' ArXiv preprint , vol. abs/2405.02766, 2024. [Online]. Available: https://arxiv.org/abs/2405.02766 - · arXiv
  94. [106][106] Y. Cai, J. Thomason, and M. Rostami, 'Task-attentive transformer architecture for continual learning of vision-andlanguage tasks using knowledge distillation,' in Findings of the Association for Computational Linguistics: EMNLP 2023 , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 6986-7000. [Online]. Available: https://aclanthology.org/2023.findings-emnlp.466 -
  95. [107][107] R. Yang, S. Wang, H. Zhang, S. Xu, Y. Guo, X. Ye, B. Hou, and L. Jiao, 'Knowledge decomposition and replay: A novel cross-modal image-text retrieval continual learning method,' in Proceedings of the 31st ACM International Conference on Multimedia , 2023, pp. 6510-6519. -
  96. [108][108] S. Yan, L. Hong, H. Xu, J. Han, T. Tuytelaars, Z. Li, and X. He, 'Generative negative text replay for continual vision-language pretraining,' in European Conference on Computer Vision . Springer, 2022, pp. 22-38. -
  97. [110][110] C. He, S. Cheng, Z. Qiu, L. Xu, F. Meng, Q. Wu, and H. Li, 'Continual egocentric activity recognition with foreseeablegeneralized visual-imu representations,' IEEE Sensors Journal , 2024. -
  98. [111][111] S. Cheng, C. He, K. Chen, L. Xu, H. Li, F. Meng, and Q. Wu, 'Vision-sensor attention based continual multimodal egocentric activity recognition,' in ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2024, pp. 6300-6304. -
  99. [112][112] W. Jin, D.-H. Lee, C. Zhu, J. Pujara, and X. Ren, 'Leveraging visual knowledge in language tasks: An empirical study on intermediate pre-training for cross-modal knowledge transfer,' in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , S. Muresan, P. Nakov, and A. Villavicencio, Eds. Dublin, Ireland: Association for Computational Linguistics, 2022, pp. 2750-2762. [Online]. Available: https://aclanthology.org/2022.acl-long.196 -
  100. [113][113] J. Gou, B. Yu, S. J. Maybank, and D. Tao, 'Knowledge distillation: - A survey,' International Journal of Computer Vision , vol. 129, no. 6, pp. 1789-1819, 2021. -
  101. [114][114] S. Masoudnia and R. Ebrahimpour, 'Mixture of experts: a literature survey,' Artificial Intelligence Review , vol. 42, pp. 275-293, 2014. -
  102. [115][115] G. Song and X. Tan, 'Real-world cross-modal retrieval via sequential learning,' IEEE Transactions on Multimedia , vol. 23, pp. 1708-1721, 2020. -
  103. [116][116] J. Han, K. Gong, Y. Zhang, J. Wang, K. Zhang, D. Lin, Y. Qiao, P. Gao, and X. Yue, 'Onellm: One framework to align all modalities with language,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 26 584-26 595. -
  104. [117][117] S. Moon, A. Madotto, Z. Lin, T. Nagarajan, M. Smith, S. Jain, C.-F. Yeh, P. Murugesan, P. Heidari, Y. Liu et al. , 'Anymal: An efficient and scalable any-modality augmented language model,' in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track , 2024, pp. 1314-1332. -
  105. [118][118] J. Zheng, Q. Ma, Z. Liu, B. Wu, and H. Feng, 'Beyond anti-forgetting: Multimodal continual instruction tuning with positive forward transfer,' ArXiv preprint , vol. abs/2401.09181, 2024. [Online]. Available: https://arxiv.org/abs/2401.09181 - · arXiv
  106. [119][119] R. D. Chiaro, B. Twardowski, A. D. Bagdanov, and J. van de Weijer, 'RATT: recurrent attention to transient tasks for continual image captioning,' in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., 2020. [Online]. Available: https://proceedings.neurips.cc/paper/2020/hash/ c2964caac096f26db222cb325aa267cb-Abstract.html -
  107. [120][120] A. Chevalier, A. Wettig, A. Ajith, and D. Chen, 'Adapting language models to compress contexts,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 3829-3846. [Online]. Available: https://aclanthology.org/2023.emnlp-main.232 -
  108. [121][121] J. Mu, X. Li, and N. D. Goodman, 'Learning to compress prompts with gist tokens,' in Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ 3d77c6dcc7f143aa2154e7f4d5e22d68-Abstract-Conference.html -
  109. [122][122] Y. Li, B. Dong, F. Guerin, and C. Lin, 'Compressing context to enhance inference efficiency of large language models,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 6342-6353. [Online]. Available: https: //aclanthology.org/2023.emnlp-main.391 -
  110. [123][123] H. Jiang, Q. Wu, C.-Y. Lin, Y. Yang, and L. Qiu, 'LLMLingua: Compressing prompts for accelerated inference of large language models,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 13 358-13 376. [Online]. Available: https://aclanthology.org/2023.emnlp-main.825 -
  111. [124][124] H. Jiang, Q. Wu, X. Luo, D. Li, C.-Y. Lin, Y. Yang, and L. Qiu, 'Longllmlingua: Accelerating and enhancing llms in long context scenarios via prompt compression,' ArXiv preprint , vol. abs/2310.06839, 2023. [Online]. Available: https://arxiv.org/abs/2310.06839 - · arXiv
  112. [125][125] M. Ding, C. Zhou, H. Yang, and J. Tang, 'Cogltx: Applying BERT to long texts,' in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., 2020. [Online]. Available: https://proceedings.neurips.cc/paper/ 2020/hash/96671501524948bc3937b4b30d0e57b9-Abstract.html -
  113. [126][126] P. Manakul and M. Gales, 'Long-span summarization via local attention and content selection,' in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , C. Zong, F. Xia, W. Li, and R. Navigli, Eds. Online: Association - for Computational Linguistics, 2021, pp. 6026-6041. [Online]. Available: https://aclanthology.org/2021.acl-long.470 -
  114. [127][127] J. Cheng and M. Lapata, 'Neural summarization by extracting sentences and words,' in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , K. Erk and N. A. Smith, Eds. Berlin, Germany: Association for Computational Linguistics, 2016, pp. 484-494. [Online]. Available: https://aclanthology.org/P16-1046 -
  115. [128][128] A. See, P. J. Liu, and C. D. Manning, 'Get to the point: Summarization with pointer-generator networks,' in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , R. Barzilay and M.-Y. Kan, Eds. Vancouver, Canada: Association for Computational Linguistics, 2017, pp. 1073-1083. [Online]. Available: https://aclanthology.org/P17-1099 -
  116. [129][129] P. Gao, J. Lu, H. Li, R. Mottaghi, and A. Kembhavi, 'Container: Context aggregation network,' ArXiv preprint , vol. abs/2106.01401, 2021. [Online]. Available: https://arxiv.org/ abs/2106.01401 - · arXiv
  117. [130][130] M. Ivgi, U. Shaham, and J. Berant, 'Efficient long-text understanding with short-text models,' Transactions of the Association for Computational Linguistics , vol. 11, pp. 284-299, 2023. [Online]. Available: https://aclanthology.org/2023.tacl-1.17 -
  118. [131][131] N. Ratner, Y. Levine, Y. Belinkov, O. Ram, I. Magar, O. Abend, E. Karpas, A. Shashua, K. Leyton-Brown, and Y. Shoham, 'Parallel context windows for large language models,' in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, 2023, pp. 6383-6402. [Online]. Available: https://aclanthology.org/2023.acl-long.352 -
  119. [132][132] N. Chen, Y. Wang, Y. Deng, and J. Li, 'The oscars of ai theater: A survey on role-playing with language models,' ArXiv preprint , vol. abs/2407.11484, 2024. [Online]. Available: https://arxiv.org/abs/2407.11484 - · arXiv
  120. [133][133] J. Chen, X. Wang, R. Xu, S. Yuan, Y. Zhang, W. Shi, J. Xie, S. Li, R. Yang, T. Zhu et al. , 'From persona to personalization: A survey on role-playing language agents,' ArXiv preprint , vol. abs/2404.18231, 2024. [Online]. Available: https://arxiv.org/abs/2404.18231 - · arXiv
  121. [134][134] Y. Shao, L. Li, J. Dai, and X. Qiu, 'Character-LLM: A trainable agent for role-playing,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 13 153-13 187. [Online]. Available: https://aclanthology.org/2023.emnlp-main.814 -
  122. [135][135] S. Hong, X. Zheng, J. Chen, Y. Cheng, J. Wang, C. Zhang, Z. Wang, S. K. S. Yau, Z. Lin, L. Zhou et al. , 'Metagpt: Meta programming for multi-agent collaborative framework,' ArXiv preprint , vol. abs/2308.00352, 2023. [Online]. Available: https://arxiv.org/abs/2308.00352 - · arXiv
  123. [136][136] S. Han, L. Chen, L.-M. Lin, Z. Xu, and K. Yu, 'Ibsen: Directoractor agent collaboration for controllable and interactive drama script generation,' ArXiv preprint , vol. abs/2407.01093, 2024. [Online]. Available: https://arxiv.org/abs/2407.01093 - · arXiv
  124. [137][137] H. Li, Y. Chong, S. Stepputtis, J. Campbell, D. Hughes, C. Lewis, and K. Sycara, 'Theory of mind for multi-agent collaboration via large language models,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 180-192. [Online]. Available: https://aclanthology.org/2023.emnlp-main.13 -
  125. [138][138] A. Fourney, G. Bansal, H. Mozannar, C. Tan, E. Salinas, F. Niedtner, G. Proebsting, G. Bassman, J. Gerrits, J. Alber et al. , 'Magentic-one: A generalist multi-agent system for solving complex tasks,' ArXiv preprint , vol. abs/2411.04468, 2024. [Online]. Available: https://arxiv.org/abs/2411.04468 - · arXiv
  126. [139][139] S. Mousavi, R. L. Guti´ errez, D. Rengarajan, V. Gundecha, A. R. Babu, A. Naug, A. Guillen, and S. Sarkar, 'N-critics: Self-refinement of large language models with ensemble of critics,' ArXiv preprint , vol. abs/2310.18679, 2023. [Online]. Available: https://arxiv.org/abs/2310.18679 - · arXiv
  127. [140][140] L. Li, Z. Chen, G. Chen, Y. Zhang, Y. Su, E. Xing, and K. Zhang, 'Confidence matters: Revisiting intrinsic self-correction capabilities of large language models,' ArXiv preprint , vol. abs/2402.12563, 2024. [Online]. Available: https: //arxiv.org/abs/2402.12563 - · arXiv
  128. [141][141] Z. Gou, Z. Shao, Y. Gong, Y. Shen, Y. Yang, N. Duan, and W. Chen, 'Critic: Large language models can self-correct with tool-interactive critiquing,' ArXiv preprint , vol. abs/2305.11738, 2023. [Online]. Available: https://arxiv.org/abs/2305.11738 - · arXiv
  129. [142][142] Q. Guo, R. Wang, J. Guo, B. Li, K. Song, X. Tan, G. Liu, J. Bian, and Y. Yang, 'Connecting large language models with evolutionary algorithms yields powerful prompt optimizers,' ArXiv preprint , vol. abs/2309.08532, 2023. [Online]. Available: https://arxiv.org/abs/2309.08532 - · arXiv
  130. [143][143] X. Wang, C. Li, Z. Wang, F. Bai, H. Luo, J. Zhang, N. Jojic, E. P. Xing, and Z. Hu, 'Promptagent: Strategic planning with language models enables expert-level prompt optimization,' ArXiv preprint , vol. abs/2310.16427, 2023. [Online]. Available: https://arxiv.org/abs/2310.16427 - · arXiv
  131. [144][144] J. S. Vitter, 'Random sampling with a reservoir,' ACM Transactions on Mathematical Software (TOMS) , vol. 11, no. 1, pp. 37-57, 1985. -
  132. [145][145] R. Aljundi, M. Lin, B. Goujaud, and Y. Bengio, 'Gradient based sample selection for online continual learning,' in Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada , H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch´ e-Buc, E. B. Fox, and R. Garnett, Eds., 2019, pp. 11 816-11 825. [Online]. Available: https://proceedings.neurips.cc/paper/2019/hash/ e562cd9c0768d5464b64cf61da7fc6bb-Abstract.html -
  133. [146][146] L. Caccia, E. Belilovsky, M. Caccia, and J. Pineau, 'Online learned continual compression with adaptive quantization modules,' in Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event , ser. Proceedings of Machine Learning Research, vol. 119. PMLR, 2020, pp. 1240-1250. [Online]. Available: http: //proceedings.mlr.press/v119/caccia20a.html -
  134. [148][148] F. M. Castro, M. J. Mar´ ın-Jim´ enez, N. Guil, C. Schmid, and K. Alahari, 'End-to-end incremental learning,' in Proceedings of the European conference on computer vision (ECCV) , 2018, pp. 233248. -
  135. [149][149] C. Wu, L. Herranz, X. Liu, Y. Wang, J. van de Weijer, and B. Raducanu, 'Memory replay gans: Learning to generate new categories without forgetting,' in Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montr´ eal, Canada , S. Bengio, H. M. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, Eds., 2018, pp. 5966-5976. [Online]. Available: https://proceedings.neurips.cc/paper/2018/hash/ a57e8915461b83adefb011530b711704-Abstract.html -
  136. [150][150] H. Shin, J. K. Lee, J. Kim, and J. Kim, 'Continual learning with deep generative replay,' in Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , I. Guyon, U. von Luxburg, S. Bengio, H. M. Wallach, R. Fergus, S. V. N. Vishwanathan, and R. Garnett, Eds., 2017, pp. 2990-2999. [Online]. Available: https://proceedings.neurips.cc/paper/ 2017/hash/0efbe98067c6c73dba1250d2beaa81f9-Abstract.html -
  137. [151][151] C. V. Nguyen, Y. Li, T. D. Bui, and R. E. Turner, 'Variational continual learning,' in 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 -May 3, 2018, Conference Track Proceedings . OpenReview.net, 2018. [Online]. Available: https://openreview.net/forum?id= BkQqq0gRb -
  138. [152][152] C. He, R. Wang, S. Shan, and X. Chen, 'Exemplar-supported generative reproduction for class incremental learning,' in British Machine Vision Conference 2018, BMVC 2018, Newcastle, UK, September 3-6, 2018 . BMVA Press, 2018, p. 98. [Online]. Available: http://bmvc2018.org/contents/papers/0325.pdf -
  139. [153][153] X. Liu, C. Wu, M. Menta, L. Herranz, B. Raducanu, A. D. Bagdanov, S. Jui, and J. v. de Weijer, 'Generative feature replay for class-incremental learning,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops , 2020, pp. 226-227. -
  140. [154][154] M. Toldo and M. Ozay, 'Bring evanescent representations to life in lifelong class incremental learning,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 16 732-16 741. -
  141. [155][155] L.-J. Lin, 'Self-improving reactive agents based on reinforcement learning, planning and teaching,' Machine learning , vol. 8, pp. 293-321, 1992. -
  142. [156][156] T. Schaul, J. Quan, I. Antonoglou, and D. Silver, 'Prioritized experience replay,' in 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings , Y. Bengio and Y. LeCun, Eds., 2016. [Online]. Available: http://arxiv.org/abs/1511.05952 - · arXiv
  143. [157][157] M. Ramicic and A. Bonarini, 'Entropy-based prioritized sampling in deep q-learning,' in 2017 2nd international conference on image, vision and computing (ICIVC) . IEEE, 2017, pp. 1068-1072. -
  144. [158][158] A. A. Li, Z. Lu, and C. Miao, 'Revisiting prioritized experience replay: A value perspective,' ArXiv preprint , vol. abs/2102.03261, 2021. [Online]. Available: https://arxiv.org/abs/2102.03261 - · arXiv
  145. [159][159] Z. Ren, D. Dong, H. Li, and C. Chen, 'Self-paced prioritized curriculum learning with coverage penalty in deep reinforcement learning,' IEEE transactions on neural networks and learning systems , vol. 29, no. 6, pp. 2216-2226, 2018. -
  146. [160][160] G. Novati and P. Koumoutsakos, 'Remember and forget for experience replay,' in Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA , ser. Proceedings of Machine Learning Research, K. Chaudhuri and R. Salakhutdinov, Eds., vol. 97. PMLR, 2019, pp. 4851-4860. [Online]. Available: http://proceedings.mlr.press/v97/novati19a.html -
  147. [161][161] P. Sun, W. Zhou, and H. Li, 'Attentive experience replay,' in The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020 . AAAI Press, 2020, pp. 5900-5907. [Online]. Available: https://aaai.org/ojs/index.php/ AAAI/article/view/6049 -
  148. [162][162] H. Liu, A. Trott, R. Socher, and C. Xiong, 'Competitive experience replay,' in 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 69, 2019 . OpenReview.net, 2019. [Online]. Available: https: //openreview.net/forum?id=Sklsm20ctX -
  149. [163][163] A. Modarressi, A. Imani, M. Fayyaz, and H. Sch¨ utze, 'Ret-llm: Towards a general read-write memory for large language models,' ArXiv preprint , vol. abs/2305.14322, 2023. [Online]. Available: https://arxiv.org/abs/2305.14322 - · arXiv
  150. [164][164] D. Lopez-Paz and M. Ranzato, 'Gradient episodic memory for continual learning,' in Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , I. Guyon, U. von Luxburg, S. Bengio, H. M. Wallach, R. Fergus, S. V. N. Vishwanathan, and R. Garnett, Eds., 2017, pp. 6467-6476. [Online]. Available: https://proceedings.neurips.cc/paper/ 2017/hash/f87522788a2be2d171666752f97ddebb-Abstract.html -
  151. [165][165] X. Kou, Y. Lin, S. Liu, P. Li, J. Zhou, and Y. Zhang, 'Disentangle-based Continual Graph Representation Learning,' in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , B. Webber, T. Cohn, Y. He, and Y. Liu, Eds. Online: Association for Computational Linguistics, 2020, pp. 2961-2972. [Online]. Available: https: //aclanthology.org/2020.emnlp-main.237 -
  152. [167][167] J. Su, D. Zou, Z. Zhang, and C. Wu, 'Towards robust graph incremental learning on evolving graphs,' in International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA , ser. Proceedings of Machine Learning Research, A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett, Eds., vol. 202. PMLR, 2023, pp. 32 728-32 748. [Online]. Available: https://proceedings.mlr. press/v202/su23a.html -
  153. [169][169] J. Liu, W. Ke, P. Wang, J. Wang, J. Gao, Z. Shang, G. Li, Z. Xu, K. Ji, and Y. Li, 'Fast and continual knowledge graph embedding via incremental lora,' ArXiv preprint , vol. abs/2407.05705, 2024. [Online]. Available: https://arxiv.org/abs/2407.05705 - · arXiv
  154. [173][173] Z. Cheng, T. Xie, P. Shi, C. Li, R. Nadkarni, Y. Hu, C. Xiong, D. Radev, M. Ostendorf, L. Zettlemoyer, N. A. Smith, and T. Yu, 'Binding language models in symbolic languages,' in The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023 . OpenReview.net, 2023. [Online]. Available: https://openreview. net/pdf?id=lH1PV42cbF -
  155. [174][174] R. Sun, S. ¨ O. Arik, A. Muzio, L. Miculicich, S. Gundabathula, P. Yin, H. Dai, H. Nakhost, R. Sinha, Z. Wang et al. , 'Sql-palm: Improved large language model adaptation for text-to-sql (extended),' ArXiv preprint , vol. abs/2306.00739, 2023. [Online]. Available: https://arxiv.org/abs/2306.00739 - · arXiv
  156. [175][175] R. Pedro, D. Castro, P. Carreira, and N. Santos, 'From prompt injections to sql injection attacks: How protected is your llmintegrated web application?' ArXiv preprint , vol. abs/2308.01990, 2023. [Online]. Available: https://arxiv.org/abs/2308.01990 - · arXiv
  157. [176][176] R. Liu, J. Zhang, Y. Song, Y. Zhang, and B. Yang, 'Filling memory gaps: Enhancing continual semantic parsing via sql syntax variance-guided llms without real data replay,' ArXiv preprint , vol. abs/2412.07246, 2024. [Online]. Available: https://arxiv.org/abs/2412.07246 - · arXiv
  158. [177][177] T. On, S. Ghosh, M. Du, and S. B. Roy, 'Proportionate diversification of top-k llm results using database queries,' DEF , vol. 2, p. 1, 2002. -
  159. [178][178] S. Xue, C. Jiang, W. Shi, F. Cheng, K. Chen, H. Yang, Z. Zhang, J. He, H. Zhang, G. Wei et al. , 'Db-gpt: Empowering database interactions with private large language models,' ArXiv preprint , vol. abs/2312.17449, 2023. [Online]. Available: https://arxiv.org/abs/2312.17449 - · arXiv
  160. [179][179] Y. Wang, J. Zeng, X. Liu, D. F. Wong, F. Meng, J. Zhou, and M. Zhang, 'Delta: An online document-level translation agent based on multi-level memory,' ArXiv preprint , vol. abs/2410.08143, 2024. [Online]. Available: https://arxiv.org/ abs/2410.08143 - · arXiv
  161. [180][180] S. V. Mehta, J. Gupta, Y. Tay, M. Dehghani, V. Q. Tran, J. Rao, M. Najork, E. Strubell, and D. Metzler, 'DSI++: Updating transformer memory with new documents,' in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , H. Bouamor, J. Pino, and K. Bali, Eds. Singapore: Association for Computational Linguistics, 2023, pp. 8198-8213. [Online]. Available: https: //aclanthology.org/2023.emnlp-main.510 -
  162. [181][181] V. Kishore, C. Wan, J. Lovelace, Y. Artzi, and K. Q. Weinberger, 'Incdsi: Incrementally updatable document retrieval,' in International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA , ser. Proceedings of Machine Learning Research, A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett, Eds., vol. 202. PMLR, 2023, pp. 17122-17134. [Online]. Available: https://proceedings.mlr.press/v202/kishore23a.html -
  163. [182][182] T.-L. Huynh, T.-T. Vu, W. Wang, Y. Wei, T. Le, D. Gasevic, Y.-F. Li, and T.-T. Do, 'Promptdsi: Prompt-based rehearsal-free instance-wise incremental learning for document retrieval,' ArXiv preprint , vol. abs/2406.12593, 2024. [Online]. Available: https://arxiv.org/abs/2406.12593 - · arXiv
  164. [183][183] J. Chen, R. Zhang, J. Guo, Y. Liu, Y. Fan, and X. Cheng, 'Corpusbrain: Pre-train a generative retrieval model for knowledgeintensive language tasks,' in Proceedings of the 31st ACM International Conference on Information & Knowledge Management , 2022, pp. 191-200. -
  165. [184][184] J. Guo, C. Zhou, R. Zhang, J. Chen, M. de Rijke, Y. Fan, and X. Cheng, 'Corpusbrain++: A continual generative pretraining framework for knowledge-intensive language tasks,' ArXiv preprint , vol. abs/2402.16767, 2024. [Online]. Available: https://arxiv.org/abs/2402.16767 - · arXiv
  166. [185][185] X. Zhou, G. Li, and Z. Liu, 'Llm as dba,' ArXiv preprint , vol. abs/2308.05481, 2023. [Online]. Available: https: //arxiv.org/abs/2308.05481 - · arXiv
  167. [186][186] N. Liu, L. Chen, X. Tian, W. Zou, K. Chen, and M. Cui, 'From llm to conversational agent: A memory enhanced architecture with fine-tuning of large language models,' ArXiv preprint , vol. abs/2401.02777, 2024. [Online]. Available: https://arxiv.org/abs/2401.02777 - · arXiv
  168. [187][187] K. Mitsui, Y. Hono, and K. Sawada, 'Towards human-like spoken dialogue generation between ai agents from written dialogue,' ArXiv preprint , vol. abs/2310.01088, 2023. [Online]. Available: https://arxiv.org/abs/2310.01088 - · arXiv
  169. [188][188] Q. Wu, G. Bansal, J. Zhang, Y. Wu, S. Zhang, E. Zhu, B. Li, L. Jiang, X. Zhang, and C. Wang, 'Autogen: Enabling next-gen llm applications via multi-agent conversation framework,' ArXiv preprint , vol. abs/2308.08155, 2023. [Online]. Available: https://arxiv.org/abs/2308.08155 - · arXiv
  170. [189][189] Y. Deng, W. Zhang, W. Lam, S.-K. Ng, and T.-S. Chua, 'Plug-andplay policy planner for large language model powered dialogue agents,' in The Twelfth International Conference on Learning Representations , 2023. -
  171. [191][191] X. Xu, Z. Gou, W. Wu, Z.-Y. Niu, H. Wu, H. Wang, and S. Wang, 'Long time no see! open-domain conversation with long-term persona memory,' in Findings of the Association for Computational Linguistics: ACL 2022 , S. Muresan, P. Nakov, and A. Villavicencio, Eds. Dublin, Ireland: Association for Computational Linguistics, 2022, pp. 2639-2650. [Online]. Available: https://aclanthology.org/2022.findings-acl.207 -
  172. [192][192] Z. Huang, S. Gutierrez, H. Kamana, and S. MacNeil, 'Memory sandbox: Transparent and interactive memory management for conversational agents,' in Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology , 2023, pp. 1-3. -
  173. [193][193] S. Bae, D. Kwak, S. Kang, M. Y. Lee, S. Kim, Y. Jeong, H. Kim, S.-W. Lee, W. Park, and N. Sung, 'Keep me updated! memory management in long-term conversations,' in Findings of the Association for Computational Linguistics: EMNLP 2022 , Y. Goldberg, Z. Kozareva, and Y. Zhang, Eds. Abu Dhabi, United Arab Emirates: Association for Computational Linguistics, 2022, pp. 3769-3787. [Online]. Available: https://aclanthology.org/2022.findings-emnlp.276 -
  174. [194][194] S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. R. Narasimhan, and Y. Cao, 'React: Synergizing reasoning and acting in language models,' in The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023 . OpenReview.net, 2023. [Online]. Available: https: //openreview.net/pdf?id=WE vluYUL-X -
  175. [195][195] Q. Wang, Z. Mao, B. Wang, and L. Guo, 'Knowledge graph embedding: A survey of approaches and applications,' IEEE transactions on knowledge and data engineering , vol. 29, no. 12, pp. 2724-2743, 2017. -
  176. [196][196] Z. Pan and P. Wang, 'Hyperbolic hierarchy-aware knowledge graph embedding for link prediction,' in Findings of the Association for Computational Linguistics: EMNLP 2021 , M.-F. Moens, X. Huang, L. Specia, and S. W.-t. Yih, Eds. Punta Cana, Dominican Republic: Association for Computational Linguistics, 2021, pp. 2941-2948. [Online]. Available: https: //aclanthology.org/2021.findings-emnlp.251 -
  177. [198][198] Z. Shang, P. Wang, Y. Liu, J. Liu, and W. Ke, 'Askrl: An alignedspatial knowledge representation learning framework for openworld knowledge graph,' in International Semantic Web Conference . Springer, 2023, pp. 101-120. -
  178. [200][200] H. Wang, W. Xiong, M. Yu, X. Guo, S. Chang, and W. Y. Wang, 'Sentence embedding alignment for lifelong relation extraction,' in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , J. Burstein, C. Doran, and T. Solorio, Eds. Minneapolis, Minnesota: Association for Computational Linguistics, 2019, pp. 796-806. [Online]. Available: https://aclanthology.org/N19-1086 -
  179. [201][201] E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, 'Lora: Low-rank adaptation of large language models,' in The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 . OpenReview.net, 2022. [Online]. Available: https: //openreview.net/forum?id=nZeVKeeFYf9 -
  180. [202][202] X. Li, J. Jin, Y. Zhou, Y. Zhang, P. Zhang, Y. Zhu, and Z. Dou, 'From matching to generation: A survey on generative information retrieval,' ArXiv preprint , vol. abs/2404.14851, 2024. [Online]. Available: https://arxiv.org/abs/2404.14851 - · arXiv
  181. [203][203] Y. Tay, V. Tran, M. Dehghani, J. Ni, D. Bahri, H. Mehta, Z. Qin, K. Hui, Z. Zhao, J. P. Gupta, T. Schuster, W. W. Cohen, and D. Metzler, 'Transformer memory as a differentiable search index,' in Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 -December 9, 2022 , S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., 2022. [Online]. Available: http://papers.nips.cc/paper files/paper/2022/hash/ 892840a6123b5ec99ebaab8be1530fba-Abstract-Conference.html -
  182. [204][204] Y. Qin, S. Liang, Y. Ye, K. Zhu, L. Yan, Y. Lu, Y. Lin, X. Cong, X. Tang, B. Qian et al. , 'Toolllm: Facilitating large language models to master 16000+ real-world apis,' ArXiv preprint , vol. abs/2307.16789, 2023. [Online]. Available: https://arxiv.org/abs/2307.16789 - · arXiv
  183. [205][205] Z. Yuan, H. Yuan, C. Li, G. Dong, K. Lu, C. Tan, C. Zhou, and J. Zhou, 'Scaling relationship on learning mathematical reasoning with large language models,' ArXiv preprint , vol. abs/2308.01825, 2023. [Online]. Available: https: //arxiv.org/abs/2308.01825 - · arXiv
  184. [206][206] Y. Xu, X. Liu, X. Liu, Z. Hou, Y. Li, X. Zhang, Z. Wang, A. Zeng, Z. Du, W. Zhao et al. , 'Chatglm-math: Improving math problem-solving in large language models with a self-critique pipeline,' ArXiv preprint , vol. abs/2404.02893, 2024. [Online]. Available: https://arxiv.org/abs/2404.02893 - · arXiv
  185. [207][207] A. Zeng, M. Liu, R. Lu, B. Wang, X. Liu, Y. Dong, and J. Tang, 'Agenttuning: Enabling generalized agent abilities for llms,' ArXiv preprint , vol. abs/2310.12823, 2023. [Online]. Available: https://arxiv.org/abs/2310.12823 - · arXiv
  186. [208][208] D. Yin, F. Brahman, A. Ravichander, K. Chandu, K.-W. Chang, Y. Choi, and B. Y. Lin, 'Agent lumos: Unified and modular training for open-source language agents,' in Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2024, pp. 12 380-12 403. -
  187. [209][209] M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. D. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman et al. , 'Evaluating large language models trained on code,' ArXiv preprint , vol. abs/2107.03374, 2021. [Online]. Available: https://arxiv.org/abs/2107.03374 - · arXiv
  188. [210][210] R. Zellers, A. Holtzman, Y. Bisk, A. Farhadi, and Y. Choi, 'HellaSwag: Can a machine really finish your sentence?' in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , A. Korhonen, D. Traum, and - L. M` arquez, Eds. Florence, Italy: Association for Computational Linguistics, 2019, pp. 4791-4800. [Online]. Available: https: //aclanthology.org/P19-1472 -
  189. [211][211] M. Joshi, E. Choi, D. Weld, and L. Zettlemoyer, 'TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension,' in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , R. Barzilay and M.-Y. Kan, Eds. Vancouver, Canada: Association for Computational Linguistics, 2017, pp. 1601-1611. [Online]. Available: https://aclanthology.org/P17-1147 -
  190. [212][212] C. Clark, K. Lee, M.-W. Chang, T. Kwiatkowski, M. Collins, and K. Toutanova, 'BoolQ: Exploring the surprising difficulty of natural yes/no questions,' in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , J. Burstein, C. Doran, and T. Solorio, Eds. Minneapolis, Minnesota: Association for Computational Linguistics, 2019, pp. 2924-2936. [Online]. Available: https://aclanthology.org/N19-1300 -
  191. [213][213] K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano et al. , 'Training verifiers to solve math word problems,' ArXiv preprint , vol. abs/2110.14168, 2021. [Online]. Available: https://arxiv.org/abs/2110.14168 - · arXiv
  192. [214][214] D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt, 'Measuring massive multitask language understanding,' in 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021 . OpenReview.net, 2021. [Online]. Available: https://openreview.net/forum?id=d7KBjmI3GmQ -
  193. [215][215] M. Suzgun, N. Scales, N. Sch¨ arli, S. Gehrmann, Y. Tay, H. W. Chung, A. Chowdhery, Q. Le, E. Chi, D. Zhou, and J. Wei, 'Challenging BIG-bench tasks and whether chain-ofthought can solve them,' in Findings of the Association for Computational Linguistics: ACL 2023 , A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, 2023, pp. 13 003-13 051. [Online]. Available: https://aclanthology.org/2023.findings-acl.824 -
  194. [217][217] B. Chen, C. Shu, E. Shareghi, N. Collier, K. Narasimhan, and S. Yao, 'Fireact: Toward language agent fine-tuning,' ArXiv preprint , vol. abs/2310.05915, 2023. [Online]. Available: https://arxiv.org/abs/2310.05915 - · arXiv
  195. [218][218] J. Wei, X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. H. Chi, Q. V. Le, and D. Zhou, 'Chainof-thought prompting elicits reasoning in large language models,' in Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 -December 9, 2022 , S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, Eds., 2022. [Online]. Available: http://papers.nips.cc/paper files/paper/2022/hash/ 9d5609613524ecf4f15af0f7b31abca4-Abstract-Conference.html -
  196. [219][219] Z. Tao, T.-E. Lin, X. Chen, H. Li, Y. Wu, Y. Li, Z. Jin, F. Huang, D. Tao, and J. Zhou, 'A survey on self-evolution of large language models,' ArXiv preprint , vol. abs/2404.14387, 2024. [Online]. Available: https://arxiv.org/abs/2404.14387 - · arXiv
  197. [220][220] Y. Wang, Y. Kordi, S. Mishra, A. Liu, N. A. Smith, D. Khashabi, and H. Hajishirzi, 'Self-instruct: Aligning language models with self-generated instructions,' in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, 2023, pp. 13 484-13 508. [Online]. Available: https://aclanthology.org/2023.acl-long.754 -
  198. [221][221] Z. Chen, Y. Deng, H. Yuan, K. Ji, and Q. Gu, 'Self-play fine-tuning converts weak language models to strong language models,' ArXiv preprint , vol. abs/2401.01335, 2024. [Online]. Available: https://arxiv.org/abs/2401.01335 - · arXiv
  199. [222][222] A. L. Samuel, 'Some studies in machine learning using the game of checkers,' IBM Journal of research and development , vol. 3, no. 3, pp. 210-229, 1959. -
  200. [223][223] R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn, 'Direct preference optimization: Your language model is secretly a reward model,' in Advances in Neural Information - Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023 , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, Eds., 2023. [Online]. Available: http://papers.nips.cc/paper files/paper/2023/hash/ a85b405ed65c6477a4fe8302b5e06ce7-Abstract-Conference.html -

200 of 328 shown

Cited by

Sorted by citations

Related

Authors
Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q.
Affiliations
South China University of Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2501.07278
arXiv
2501.07278
OpenAlex
W6910806095
Cited by
4
References
0
Citations by year
2026: 1 · 2025: 3
Type
posted content
Language
en
Open access
Licence
Locations
arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
lifelong learning, continual learning, LLM agents, artificial general intelligence, catastrophic forgetting, memory modules, multisensory perception, knowledge retrieval, incremental learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review