CoChat
Sign Up
PreprintCited by 1Speech and dialogue systemsArtificial Intelligence ApplicationsNatural Language Processing Techniques

Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Survey

Open access
Zhu, Jiachen, Zhu, Menghui, Rui, Renting, Shan, Rong, Zheng, Congmin, Chen, Bo, Xi, Yunjia, Lin, Jianghao +4 more·2025·arXiv
DOI 10.48550/arxiv.2506.11102arXiv 2506.11102
Open this paper in CoChat — free accountOpen PDF

Abstract

The advent of large language models (LLMs), such as GPT, Gemini, and DeepSeek, has significantly advanced natural language processing, giving rise to sophisticated chatbots capable of diverse language-related tasks. The transition from these traditional LLM chatbots to more advanced AI agents represents a pivotal evolutionary step. However, existing evaluation frameworks often blur the distinctions between LLM chatbots and AI agents, leading to confusion among researchers selecting appropriate benchmarks. To bridge this gap, this paper introduces a systematic analysis of current evaluation approaches, grounded in an evolutionary perspective. We provide a detailed analytical framework that clearly differentiates AI agents from LLM chatbots along five key aspects: complex environment, multi-source instructor, dynamic feedback, multi-modal perception, and advanced capability. Further, we categorize existing evaluation benchmarks based on external environments driving forces, and resulting advanced internal capabilities. For each category, we delineate relevant evaluation attributes, presented comprehensively in practical reference tables. Finally, we synthesize current trends and outline future evaluation methodologies through four critical lenses: environment, agent, evaluator, and metrics. Our findings offer actionable guidance for researchers, facilitating the informed selection and application of benchmarks in AI agent evaluation, thus fostering continued advancement in this rapidly evolving research domain.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2506.11102

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Most current benchmarks evaluate agents primarily through task completion under fixed prompts and fixed model settings.

    “Most current benchmarks evaluate agents primarily through task completion under fixed prompts and fixed model settings [Zhu et al., 2025, Mishra et al., 2026].”

    From Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering (2026) · cites this paper as Zhu et al., 2025

    The Environment Perspective (p. 12) says earlier benchmarks, especially in web and mobile settings, generally assessed whether agents reached a task’s final state. The Agent Perspective (p. 12) also describes early benchmarks built around single-turn prompts. These passages do not establish that most current benchmarks use fixed prompts or fixed model settings; the discussion of static evaluation in Mobile Environments (p. 6) is likewise limited to earlier benchmarks. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 191

  1. [1][1] A. Vaswani, N. Shazeer et al. , 'Attention is all you need,' in Advances in Neural Information Processing Systems , 2017, pp. 5998-6008. [Online]. Available: http://arxiv.org/abs/1706.03762 - · arXiv
  2. [2][2] OpenAI, 'Gpt-4 technical report,' arXiv preprint arXiv:2303.08774 , 2023. [Online]. Available: https: //doi.org/10.48550/arXiv.2303.08774 - · DOI · Paper page
  3. [3][3] H. Touvron, T. Lavril et al. , 'Llama: Open and efficient foundation language models,' CoRR , vol. abs/2302.13971, 2023. [Online]. Available: https: //doi.org/10.48550/arXiv.2302.13971 - · DOI · Paper page
  4. [4][4] R. Anil, S. Borgeaud et al. , 'Gemini: A family of highly capable multimodal models,' arXiv preprint arXiv:2312.11805 , 2023. [Online]. Available: https: //arxiv.org/abs/2312.11805 - · arXiv
  5. [5][5] Y. Bai, Y. Lin et al. , 'Qwen technical report,' arXiv preprint arXiv:2309.16609 , 2023. [Online]. Available: https://arxiv.org/abs/2309.16609 - · arXiv
  6. [6][6] D. Guo, D. Yang et al. , 'Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning,' arXiv preprint arXiv:2501.12948 , 2025. [Online]. Available: https://arxiv.org/abs/2501.12948 - · arXiv
  7. [7][7] T. Abuelsaad, D. Akkil et al. , 'Agent-e: From autonomous web navigation to foundational design principles in agentic systems,' arXiv preprint arXiv:2407.13032 , 2024. [Online]. Available: https://arxiv.org/abs/2407.13032 - · arXiv
  8. [8][8] Y. Song, F. Xu et al. , 'Beyond browsing: Api-based web agents,' arXiv preprint arXiv:2410.16464 , 2024. [Online]. Available: https://arxiv.org/abs/2410.16464 - · arXiv
  9. [9][9] N. Shinn, F. Cassano et al. , 'Reflexion: Language agents with verbal reinforcement learning,' arXiv preprint arXiv:2303.11366 , 2023. [Online]. Available: https://arxiv.org/abs/2303.11366 - · arXiv
  10. [10][10] Y. Chang, X. Wang et al. , 'A survey on evaluation of large language models,' 2023. [Online]. Available: https://arxiv.org/abs/2307.03109 - · arXiv
  11. [11][11] M. T. R. Laskar, S. Alqahtani et al. , 'A systematic survey and critical review on evaluating large language models: 12. Challenges, limitations, and recommendations,' 2024. [Online]. Available: https://arxiv.org/abs/2407.04069 - · arXiv
  12. [12][12] Z. Guo, R. Jin et al. , 'Evaluating large language models: A comprehensive survey,' 2023. [Online]. Available: https://arxiv.org/abs/2310.19736 - · arXiv
  13. [13][13] M. Chen, J. Tworek et al. , 'Evaluating large language models trained on code,' arXiv preprint arXiv:2107.03374 , 2021. - · arXiv
  14. [14][14] X. Du, M. Liu et al. , 'Classeval: A manually-crafted benchmark for evaluating llms on class-level code generation,' arXiv preprint arXiv:2308.01861 , 2023. - · arXiv
  15. [15][15] H. Yu, B. Shen et al. , 'Codereval: A benchmark of pragmatic code generation with generative pre-trained models,' in Proceedings of the 46th IEEE/ACM International Conference on Software Engineering , 2024, pp. 1-12. -
  16. [16][16] Z. Yuan, J. Liu et al. , 'Evaluating instruction-tuned large language models on code comprehension and generation,' arXiv preprint arXiv:2308.01240 , 2023. - · arXiv
  17. [17][17] A. Zhang, M. Dong et al. , 'Codecriticbench: A holistic code critique benchmark for large language models,' arXiv preprint arXiv:2502.16614 , 2025. - · arXiv
  18. [18][18] A. Gu, B. Rozière et al. , 'Cruxeval: A benchmark for code reasoning, understanding and execution,' arXiv preprint arXiv:2401.03065 , 2024. - · arXiv
  19. [19][19] T. Y. Zhuo, M. C. Vu et al. , 'Bigcodebench: Benchmarking code generation with diverse function calls and complex instructions,' arXiv preprint arXiv:2406.15877 , 2024. - · arXiv
  20. [20][20] P. Yin, W.-D. Li et al. , 'Natural language to code generation in interactive data science notebooks,' arXiv preprint arXiv:2212.09248 , 2022. - · arXiv
  21. [21][21] C. E. Jimenez, J. Yang et al. , 'Swe-bench: Can language models resolve real-world github issues?' arXiv preprint arXiv:2310.06770 , 2023. - · arXiv
  22. [22][22] J. Yang, C. E. Jimenez et al. , 'Swe-bench multimodal: Do ai systems generalize to visual software domains?' arXiv preprint arXiv:2410.03859 , 2024. - · arXiv
  23. [23][23] A. Antoniades, A. Örwall, K. Zhang et al. , 'Swesearch: Enhancing software agents with monte carlo tree search and iterative refinement,' arXiv preprint arXiv:2410.20285 , 2024. - · arXiv
  24. [24][24] D. Zan, Z. Huang et al. , 'Swe-bench-java: A github issue resolving benchmark for java, 2024,' URL https://arxiv. org/abs/2408.14354 . -
  25. [26][26] A. Yadavally, H. Nguyen et al. , 'Large language model critics for execution-free evaluation of code changes,' arXiv preprint arXiv:2501.16655 , 2025. - · arXiv
  26. [27][27] R. Aleithan, H. Xue, and et al., 'Swe-bench+: Enhanced coding benchmark for llms,' arXiv preprint arXiv:2410.06992 , 2024. - · arXiv
  27. [28][28] T. Liu, C. Xu, and J. McAuley, 'Repobench: Benchmarking repository-level code auto-completion systems,' arXiv preprint arXiv:2306.03091 , 2023. - · arXiv
  28. [29][29] N. Mündler, M. Müller, J. He, and M. Vechev, 'Swtbench: Testing and validating real-world bug-fixes with - code agents,' Advances in Neural Information Processing Systems , vol. 37, pp. 81 857-81 887, 2024. -
  29. [30][30] C. Qian, W. Liu et al. , 'Chatdev: Communicative agents for software development,' arXiv preprint arXiv:2307.07924 , 2023. - · arXiv
  30. [31][31] B. Li, W. Wu et al. , 'Prompting large language models to tackle the full software development lifecycle: A case study,' arXiv preprint arXiv:2403.08604 , 2024. - · arXiv
  31. [32][32] X. Tang, Y. Liu et al. , 'Ml-bench: Evaluating large language models and agents for machine learning tasks on repository-level code,' arXiv preprint arXiv:2311.09835 , 2023. - · arXiv
  32. [33][33] Y. Zhang, Y. Pan, Y. Wang, and J. Cai, 'Pybench: Evaluating llm agent on various real-world coding tasks,' 2024. [Online]. Available: https://arxiv.org/abs/ 2407.16732 -
  33. [34][34] T. Shi, A. Karpathy et al. , 'World of bits: An opendomain platform for web-based agents,' in Proceedings of the 34th International Conference on Machine Learning , ser. Proceedings of Machine Learning Research, D. Precup and Y. W. Teh, Eds., vol. 70. PMLR, 06-11 Aug 2017, pp. 3135-3144. [Online]. Available: https://proceedings.mlr.press/v70/shi17a.html -
  34. [35][35] E. Z. Liu, K. Guu et al. , 'Reinforcement learning on web interfaces using workflow-guided exploration,' 2018. [Online]. Available: https://arxiv.org/abs/1802.08802 - · arXiv
  35. [36][36] S. Yao, H. Chen et al. , 'Webshop: Towards scalable real-world web interaction with grounded language agents,' 2023. [Online]. Available: https://arxiv.org/abs/ - [2207.01206](https://arxiv.org/abs/2207.01206) - · arXiv
  36. [37][37] X. Deng, Y. Gu et al. , 'Mind2web: Towards a generalist agent for the web,' 2023. [Online]. Available: https://arxiv.org/abs/2306.06070 - · arXiv
  37. [38][38] H. He, W. Yao et al. , 'Webvoyager: Building an endto-end web agent with large multimodal models,' arXiv preprint arXiv:2401.13919 , 2024. - · arXiv
  38. [39][39] X. H. Lù, Z. Kasner, and S. Reddy, 'Weblinx: Real-world website navigation with multi-turn dialogue,' arXiv preprint arXiv:2402.05930 , 2024. - · arXiv
  39. [40][40] S. Zhou, F. F. Xu et al. , 'Webarena: A realistic web environment for building autonomous agents,' 2024. [Online]. Available: https://arxiv.org/abs/2307.13854 - · arXiv
  40. [41][41] J. Y. Koh, R. Lo et al. , 'Visualwebarena: Evaluating multimodal agents on realistic visual web tasks,' 2024. [Online]. Available: https://arxiv.org/abs/2401.13649 - · arXiv
  41. [42][42] A. Drouin, M. Gasse et al. , 'Workarena: How capable are web agents at solving common knowledge work tasks?' 2024. [Online]. Available: https://arxiv.org/abs/ 2403.07718 -
  42. [43][43] L. Boisvert, M. Thakkar et al. , 'Workarena++: Towards compositional planning and reasoning-based common knowledge work tasks,' 2025. [Online]. Available: https://arxiv.org/abs/2407.05291 - · arXiv
  43. [44][44] Z. Zhang, S. Tian, L. Chen, and Z. Liu, 'Mmina: Benchmarking multihop multimodal internet agents,' 2024. [Online]. Available: https://arxiv.org/abs/2404. 09992 -
  44. [45][45] O. Yoran, S. J. Amouyal et al. , 'Assistantbench: Can web - agents solve realistic and time-consuming tasks?' 2024. [Online]. Available: https://arxiv.org/abs/2407.15711 - · arXiv
  45. [46][46] Y. Pan, D. Kong et al. , 'Webcanvas: Benchmarking web agents in online environments,' 2024. [Online]. Available: https://arxiv.org/abs/2406.12373 - · arXiv
  46. [47][47] I. Levy, B. Wiesel et al. , 'St-webagentbench: A benchmark for evaluating safety and trustworthiness in web agents,' 2024. [Online]. Available: https: //arxiv.org/abs/2410.06703 -
  47. [48][48] L. Jang, Y. Li et al. , 'Videowebarena: Evaluating long context multimodal agents with video understanding web tasks,' 2025. [Online]. Available: https://arxiv.org/ abs/2410.19100 - · arXiv
  48. [49][49] K. Xu, Y. Kordi et al. , 'Tur[k]ingbench: A challenge benchmark for web agents,' 2025. [Online]. Available: https://arxiv.org/abs/2403.11905 - · arXiv
  49. [50][50] Y. Song, K. Thai et al. , 'Bearcubs: A benchmark for computer-using web agents,' 2025. [Online]. Available: https://arxiv.org/abs/2503.07919 - · arXiv
  50. [51][51] F. F. Xu, Y. Song et al. , 'Theagentcompany: Benchmarking llm agents on consequential real world tasks,' 2024. [Online]. Available: https://arxiv.org/abs/ 2412.14161 -
  51. [52][52] S. Kara, F. Faisal, and S. Nath, 'Waber: Evaluating reliability and efficiency of web agents with existing benchmarks,' in ICLR 2025 Workshop on Foundation Models in the Wild . -
  52. [53][53] X. Liu, T. Zhang et al. , 'Visualagentbench: Towards large multimodal models as visual foundation agents,' 2024. [Online]. Available: https://arxiv.org/abs/2408. 06327 -
  53. [54][54] T. Xue, W. Qi et al. , 'An illusion of progress? assessing the current state of web agents,' 2025. [Online]. Available: https://arxiv.org/abs/2504.01382 - · arXiv
  54. [55][55] D. Garg, S. VanWeelden et al. , 'Real: Benchmarking autonomous agents on deterministic simulations of real websites,' 2025. [Online]. Available: https: //arxiv.org/abs/2504.11543 -
  55. [56][56] R. Kapoor, Y. P. Butala et al. , 'Omniact: A dataset and benchmark for enabling multimodal generalist autonomous agents for desktop and web,' 2024. [Online]. Available: https://arxiv.org/abs/2402.17553 - · arXiv
  56. [57][57] S. Chen, S. Wiseman, and B. Dhingra, 'Chatshop: Interactive information seeking with language agents,' 2024. [Online]. Available: https://arxiv.org/abs/2404. 09911 -
  57. [58][58] T. Xie, D. Zhang et al. , 'Osworld: Benchmarking multimodal agents for open-ended tasks in real computer environments,' Advances in Neural Information Processing Systems , vol. 37, pp. 52 040-52 094, 2024. -
  58. [59][59] R. Bonatti, D. Zhao et al. , 'Windows agent arena: Evaluating multi-modal os agents at scale,' arXiv preprint arXiv:2409.08264 , 2024. - · arXiv
  59. [60][60] L. Zheng, Z. Huang et al. , 'Agentstudio: A toolkit for building general virtual agents,' arXiv preprint arXiv:2403.17918 , 2024. - · arXiv
  60. [61][61] R. Kapoor, Y. P. Butala et al. , 'Omniact: A dataset and benchmark for enabling multimodal generalist - autonomous agents for desktop and web,' in European Conference on Computer Vision . Springer, 2024, pp. 161-178. -
  61. [62][62] Z. Wang, Y. Cui et al. , 'Officebench: Benchmarking language agents across multiple applications for office automation,' arXiv preprint arXiv:2407.19056 , 2024. - · arXiv
  62. [63][63] H. Liu, X. Zhang et al. , 'Pc-agent: A hierarchical multi-agent collaboration framework for complex task automation on pc,' arXiv preprint arXiv:2502.14282 , 2025. - · arXiv
  63. [64][64] Y. Li, J. He et al. , 'Mapping natural language instructions to mobile ui action sequences,' arXiv preprint arXiv:2005.03776 , 2020. - · arXiv
  64. [65][65] S. G. Venkatesh, P. Talukdar, and S. Narayanan, 'Ugif: Ui grounded instruction following,' arXiv preprint arXiv:2211.07615 , 2022. - · arXiv
  65. [66][66] A. Burns, D. Arsan et al. , 'Mobile app tasks with iterative feedback (motif): Addressing task feasibility in interactive visual environments,' arXiv preprint arXiv:2104.08560 , 2021. - · arXiv
  66. [67][67] C. Rawles, A. Li et al. , 'Androidinthewild: A large-scale dataset for android device control,' Advances in Neural Information Processing Systems , vol. 36, pp. 59 70859 728, 2023. -
  67. [68][68] W. Li, W. E. Bishop et al. , 'On the effects of data scale on ui control agents,' Advances in Neural Information Processing Systems , vol. 37, pp. 92 130-92 154, 2024. -
  68. [69][69] Y. Chai, S. Huang et al. , 'Amex: Android multiannotation expo dataset for mobile gui agents,' arXiv preprint arXiv:2407.17490 , 2024. - · arXiv
  69. [70][70] J. Lee, T. Min et al. , 'Benchmarking mobile device control agents across diverse configurations,' arXiv preprint arXiv:2404.16660 , 2024. - · arXiv
  70. [71][71] C. Rawles, S. Clinckemaillie et al. , 'Androidworld: A dynamic benchmarking environment for autonomous agents,' arXiv preprint arXiv:2405.14573 , 2024. - · arXiv
  71. [72][72] S. Deng, W. Xu et al. , 'Mobile-bench: An evaluation benchmark for llm-based mobile agents,' arXiv preprint arXiv:2407.00993 , 2024. - · arXiv
  72. [73][73] Y. Chai, H. Li et al. , 'A3: Android agent arena for mobile gui agents,' arXiv preprint arXiv:2501.01149 , 2025. - · arXiv
  73. [74][74] D. Zhang, Z. Shen et al. , 'Mobile-env: Building qualified evaluation benchmarks for llm-gui interaction,' arXiv preprint arXiv:2305.08144 , 2023. - · arXiv
  74. [75][75] M. Xing, R. Zhang et al. , 'Understanding the weakness of large language model agents within a complex android environment,' in Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , 2024, pp. 6061-6072. -
  75. [76][76] J. Lee, D. Hahm et al. , 'Mobilesafetybench: Evaluating safety of autonomous agents in mobile device control,' arXiv preprint arXiv:2410.17520 , 2024. - · arXiv
  76. [77][77] L. Wang, Y. Deng et al. , 'Mobileagentbench: An efficient and user-friendly benchmark for mobile llm agents,' arXiv preprint arXiv:2406.08184 , 2024. - · arXiv
  77. [78][78] J. Chen, D. Yuen et al. , 'Spa-bench: A comprehensive benchmark for smartphone agent evaluation,' in NeurIPS - 2024 Workshop on Open-World Agents , 2024. -
  78. [79][79] L. Zhang, S. Wang et al. , 'Llamatouch: A faithful and scalable testbed for mobile ui task automation,' in Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology , 2024, pp. 1-13. -
  79. [80][80] Y. Xu, X. Liu et al. , 'Androidlab: Training and systematic benchmarking of android autonomous agents,' arXiv preprint arXiv:2410.24024 , 2024. - · arXiv
  80. [81][81] J. Sun, Z. Hua, and Y. Xia, 'Autoeval: A practical framework for autonomous evaluation of mobile agents,' arXiv preprint arXiv:2503.02403 , 2025. - · arXiv
  81. [82][82] P. Clark, I. Cowhey et al. , 'Think you have solved question answering? try arc, the ai2 reasoning challenge,' arXiv preprint arXiv:1803.05457 , 2018. - · arXiv
  82. [83][83] P. Lu, S. Mishra et al. , 'Learn to explain: Multimodal reasoning via thought chains for science question answering,' 2022. [Online]. Available: https://arxiv.org/ abs/2209.09513 - · arXiv
  83. [84][84] P. Dasigi, K. Lo et al. , 'A dataset of information-seeking questions and answers anchored in research papers,' arXiv preprint arXiv:2105.03011 , 2021. - · arXiv
  84. [85][85] Y. Lee, K. Lee et al. , 'Qasa: advanced question answering on scientific articles,' in International Conference on Machine Learning . PMLR, 2023, pp. 19 036-19 052. -
  85. [86][86] E. Chamoun, M. Schlichktrull, and A. Vlachos, 'Automated focused feedback generation for scientific writing assistance,' arXiv preprint arXiv:2405.20477 , 2024. - · arXiv
  86. [87][87] R. Lou, H. Xu et al. , 'Aaar-1.0: Assessing ai's potential to assist research,' arXiv preprint arXiv:2410.22394 , 2024. - · arXiv
  87. [88][88] J. DeYoung, I. Beltagy et al. , 'Ms2: Multi-document summarization of medical studies,' arXiv preprint arXiv:2104.06486 , 2021. - · arXiv
  88. [89][89] J. M. Laurent, J. D. Janizek et al. , 'Lab-bench: Measuring capabilities of language models for biology research,' arXiv preprint arXiv:2407.10362 , 2024. - · arXiv
  89. [90][90] H. Kang and C. Xiong, 'Researcharena: Benchmarking llms' ability to collect and organize information as research agents,' arXiv preprint arXiv:2406.10291 , 2024. - · arXiv
  90. [91][91] C. Si, D. Yang, and T. Hashimoto, 'Can llms generate novel research ideas? a large-scale human study with 100+ nlp researchers,' arXiv preprint arXiv:2409.04109 , 2024. - · arXiv
  91. [92][92] J. Lála, O. O'Donoghue et al. , 'Paperqa: Retrievalaugmented generative agent for scientific research,' arXiv preprint arXiv:2312.07559 , 2023. - · arXiv
  92. [93][93] R. Wang, P. Jansen et al. , 'Scienceworld: Is your agent smarter than a 5th grader?, 2022,' URL https://arxiv. org/abs/2203.07540 , 2022. -
  93. [94][94] P. Jansen, M.-A. Côté et al. , 'Discoveryworld: A virtual environment for developing and evaluating automated scientific discovery agents, 2024,' URL https://arxiv. org/abs/2406.06769 . -
  94. [95][95] Z. Chen, S. Chen et al. , 'Scienceagentbench: Toward rigorous assessment of language agents for data-driven scientific discovery,' arXiv preprint arXiv:2410.05080 , 2024. - · arXiv
  95. [96][96] D. Nathani, L. Madaan et al. , 'Mlgym: A new framework - and benchmark for advancing ai research agents,' arXiv preprint arXiv:2502.14499 , 2025. - · arXiv
  96. [97][97] Q. Huang, J. Vora, P. Liang, and J. Leskovec, 'Mlagentbench: Evaluating language agents on machine learning experimentation, 2024,' URL https://arxiv. org/abs/2310 , vol. 3302. -
  97. [98][98] L. Jing, Z. Huang et al. , 'Dsbench: How far are data science agents to becoming data science experts?' arXiv preprint arXiv:2409.07703 , 2024. - · arXiv
  98. [99][99] Y. Zhang, Q. Jiang et al. , 'Benchmarking data science agents,' arXiv preprint arXiv:2402.17168 , 2024. - · arXiv
  99. [100][100] Y. Huang, J. Luo et al. , 'Da-code: Agent data science code generation benchmark for large language models,' arXiv preprint arXiv:2410.07331 , 2024. - · arXiv
  100. [101][101] R. Cao, F. Lei et al. , 'Spider2-v: How far are multimodal agents from automating data science and engineering workflows?' Advances in Neural Information Processing Systems , vol. 37, pp. 107 703-107 744, 2024. -
  101. [102][102] D. Castillo-Bolado, J. Davidson, F. Gray, and M. Rosa, 'Beyond prompts: Dynamic conversational benchmarking of large language models,' arXiv preprint arXiv:2409.20222 , 2024. - · arXiv
  102. [103][103] D. Paglieri, B. Cupiał et al. , 'Balrog: Benchmarking agentic llm and vlm reasoning on games,' arXiv preprint arXiv:2411.13543 , 2024. - · arXiv
  103. [104][104] Y. Wu, X. Tang, T. M. Mitchell, and Y. Li, 'Smartplay: A benchmark for llms as intelligent agents,' arXiv preprint arXiv:2310.01557 , 2023. - · arXiv
  104. [105][105] X. Wang, B. Zhuang, and Q. Wu, 'Are large vision language models good game players?' arXiv preprint arXiv:2503.02358 , 2025. - · arXiv
  105. [106][106] Y. Ren, K. Tertikas et al. , 'Vgrp-bench: Visual grid reasoning puzzle benchmark for large vision-language models,' arXiv preprint arXiv:2503.23064 , 2025. - · arXiv
  106. [107][107] H. Zhang, H. Guo et al. , 'Ing-vp: Mllms cannot play easy vision-based games yet,' arXiv preprint arXiv:2410.06555 , 2024. - · arXiv
  107. [108][108] W. Tang, Y. Zhou et al. , 'Dsgbench: A diverse strategic game benchmark for evaluating llm-based agents in complex decision-making environments,' arXiv preprint arXiv:2503.06047 , 2025. - · arXiv
  108. [109][109] A. Costarelli, M. Allen et al. , 'Gamebench: Evaluating strategic reasoning abilities of llm agents,' arXiv preprint arXiv:2406.06613 , 2024. - · arXiv
  109. [110][110] J.-t. Huang, E. J. Li et al. , 'Competing large language models in multi-agent gaming environments,' in The Thirteenth International Conference on Learning Representations , 2025. -
  110. [111][111] J. Duan, R. Zhang et al. , 'Gtbench: Uncovering the strategic reasoning limitations of llms via game-theoretic evaluations,' arXiv preprint arXiv:2402.12348 , 2024. - · arXiv
  111. [112][112] L. Hu, Q. Li et al. , 'Gamearena: Evaluating llm reasoning through live computer games,' arXiv preprint arXiv:2412.06394 , 2024. - · arXiv
  112. [113][113] K. Valmeekam, M. Marquez et al. , 'Planbench: An extensible benchmark for evaluating large language models on planning and reasoning about change,' Advances in Neural Information Processing Systems , vol. 36, pp. 38 975-38 987, 2023. -
  113. [114][114] K. Valmeekam, S. Sreedharan et al. , 'On the planning abilities of large language models (a critical investigation with a proposed benchmark),' arXiv preprint arXiv:2302.06706 , 2023. - · arXiv
  114. [115][115] K. Stein, D. Fišer et al. , 'Autoplanbench: Automatically generating benchmarks for llm planners from pddl,' arXiv preprint arXiv:2311.09830 , 2023. - · arXiv
  115. [116][116] H. Kokel, M. Katz et al. , 'Acpbench: Reasoning about action, change, and planning,' in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 39, no. 25, 2025, pp. 26 559-26 568. -
  116. [117][117] S. Qiao, R. Fang et al. , 'Benchmarking agentic workflow generation,' arXiv preprint arXiv:2410.07869 , 2024. - · arXiv
  117. [118][118] R. Xiao, W. Ma et al. , 'Flowbench: Revisiting and benchmarking workflow-guided planning for llm-based agents,' arXiv preprint arXiv:2406.14884 , 2024. - · arXiv
  118. [119][119] L. Geng and E. Y. Chang, 'Realm-bench: A real-world planning benchmark for llms and multi-agent systems,' arXiv preprint arXiv:2502.18836 , 2025. - · arXiv
  119. [120][120] L. Zhang, Y. Wang, H. Gu et al. , 'Et-plan-bench: Embodied task-level planning benchmark towards spatialtemporal cognition with foundation models,' arXiv preprint arXiv:2410.14682 , 2024. - · arXiv
  120. [121][121] C.-A. Cheng, A. Kolobov et al. , 'Llf-bench: Benchmark for interactive learning from language feedback,' 2023. [Online]. Available: https://arxiv.org/abs/2312.06853 - · arXiv
  121. [122][122] J. You, M. Liu et al. , 'LLM-evolve: Evaluation for LLM's evolving capability on benchmarks,' in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , Y. Al-Onaizan, M. Bansal, and Y.-N. Chen, Eds. Miami, Florida, USA: Association for Computational Linguistics, Nov. 2024, pp. 16937-16942. [Online]. Available: https://aclanthology.org/2024.emnlp-main.940/ -
  122. [123][123] L. Li, Y. Wang et al. , 'Reflection-bench: probing ai intelligence with reflection,' 2024. [Online]. Available: https://arxiv.org/abs/2410.16270 - · arXiv
  123. [124][124] J. Pan, R. Shar et al. , 'When benchmarks talk: Reevaluating code llms with interactive feedback,' 2025. [Online]. Available: https://arxiv.org/abs/2502.18413 - · arXiv
  124. [125][125] Q. Tang et al. , 'Toolalpaca: Generalized tool learning for language models with 3000 simulated cases,' arXiv , 2023. [Online]. Available: https://arxiv.org/abs/2306. 05301 -
  125. [126][126] Y. Li et al. , 'Revisiting, benchmarking and exploring api recommendation: How far are we?' arXiv , 2021. [Online]. Available: https://arxiv.org/abs/2112.12653 - · arXiv
  126. [127][127] S. Patil et al. , 'Toolllm: Facilitating large language models to master 16000+ real-world apis,' arXiv , 2023. [Online]. Available: https://arxiv.org/abs/2305.16504 - · arXiv
  127. [129][129] J. Lu et al. , 'Toolsandbox: A stateful, conversational, interactive evaluation benchmark for llm tool use capabilities,' arXiv , 2024. [Online]. Available: https: [//arxiv.org/abs/2408.04682](https://arxiv.org/abs/2408.04682) - · arXiv
  128. [130][130] F. Team, 'Seal-tools: Self-instruct tool learning dataset for agent tuning and evaluation,' arXiv , 2024. [Online]. Available: https://arxiv.org/abs/2405.08355 - · arXiv
  129. [131][131] Y. Li et al. , 'Api-bank: A comprehensive benchmark for tool-augmented llms,' EMNLP , 2023. [Online]. Available: https://aclanthology.org/2023.emnlp-main.187/ -
  130. [133][133] K. Basu et al. , 'A comprehensive corpora for training and benchmarking api llms,' ACL , 2024. [Online]. Available: https://aclanthology.org/2024.acl-long.694/ -
  131. [135][135] N. Team, 'Apigen: Automated pipeline for generating verifiable and diverse function-calling datasets,' NeurIPS , 2024. [Online]. Available: https://arxiv.org/abs/2406. 18518 -
  132. [136][136] Z. Guo et al. , 'Towards stable large-scale benchmarking on tool learning of large language models,' ACL Findings , 2024. [Online]. Available: https://aclanthology. org/2024.findings-acl.664/ -
  133. [137][137] T. Team, 'Exploring multi-step and constrained function calling under long-context scenario,' arXiv , 2025. [Online]. Available: https://arxiv.org/abs/2501.10132 - · arXiv
  134. [138][138] K. Basu et al. , 'A benchmark for evaluating llms on nested sequences of api calls,' OpenReview , 2024. [Online]. Available: https://openreview.net/forum?id= r7staQknbI -
  135. [139][139] T. Team, 'Tooleyes: Fine-grained evaluation for tool learning capabilities of large language models,' COLING , 2025. [Online]. Available: https://aclanthology. org/2025.coling-main.12/ -
  136. [140][140] P. Team, 'Petoolbench: Personalized evaluation benchmark for tool-augmented llms,' arXiv , 2024. [Online]. Available: https://arxiv.org/abs/2407.02912 - · arXiv
  137. [141][141] S. Yao, N. Shinn, P. Razavi, and K. Narasimhan, ' τ -bench: A benchmark for tool-agent-user interaction in real-world domains,' 2024. [Online]. Available: https://arxiv.org/abs/2406.12045 - · arXiv
  138. [142][142] D. Chen, H. Chen, Y. Yang, A. Lin, and Z. Yu, 'Actionbased conversations dataset: A corpus for building more in-depth task-oriented dialogue systems,' 2021. [Online]. Available: https://arxiv.org/abs/2104.00783 - · arXiv
  139. [143][143] P. Budzianowski, T.-H. Wen et al. , 'Multiwoz -a large-scale multi-domain wizard-of-oz dataset for taskoriented dialogue modelling,' 2020. [Online]. Available: https://arxiv.org/abs/1810.00278 - · arXiv
  140. [144][144] S. Arcadinho, D. Aparicio, and M. Almeida, 'Automated test generation to evaluate tool-augmented llms as conversational ai agents,' 2024. [Online]. Available: https://arxiv.org/abs/2409.15934 - · arXiv
  141. [145][145] S. Yao, N. Shinn, P. Razavi, and K. Narasimhan, 'Intellagent: A benchmark for evaluating tool-augmented agents in real-world domains,' 2024. [Online]. Available: https://arxiv.org/abs/2406.12045 - · arXiv
  142. [146][146] W. Wang, D. Zhang et al. , 'Battleagentbench: A benchmark for evaluating cooperation and competition capabilities of language models in multi-agent systems,' arXiv preprint arXiv:2408.15971 , 2024. [Online]. Available: https://arxiv.org/abs/2408.15971 - · arXiv
  143. [147][147] A. Gangrade et al. , 'Evaluating the collaboration and competition of llm agents,' arXiv preprint arXiv:2503.01935 , 2025. [Online]. Available: https: //arxiv.org/abs/2503.01935 - · arXiv
  144. [148][148] R. Wang et al. , 'Collab-overcooked: Benchmarking and evaluating large language models as collaborative agents,' arXiv preprint arXiv:2502.20073 , 2025. [Online]. Available: https://arxiv.org/abs/2502.20073 - · arXiv
  145. [149][149] --, 'Sotopia: Interactive evaluation for social intelligence in language agents,' arXiv preprint arXiv:2310.11667 , 2023. [Online]. Available: https: //arxiv.org/abs/2310.11667 - · arXiv
  146. [150][150] R. Zhao et al. , 'Auto-arena: Automating llm evaluations with agent peer battles and committee discussions,' arXiv preprint arXiv:2405.20267 , 2024. [Online]. Available: https://arxiv.org/abs/2405.20267 - · arXiv
  147. [151][151] M. Alahi et al. , 'Smarteval: Evaluation system for descriptive answers in examinations using iotenabled technologies and artificial intelligence,' Sensors , vol. 23, no. 11, p. 5206, 2023. [Online]. Available: https://doi.org/10.3390/s23115206 - · DOI
  148. [152][152] H. Yu et al. , 'Mindagent: Emergent gaming interaction,' in Findings of the Association for Computational Linguistics: NAACL 2024 , 2024, pp. 200-210. [Online]. Available: https://aclanthology.org/2024.findings-naacl. 200/ -
  149. [153][153] G. Piatti et al. , 'Cooperate or collapse: Emergence of sustainable cooperation in a society of llm agents,' arXiv preprint arXiv:2404.16698 , 2024. [Online]. Available: https://arxiv.org/abs/2404.16698 - · arXiv
  150. [154][154] T. Koˇ cisk` y, J. Schwarz et al. , 'The narrativeqa reading comprehension challenge,' Transactions of the Association for Computational Linguistics , vol. 6, pp. 317-328, 2018. -
  151. [155][155] M. Zhong, D. Yin et al. , 'Qmsum: A new benchmark for query-based multi-domain meeting summarization,' arXiv preprint arXiv:2104.05938 , 2021. - · arXiv
  152. [156][156] R. Y. Pang, A. Parrish et al. , 'Quality: Question answering with long input texts, yes!' arXiv preprint arXiv:2112.08608 , 2021. - · arXiv
  153. [157][157] J. Kim, W. Chay et al. , 'Dialsim: A real-time simulator for evaluating long-term multi-party dialogue understanding of conversational agents,' arXiv preprint arXiv:2406.13144 , 2024. - · arXiv
  154. [158][158] A. Maharana, D.-H. Lee et al. , 'Evaluating very longterm conversational memory of llm agents,' arXiv preprint arXiv:2402.17753 , 2024. - · arXiv
  155. [159][159] D. Wu, H. Wang et al. , 'Longmemeval: Benchmarking chat assistants on long-term interactive memory,' arXiv preprint arXiv:2410.10813 , 2024. - · arXiv
  156. [160][160] A. Huet, Z. B. Houidi, and D. Rossi, 'Episodic memories generation and evaluation benchmark for large language models,' arXiv preprint arXiv:2501.13121 , 2025. - · arXiv
  157. [161][161] Y. Du, H. Wang et al. , 'Perltqa: A personal long-term memory dataset for memory classification, retrieval, and synthesis in question answering,' arXiv preprint arXiv:2402.16288 , 2024. - · arXiv
  158. [162][162] C.-K. Wu, Z. R. Tam et al. , 'Streambench: Towards benchmarking continuous improvement of language agents,' Advances in Neural Information Processing Systems , vol. 37, pp. 107 039-107 063, 2024. -
  159. [163][163] X. Liu, H. Yu et al. , 'Agentbench: Evaluating llms as agents,' 2023. [Online]. Available: https: //arxiv.org/abs/2308.03688 -
  160. [164][164] G. Mialon, C. Fourrier et al. , 'Gaia: a benchmark for general ai assistants,' 2023. [Online]. Available: https://arxiv.org/abs/2311.12983 - · arXiv
  161. [165][165] G. Yin, H. Bai, S. Ma et al. , 'Mmau: A holistic benchmark of agent capabilities across diverse domains,' arXiv preprint arXiv:2407.18961 , 2024. [Online]. Available: https://arxiv.org/pdf/2407.18961 - · arXiv
  162. [169][169] Y. Yang, B. Huang, S. Qi et al. , 'Who's the mvp? a gametheoretic evaluation benchmark for modular attribution in llm agents,' arXiv preprint arXiv:2502.00510 , 2025. [Online]. Available: https://arxiv.org/abs/2502.00510 - · arXiv
  163. [171][171] F. Zhang, B. Chen et al. , 'Repocoder: Repositorylevel code completion through iterative retrieval and generation,' arXiv preprint arXiv:2303.12570 , 2023. - · arXiv
  164. [172][172] J. S. Chan, N. Chowdhury et al. , 'Mle-bench: Evaluating machine learning agents on machine learning engineering,' arXiv preprint arXiv:2410.07095 , 2024. - · arXiv
  165. [173][173] T. Carta, C. Romac et al. , 'Grounding large language models in interactive environments with online reinforcement learning,' in International Conference on Machine Learning . PMLR, 2023, pp. 3676-3713. -
  166. [174][174] D. Hafner, 'Benchmarking the spectrum of agent capabilities,' arXiv preprint arXiv:2109.06780 , 2021. - · arXiv
  167. [175][175] M.-A. Côté, A. Kádár et al. , 'Textworld: A learning environment for text-based games,' in Computer Games: 7th Workshop, CGW 2018, Held in Conjunction with the 27th International Conference on Artificial Intelligence, IJCAI 2018, Stockholm, Sweden, July 13, 2018, Revised Selected Papers 7 . Springer, 2019, pp. 41-75. -
  168. [176][176] R. A. Bradley and M. E. Terry, 'Rank analysis of incomplete block designs: I. the method of paired comparisons,' Biometrika , vol. 39, no. 3-4, pp. 324345, 1952. -
  169. [177][177] J. Wei, X. Wang et al. , 'Chain of thought prompting 18. elicits reasoning in large language models,' in Advances in Neural Information Processing Systems , vol. 35, 2022, pp. 24 824-24 837. [Online]. Available: https://arxiv.org/abs/2201.11903 - · arXiv
  170. [178][178] X. Yao, Z. Ye et al. , 'Tree of thoughts: Deliberate problem solving with large language models,' in Advances in Neural Information Processing Systems , vol. 36, 2023. [Online]. Available: https://arxiv.org/abs/ 2305.10601 -
  171. [179][179] W. Ling, D. Yogatama et al. , 'Program induction by rationale generation: Learning to solve and explain algebraic word problems,' arXiv preprint arXiv:1705.04146 , 2017. - · arXiv
  172. [180][180] K. Cobbe, V. Kosaraju et al. , 'Training verifiers to solve math word problems,' arXiv preprint arXiv:2110.14168 , 2021. - · arXiv
  173. [181][181] D. Hendrycks, C. Burns et al. , 'Measuring mathematical problem solving with the math dataset,' arXiv preprint arXiv:2103.03874 , 2021. - · arXiv
  174. [182][182] Y. Zhang, J. Yang et al. , 'Cumulative reasoning with large language models,' arXiv preprint arXiv:2308.04371 , 2023. - · arXiv
  175. [183][183] A. Patel, S. Bhattamishra, and N. Goyal, 'Are nlp models really able to solve simple math word problems?' arXiv preprint arXiv:2103.07191 , 2021. - · arXiv
  176. [184][184] Z. Yang, P. Qi et al. , 'Hotpotqa: A dataset for diverse, explainable multi-hop question answering,' arXiv preprint arXiv:1809.09600 , 2018. - · arXiv
  177. [185][185] M. Geva, D. Khashabi et al. , 'Did aristotle use a laptop? a question answering benchmark with implicit reasoning strategies,' Transactions of the Association for Computational Linguistics , vol. 9, pp. 346-361, 2021. -
  178. [186][186] S. Han, H. Schoelkopf et al. , 'Folio: Natural language reasoning with first-order logic,' 2024. [Online]. Available: https://arxiv.org/abs/2209.00840 - · arXiv
  179. [187][187] S. Han, A. Yu, R. Shen et al. , 'P-folio: Evaluating and improving logical reasoning with abundant human-written reasoning chains,' arXiv preprint arXiv:2410.09207 , 2024. - · arXiv
  180. [188][188] B. Bohnet, A. Nova et al. , 'Exploring and benchmarking the planning capabilities of large language models,' arXiv preprint arXiv:2406.13094 , 2024. - · arXiv
  181. [189][189] H. S. Zheng, S. Mishra et al. , 'Natural plan: Benchmarking llms on natural language planning,' arXiv preprint arXiv:2406.04520 , 2024. - · arXiv
  182. [190][190] X. Wang, Z. Wang et al. , 'Mint: Evaluating llms in multiturn interaction with tools and language feedback,' 2024. [Online]. Available: https://arxiv.org/abs/2309.10691 - · arXiv
  183. [191][191] M. Renze and E. Guven, 'The benefits of a concise chain of thought on problem-solving in large language models,' in 2024 2nd International Conference on Foundation and Large Language Models (FLLM) . IEEE, Nov. 2024, p. 476-483. [Online]. Available: http://dx.doi.org/10.1109/FLLM63129.2024.10852493 - · DOI
  184. [192][192] F. Liu, N. AlDahoul et al. , 'Self-reflection makes large language models safer, less biased, and ideologically neutral,' 2025. [Online]. Available: https://arxiv.org/abs/ 2406.10400 -
  185. [193][193] J. Huang, X. Chen et al. , 'Large language models cannot self-correct reasoning yet,' 2024. [Online]. Available: https://arxiv.org/abs/2310.01798 - · arXiv
  186. [194][194] W. Zhang, Y. Shen et al. , 'Self-contrast: Better reflection through inconsistent solving perspectives,' 2024. [Online]. Available: https://arxiv.org/abs/2401.02009 - · arXiv
  187. [195][195] D. Hendrycks, S. Basart et al. , 'Measuring coding challenge competence with apps,' 2021. [Online]. Available: https://arxiv.org/abs/2105.09938 - · arXiv
  188. [196][196] N. Jain, K. Han et al. , 'Livecodebench: Holistic and contamination free evaluation of large language models for code,' 2024. [Online]. Available: https: //arxiv.org/abs/2403.07974 -
  189. [198][198] M. Zhuge, C. Zhao, D. Ashley et al. , 'Agentas-a-judge: Evaluate agents with agents,' arXiv preprint arXiv:2410.10934 , 2024. [Online]. Available: https://arxiv.org/abs/2410.10934 - · arXiv
  190. [200][200] W. Chen, Y. Su et al. , 'Agentverse: Facilitating multiagent collaboration and exploring emergent behaviors,' 2023. [Online]. Available: https://arxiv.org/abs/2308. 10848 -
  191. [201][201] C. Chen, X. Hao et al. , 'Acebench: Who wins the match point in tool usage?' 2025. [Online]. Available: https://arxiv.org/abs/2501.12851 · arXiv

Cited by

Sorted by citations

Authors
Zhu, J., Zhu, M., Rui, R., Shan, R., Zheng, C., Chen, B., Xi, Y., Lin, J., Liu, W., Tang, R., Yu, Y., & Zhang, W.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2506.11102
arXiv
2506.11102
OpenAlex
W4415068065
Cited by
0
References
0
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
large language models, AI agents, LLM chatbots, AI agent evaluation, evaluation benchmark, benchmark selection, dynamic feedback, multisensory perception, complex environments, evaluation metrics, evolutionary perspective

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review