Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index; 52 of the 80 sources its claims cite were checked for support.

Evaluation and Benchmarking of LLM Agents: A Survey

Open access
Mohammadi, Mahmoud, Li, Yipeng, Lo, Jane, Yip, Wendy · 2025 · Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2

Published version of a preprint

Abstract

The rise of LLM-based agents has opened new frontiers in AI applications, yet evaluating these agents remains a complex and underdeveloped area.This survey provides an in-depth overview of the emerging field of LLM agent evaluation, introducing a twodimensional taxonomy that organizes existing work along (1) evaluation objectives-what to evaluate, such as agent behavior, capabilities, reliability, and safety-and (2) evaluation process-how to evaluate, including interaction modes, datasets and benchmarks, metric computation methods, and tooling.In addition to taxonomy, we highlight enterprise-specific challenges, such as role-based access to data, the need for reliability guarantees, dynamic and longhorizon interactions, and compliance, which are often overlooked in current research.We also identify the future research directions, including holistic, more realistic, and scalable evaluation.This work aims to bring clarity to the fragmented landscape of agent evaluation and provide a framework for systematic assessment, enabling researchers and practitioners to evaluate LLM agents for real-world deployment.

Overview

CoChat Summary

TL;DR

This survey proposes a two-dimensional taxonomy for LLM agent evaluation along evaluation objectives (what to evaluate) and evaluation process (how to evaluate), and highlights enterprise-specific challenges and future directions. It aims to organize fragmented work and guide systematic assessment for real-world deployment.

Key findings

  • The taxonomy separates evaluation objectives—agent behavior, capabilities, reliability, and safety/alignment—from evaluation process—interaction mode, evaluation data, metrics computation, tooling, and evaluation contexts.
  • Enterprise-specific challenges include role-based access control, reliability guarantees, dynamic and long-horizon interactions, and adherence to domain-specific policies and compliance requirements such as GDPR or HIPAA.
  • Reported metrics and benchmarks include Success Rate, pass@k, pass^k, Invocation Accuracy, Tool Selection Accuracy, MRR, NDCG, parameter name F1, Factual Recall Accuracy, and Consistency Score; memory evaluations are described with dialogues of 40+ turns and 600+ turns.
  • Future directions are more realistic evaluation settings, holistic evaluation frameworks, automated and scalable evaluation techniques, and time- and cost-bounded evaluation protocols.

Methods

  • Survey/position paper that proposes a two-dimensional taxonomy and reviews prior work on LLM agent evaluation; no primary experiments are reported.
  • Organizes existing literature by evaluation objectives and evaluation process, then discusses enterprise challenges and open research directions.
  • Draws on cited benchmarks, datasets, metrics, and tooling, including SWE-bench, WebArena, HELM, τ-bench, LangSmith, Arize AI, and OpenAI Evals.

Limitations

  • The paper states that existing surveys focus narrowly on LLM evaluation or specific agent capabilities without a holistic perspective, and that enterprise requirements are rarely addressed in existing literature.
  • The paper states that current benchmarks often focus on short episodes or single interactions, and that measuring reliability requires repeated trials, introducing significant evaluation overhead.
  • Evident from the text: no systematic review protocol, search strategy, or inclusion criteria are described; the taxonomy is conceptual and not empirically validated; the survey reports no primary data or quantitative results of its own.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3711896.3736570

Cites

136 of 136 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

35 Valid · 3 Not valid · 13 Not checked · 17 Own results and interpretations

26 more claims · 17 with their cited sources checked

Create a free account to see all 68 claims and to verify the 12 references still open.

See all claims — free account
  • It may state two separate claims as one. 16
  • Probably not a substantial claim. 30

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 61 references

Research works printed but not linked: 7

  1. Zaijing Li, Yuquan Xie, Rui Shao, Gongwei Chen, Dongmei Jiang, and Liqiang Nie. 2024d. Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks. In Advances in Neural Information Processing Systems, A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang(Eds.), Vol. 37. Curran Associates, Inc., 49881-49913.
  2. Xiao Liu Hao Yu Hanchen Zhang Yifan Xu Xuanyu Lei Hanyu Lai Yu Gu Hangliang Ding Kaiwen Men Kejuan Yang Shudan Zhang Xiang Deng Aohan Zeng Zhengxiao Du Chenhui Zhang Sheng Shen Tianjun Zhang Yu Su Huan Sun Minlie Huang Yuxiao Dong and Jie Tang. 2023c. AgentBench: Evaluating LLMs as Agents. arXiv:2308.03688 [cs.AI] https://arxiv.org/abs/2308.03688 · arXiv
  3. Wenjie Ruan, Wei Huang, Xiaowei Huang, Gaojie Jin, Yi Dong, Changshun Wu, Saddek Bensalem, Ronghui Mu, Yi Qi, Xingyu Zhao, et al., 2024. ToolEmu. In Proceedings of t.
  4. Tianlin Shi, Andrej Karpathy, Linxi Fan, Jonathan Hernandez, and Percy Liang. 2017. World of bits: An open-domain platform for web-based agents. In International Conference on Machine Learning. PMLR, 3135-3144.
  5. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023a. ReAct: Synergizing Reasoning and Acting in Language Models. In Proceedings of the International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2210.03629v3 · arXiv
  6. Yangyang Yu, Zhiyuan Yao, Haohang Li, Zhiyang Deng, Yuechen Jiang, Yupeng Cao, Zhi Chen, Jordan Suchow, Zhenyu Cui, Rong Liu, Zhaozhuo Xu, Denghui Zhang, Koduvayur (Suba) Subbalakshmi, GUOJUN XIONG, Yueru He, Jimin Huang, Dong Li, and Qianqian Xie. 2024b. FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making. In Advances in Neural Information Processing Systems, A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang(Eds.), Vol. 37. Curran Associates, Inc., 137010-137045.
  7. Danyang Zhang, Lu Chen, and Kai Yu. 2023a. Mobile-env: A universal platform for training and evaluation of mobile interaction. CoRR(2023).

Cited by

See all 74

Metadata

Authors
Mohammadi, M., Li, Y., Lo, J., & Yip, W.
Affiliations
  • SAP Labs, Bellevue, Washington, USA
  • Systems, Applications & Products in Data Processing (United States) (US)
Venue
Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2
Publisher
ACM
Published
2025-08-03
Pages
6129-6139
OpenAlex
W4412877164
Cited by
74
References
61
Citations by year
2026: 68 · 2025: 5
FWCI
68.73
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
  • ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
LLM agents, agent evaluation, benchmarking, evaluation taxonomy, agent behavior, agent reliability, agent safety, evaluation dataset, evaluation metrics, enterprise AI deployment, compliance, long-horizon interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluation and Benchmarking of LLM Agents: A Survey. https://app.cochat.ai/papers/10.1145/3711896.3736570
The paper
Mohammadi, M., Li, Y., Lo, J., & Yip, W. (2025). Evaluation and Benchmarking of LLM Agents: A Survey. Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2. https://doi.org/10.1145/3711896.3736570

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.