From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Current benchmarks [57] and datasets evaluate RAG systems across retrieval, reasoning, and generation.”
From Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG (2025) · cites this paper as [57]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Gu, J., Jiang, X., Shi, Z., Tan, H., Zhai, X., Xu, C., Li, W., Shen, Y., Ma, S., Liu, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.15594 · Cited by 1,781
Large Language Model based Multi-Agents: A Survey of Progress and Challenges
Guo, T., Chen, X., Wang, Y., Chang, R., Pei, S., Chawla, N. V., Wiest, O., & Zhang, X. (2024) · arXiv · doi:10.48550/arxiv.2402.01680 · Cited by 1,713
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087 · cited 1×
“LLM-based agents are emerging as a promising frontier in AI, combining reasoning and action to interact with complex digital environments [36], [37].”
A review of large language models and autonomous agents in chemistry
Ramos, M. C., Collison, C. J., & White, A. D. (2025) · Chemical Science · doi:10.1039/d4sc03921a · Cited by 274
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2024) · arXiv · doi:10.48550/arxiv.2402.19473 · Cited by 240 · cited 1×
“When necessary, the query is decomposed into smaller, manageable sub-questions that are individually routed and processed through retrieval utilities [149].”
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Dua, D., Wang, Y., Dasigi, P., Stanovsky, G., Singh, S., & Gardner, M. (2019) · arXiv · doi:10.48550/arxiv.1903.00161 · Cited by 238
Accelerating scientific discovery with Co-Scientist
Gottweis, J., Weng, W.-H., Daryin, A., Tu, T., Sirkovic, P., Myaskovsky, A., Glowaty, G., Weissenberger, F., Orlandi, A., Popovici, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.18864 · Cited by 158 · cited 1×
“…its superior capability in managing evolving task dependencies and real-time data adjustments. e) Automating Scientific Discovery: Google [175] introduced the AI co-scientist, a multi-agent system built on Google DeepMind Gemini 2.0, designed to automate scientific discovery by…”
InfluentialA Survey on the Memory Mechanism of Large Language Model based Agents
Zhang, Z., Bo, X., Ma, C., Li, R., Chen, X., Dai, Q., Zhu, J., Dong, Z., & Wen, J.-R. (2024) · arXiv · doi:10.48550/arxiv.2404.13501 · Cited by 149
Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents
Backlund, A., & Petersson, L. (2025) · arXiv · doi:10.48550/arxiv.2502.15840 · Cited by 101
MDAgents: an adaptive collaboration of LLMs for medical decision-making
Kim, Y., Park, C., Jeong, H., Chan, Y., Xu, X., McDuff, D., Lee, H., Ghassemi, M., Breazeal, C., & Park, H. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2522 · Cited by 81 · cited 1×
“Parallel to these developments in research automation, large language model-based agents have also begun to transform the medical field [23].”
ChatDev: Communicative Agents for Software Development
Qian, C., Liu, W., Liu, H., Chen, N., Dang, Y., Li, J., Yang, C., Chen, W., Su, Y., Cong, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.07924 · Cited by 81
Phan, L., Gatti, A., Han, Z., Li, N., Hu, J., Zhang, H., Zhang, C. B. C., Shaaban, M., Ling, J., Shi, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.14249 · Cited by 65
Phan, L. (2025) · doi:10.21203/rs.3.rs-6615297/v1 · Cited by 65
Building Cooperative Embodied Agents Modularly with Large Language Models
Zhang, H., Du, W., Shan, J., Zhou, Q., Du, Y., Tenenbaum, J. B., Shu, T., & Gan, C. (2023) · arXiv · doi:10.48550/arxiv.2307.02485 · Cited by 52 · cited 1×
“Finally, Section VI concludes the paper.”
From Prompt Injections to Protocol Exploits: Threats in LLM-Powered AI Agents Workflows
Ferrag, M. A., Tihanyi, N., Hamouda, D., Maglaras, L., Lakas, A., & Debbah, M. (2026) · ICT Express · doi:10.1016/j.icte.2025.12.001 · Cited by 46
Self-citationChallenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
Suzgun, M., Scales, N., Schärli, N., Gehrmann, S., Tay, Y., Chung, H. W., Chowdhery, A., Le, Q. V., Chi, E. H., Zhou, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.09261 · Cited by 44 · cited 1×
“While the BIG-Bench dataset [129] and its more complex variant, BIG-Bench Hard (BBH) [130], have provided comprehensive assessments of general reasoning abilities, recent advances in LLMs have led to saturation, with state-of-the-art models achieving near-perfect scores on many BBH tasks.”
Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions
Hou, X., Zhao, Y., Wang, S., & Wang, H. (2025) · arXiv · doi:10.48550/arxiv.2503.23278 · Cited by 43
KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents
Zhu, Y., Qiao, S., Ou, Y., Deng, S., Lyu, S., Shen, Y., Liang, L., Gu, J., Chen, H., & Zhang, N. (2024) · arXiv · doi:10.48550/arxiv.2403.03101 · Cited by 38
OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
Ouyang, L., Qu, Y., Zhou, H., Zhu, J., Zhang, R., Lin, Q., Wang, B., Zhao, Z., Jiang, M., Zhao, X., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.07626 · Cited by 38
Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG
Singh, A., Ehtesham, A., Kumar, S., Khoei, T. T., & Vasilakos, A. V. (2025) · arXiv · doi:10.48550/arxiv.2501.09136 · Cited by 36
Phan, L., Gatti, A., Han, Z., & Li, N. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i1.13973 · Cited by 36
(2025) · doi:10.1007/s11432-025-4665-8 · Cited by 34
Yang, R., Chen, H., Zhang, J., Zhao, M., Qian, C., Wang, K., Wang, Q., Koripella, T. V., Movahedi, M., Li, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.09560 · Cited by 29
AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments
Schmidgall, S., Ziaei, R., Harris, C., Reis, E., Jopling, J., & Moor, M. (2024) · arXiv · doi:10.48550/arxiv.2405.07960 · Cited by 24
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models
Zhou, A., Yan, K., Shlapentokh-Rothman, M., Wang, H., & Wang, Y.-X. (2023) · arXiv · doi:10.48550/arxiv.2310.04406 · Cited by 18 · cited 1×
“…various approaches have been explored to enhance LLM-based agents, from combining reasoning and acting using techniques like React [38] and Monte Carlo Tree Search [39] to synthesizing high-quality data with methods like Learn-by-Interact [40], which sidestep assumptions such as state reversals.”
MLGym: A New Framework and Benchmark for Advancing AI Research Agents
Nathani, D., Madaan, L., Roberts, N., Bashlykov, N., Menon, A., Moens, V., Budhiraja, A., Magka, D., Vorotilov, V., Chaurasia, G., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.14499 · Cited by 15 · cited 4×
“…[119] 2025 Yes STEM theorem animation videos Medium High Yes RefuteBench 2.0 [120] 2025 No Multi-turn LLM feedback evaluation High High Yes MLGym [121] 2025 Yes ML agents automate research High High Yes DataSciBench [122] 2025 No LLM Data Science Benchmark High High Yes EmbodiedBench [123] 2025…”
InfluentialKazemi, M., Fatemi, B., Bansal, H., Palowitch, J., Anastasiou, C., Mehta, S. V., Jain, L. K., Aglietti, V., Jindal, D., Chen, P., et al. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1285 · Cited by 15
The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Use
Hu, S., Ouyang, M., Gao, D., & Shou, M. Z. (2024) · arXiv · doi:10.48550/arxiv.2411.10323 · Cited by 13
AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents
Andriushchenko, M., Souly, A., Dziemian, M., Duenas, D., Lin, M., Wang, J., Hendrycks, D., Zou, A., Kolter, Z., Fredrikson, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.09024 · Cited by 11
Agent-SafetyBench: Evaluating the Safety of LLM Agents
Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., & Huang, M. (2024) · arXiv · doi:10.48550/arxiv.2412.14470 · Cited by 6 · cited 1×
“This decade-spanning evolution is complemented by additional evaluations focusing on safety (Agent-SafetyBench [98]), discovery (DiscoveryBench [99]), code generation (BLADE [100], Dyn-VQA [9], and Agent-as-a-Judge [71]), judicial reasoning (JudgeBench [72]), and clinical decision making (MedChain…”
Agentic AI Systems Applied to tasks in Financial Services: Modeling and model risk management crews
Okpala, I., Golgoon, A., & Kannan, A. R. (2025) · arXiv · doi:10.48550/arxiv.2502.05439 · Cited by 6
Xiao, B., Yin, Z., & Shan, Z. (2023) · arXiv · doi:10.48550/arxiv.2311.06957 · Cited by 4 · cited 1×
“Finally, Section VI concludes the paper.”
JudgeBench: A Benchmark for Evaluating LLM-based Judges
Tan, S., Zhuang, S., Montgomery, K., Tang, W. Y., Cuadron, A., Wang, C., Popa, R. A., & Stoica, I. (2024) · arXiv · doi:10.48550/arxiv.2410.12784 · Cited by 4
Kang, H., & Xiong, C. (2024) · arXiv · doi:10.48550/arxiv.2406.10291 · Cited by 3
Understanding and Optimizing Agentic Workflows via Shapley value
Yang, Y., Huang, B., Qi, S., Feng, C., Hu, H., Zhu, Y., Hu, J., Zhao, H., He, Z., Liu, X., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.00510 · Cited by 2
BEARCUBS: A benchmark for computer-using web agents
Song, Y., Thai, K., Pham, C. M., Chang, Y., Nadaf, M., & Iyyer, M. (2025) · arXiv · doi:10.48550/arxiv.2503.07919
Research works printed but not linked: 204
- Jaech, 2024, OpenAI o1 system card, arXiv:2412.16720 · arXiv
- Xu, 2025, Qwen2.5-omni technical report
- Guo, 2025, DeepSeek-r1: Incentivizing reasoning capability in LLMs via reinforcement learning, arXiv:2501.12948 · arXiv
- Grattafiori, 2024, The llama 3 herd of models, arXiv:2407.21783 · arXiv
- Huang, 2024, Understanding the planning of LLM agents: A survey, arXiv:2402.02716 · arXiv
- 10.1145/3733799.3762964 · DOI
- 10.18653/v1/2025.emnlp-main.464 · DOI
- Li, 2024, Benchmarking multimodal retrieval augmented generation with dynamic VQA dataset and self-adaptive planning agent, arXiv:2411.02937 · arXiv
- Qing Yu, 2025, RAG-KG-IL: A multi-agent hybrid framework for reducing hallucinations and enhancing LLM reasoning through RAG and incremental knowledge graph learning integration, arXiv:2503.13514 · arXiv
- Ateia, 2024, BioRAGent: A retrieval-augmented generation system for showcasing generative query expansion and domain-specific search for scientific Q&A, arXiv:2412.12358 · arXiv
- 10.1109/GCCE65946.2025.11275306 · DOI
- Xiong, 2025, RAG-gym: Optimizing reasoning and search agents with process supervision, arXiv:2502.13957 · arXiv
- 10.1016/j.icte.2025.09.003 · DOI
- Achiam, 2023, GPT-4 technical report
- Team, 2023, Gemini: A family of highly capable multimodal models, arXiv:2312.11805 · arXiv
- 10.18653/v1/2025.findings-emnlp.320 · DOI · Paper page
- 10.18653/v1/2024.emnlp-main.840 · DOI · Paper page
- 10.18653/v1/2025.findings-emnlp.303 · DOI
- 10.18653/v1/2025.naacl-long.342 · DOI · Paper page
- Gridach, 2025, Agentic AI for scientific discovery: A survey of progress, challenges, and future directions, arXiv:2503.08979 · arXiv
- 10.18653/v1/2024.findings-acl.557 · DOI
- Li, 2024, Agent hospital: A simulacrum of hospital with evolvable medical agents, arXiv:2405.02957 · arXiv
- Durante, 2024, Agent AI: Surveying the horizons of multimodal interaction, arXiv:2401.03568 · arXiv
- 10.18653/v1/2025.findings-naacl.205 · DOI
- 10.18653/v1/2024.acl-long.371 · DOI
- Mukherjee, 2024, Polaris: A safety-focused LLM constellation architecture for healthcare, arXiv:2403.13313 · arXiv
- 10.18653/v1/2024.findings-emnlp.79 · DOI · Paper page
- Yan, 2025, The application of large language models in primary healthcare services and the challenges, Chin. Gen. Pract., 28, 1
- Yu, 2024, AIPatient: Simulating patients with EHRS and LLM powered agentic workflow, arXiv:2409.18924 · arXiv
- 10.18653/v1/2025.findings-acl.539 · DOI · Paper page
- Wang, Executable code actions elicit better LLM agents, 50208
- 10.52202/075280-0377 · doi:10.52202/075280-0377 · Paper page
- Yao, REACT: Synergizing reasoning and acting in language models
- Su, 2025, Learn-by-interact: A data-centric framework for self-adaptive agents in realistic environments, arXiv:2501.10893 · arXiv
- Hu, 2024, AgentGen: Enhancing planning abilities for large language model based agent via environment and task generation, arXiv:2408.00764 · arXiv
- 10.18653/v1/2024.findings-acl.181 · DOI · Paper page
- Gulcehre, 2023, Reinforced self-training (ReST) for language modeling, arXiv:2308.08998 · arXiv
- Aksitov, 2023, ReST meets ReAct: Self-improvement for multi-step reasoning LLM agent, arXiv:2312.10003 · arXiv
- Goldie, 2025, Synthetic data generation & multi-step RL for reasoning & tool use, arXiv:2504.04736 · arXiv
- Hong, 2023, MetaGPT: Meta programming for multi-agent collaborative framework, arXiv:2308.00352 · arXiv
- 10.1109/ICRA57147.2024.10610855 · DOI · Paper page
- 10.1145/3586183.3606763 · DOI · Paper page
- Wang, 2023, Avalon’s game of thoughts: Battle against deception through recursive contemplation, arXiv:2310.01320 · arXiv
- Wang, 2024, Agents in software engineering: Survey, landscape, and vision, arXiv:2409.09030 · arXiv
- Jin, 2024, From LLMs to LLM-based agents for software engineering: A survey of current, challenges and future, arXiv:2408.02479 · arXiv
- Yehudai, 2025, Survey on evaluation of LLM-based agents, arXiv:2503.16416 · arXiv
- Yan, 2025, Beyond self-talk: A communication-centric survey of LLM-based multi-agent systems, arXiv:2502.14321 · arXiv
- Feng, 2024, A survey on large language model-based social agents in game-theoretic scenarios, arXiv:2412.03920 · arXiv
- Zhang, 2024, Large language model-brained GUI agents: A survey, arXiv:2411.18279 · arXiv
- Li, 2024, Personal LLM agents: Insights and survey about the capability, efficiency and security, arXiv:2401.05459 · arXiv
- Wang, 2025, EnigmaEval: A benchmark of long multimodal reasoning challenges, arXiv:2502.08859 · arXiv
- Hendrycks, 2020, Measuring massive multitask language understanding, arXiv:2009.03300 · arXiv
- Zhong, 2025, ComplexFuncBench: Exploring multi-step and constrained function calling under long-context scenario, arXiv:2501.10132 · arXiv
- 2023, Facts & Grounding: A New Benchmark for Evaluating the Factuality of Large Language Models
- Zheng, 2024, ProcessBench: Identifying process errors in mathematical reasoning, arXiv:2412.06559 · arXiv
- Zhuge, 2024, Agent-as-a-judge: Evaluate agents with agents, arXiv:2410.10934 · arXiv
- 2024, Introducing Simpleqa
- 2024, Fine Tasks
- 10.18653/v1/2025.naacl-long.243 · DOI
- 2025, Dabstep
- Mao, 2024, BFCL V2 Live
- Miserendino, 2025, SWE-lancer: Can frontier LLMs earn $1 million from real world freelance software engineering?, arXiv:2502.12115 · arXiv
- Yang, 2024, CRAG—Comprehensive RAG benchmark, arXiv:2406.04744 · arXiv
- Kouremetis, 2025, OCCULT: Evaluating large language models for offensive cyber operation capabilities, arXiv:2502.15797 · arXiv
- 10.1109/BigData62323.2024.10825051 · DOI
- 10.1109/CSR61664.2024.10679494 · DOI
- 10.18653/v1/2025.acl-long.421 · DOI · Paper page
- Mialon, GAIA: A benchmark for general AI assistants, 9025
- Dubniczky, 2025, CASTLE: Benchmarking dataset for static code analyzers and LLMs towards CWE detection, arXiv:2503.09433 · arXiv
- Yao, SPIN-bench: How well do LLMs plan strategically and reason socially?, arXiv:2503.12349 · arXiv
- Yao, 2024, A benchmark for tool-agent-user interaction in real-world domains, arXiv:2406.12045 · arXiv
- Hendrycks, 2021, Measuring mathematical problem solving with the math dataset, arXiv:2103.03874 · arXiv
- Chen, 2021, Evaluating large language models trained on code, arXiv:2107.03374 · arXiv
- Shi, 2022, Language models are multilingual chain-of-thought reasoners, arXiv:2210.03057 · arXiv
- 10.18653/v1/2025.findings-emnlp.368 · DOI
- Ye, 2024, MIRAI: Evaluating LLM agents for event forecasting, arXiv:2407.01231 · arXiv
- 10.18653/v1/2024.acl-long.850 · DOI · Paper page
- Liu, 2024, VisualAgentBench: Towards large multimodal models as visual foundation agents, arXiv:2408.06327 · arXiv
- Chen, 2024, ScienceAgentBench: Toward rigorous assessment of language agents for data-driven scientific discovery, arXiv:2410.05080 · arXiv
- Majumder, 2024, DiscoveryBench: Towards data-driven discovery with large language models, arXiv:2407.01725 · arXiv
- 10.18653/v1/2024.findings-emnlp.815 · DOI
- Liu, 2024, Medchain: Bridging the gap between LLM agents and clinical practice through interactive sequential benchmarking, arXiv:2412.01605 · arXiv
- Long, 2024, TeamCraft: A benchmark for multi-modal multi-agent systems in minecraft, arXiv:2412.05255 · arXiv
- 10.18653/v1/2025.acl-long.116 · DOI
- Rein, GPQA: A graduate-level Google-proof Q&A benchmark
- Tang, 2025, MedAgentsBench: Benchmarking thinking models and agent frameworks for complex medical reasoning, arXiv:2503.07459 · arXiv
- Cheng, 2025, EmbodiedEval: Evaluate multimodal LLMs as embodied agents, arXiv:2501.11858 · arXiv
- 10.52202/079017-0607 · DOI
- Xiang, 2025, SciReplicate-bench: Benchmarking LLMs in agent-driven algorithmic reproduction from research papers, arXiv:2504.00255 · arXiv
- Fish, 2025, EconEvals: Benchmarks and litmus tests for LLM agents in unknown environments, arXiv:2503.18825 · arXiv
- Sung, 2025, VeriLA: A human-centered evaluation framework for interpretable verification of LLM agent failures, arXiv:2503.12651 · arXiv
- Li, 2025, AgentOrca: A dual-system framework to evaluate language agents on operational routine and constraint adherence, arXiv:2503.08669 · arXiv
- 10.18653/v1/2025.findings-acl.1036 · DOI
- Gautam, 2025, RefactorBench: Evaluating stateful reasoning in language agents through code, arXiv:2503.07832 · arXiv
- Gonzalez-Pumariega, 2025, Robotouille: An asynchronous planning benchmark for LLM agents, arXiv:2502.05227 · arXiv
- Tang, 2025, DSGBench: A diverse strategic game benchmark for evaluating LLM-based agents in complex decision-making environments, arXiv:2503.06047 · arXiv
- Ku, 2025, TheoremExplainAgent: Towards multimodal explanations for LLM theorem understanding, arXiv:2502.19400 · arXiv
- 10.1109/TASLPRO.2025.3626926 · DOI
- Zhang, 2025, DataSciBench: An LLM agent benchmark for data science, arXiv:2502.13897 · arXiv
- Wei, 2025, BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
- Chan, 2025, MLE-bench: Evaluating machine learning agents on machine learning engineering, arXiv:2410.07095 · arXiv
- Rashid, 2025, SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents, arXiv:2504. 08703
- Zan, 2025, Multi-SWE-bench: A multilingual benchmark for issue resolving, arXiv:2504.02605 · arXiv
- Srivastava, 2022, Beyond the imitation game: Quantifying and extrapolating the capabilities of language models, arXiv:2206.04615 · arXiv
- 10.18653/v1/2023.findings-acl.824 · DOI · Paper page
- 2025, Langchain Agents Tutorial
- 2025, Building a Basic Agent
- 2025, Crewai
- 2024, Swarm
- Wu, 2025, Agentic reasoning: Reasoning LLMs with tools for the deep research, arXiv:2502.04644 · arXiv
- Lu, 2025, OctoTools: An agentic framework with extensible tools for complex reasoning, arXiv:2502.11271 · arXiv
- 2025, Agents SDK
- Wang, 2024, StarWhisper telescope: Agent-based observation assistant system to approach AI astrophysicist, arXiv:2412. 06412
- 10.18653/v1/2024.findings-emnlp.192 · DOI
- Wang, 2024, GeneAgent: Self-verification language agent for gene set knowledge discovery using domain databases, arXiv:2405.16205 · arXiv
- 10.1038/s44387-025-00003-z · DOI
- Liang, 2025, SurveyX: Academic survey automation via large language models, arXiv:2502.14776 · arXiv
- Li, 2024, Chain of ideas: Revolutionizing research via novel idea development with LLM agents, arXiv:2410.13185 · arXiv
- Mitra, 2024, AgentInstruct: Toward generative teaching with agentic flows, arXiv:2407.03502 · arXiv
- Tang, 2025, ChemAgent: Self-updating library in large language models improves chemical reasoning, arXiv:2501.06590 · arXiv
- 10.1145/3701716.3717527 · DOI
- 10.1016/j.jss.2024.112278 · DOI · Paper page
- 2025, How to Design an Agent for Production
- Sun, 2024, OS-genesis: Automating GUI agent trajectory construction via reverse task synthesis, arXiv:2412.19723 · arXiv
- 10.18653/v1/2025.findings-acl.740 · DOI · Paper page
- Zhou, 2024, Zodiac: A cardiologist-level LLM framework for multi-agent diagnostics, arXiv:2410.02026 · arXiv
- Wang, 2025, MedAgent-pro: Towards multi-modal evidence-based medical diagnosis via reasoning agentic workflow, arXiv:2503.18968 · arXiv
- 10.1145/3706598.3714014 · DOI
- Feng, 2025, M³builder: A multi-agent system for automated machine learning in medical imaging, arXiv:2502.20301 · arXiv
- 10.18653/v1/2025.acl-long.677 · DOI · Paper page
- 10.1109/ICCV51701.2025.02175 · DOI
- 10.26615/978-954-452-106-6-001 · doi:10.26615/978-954-452-106-6-001
- 10.18653/v1/2025.acl-long.1024 · DOI
- Xu, 2025, AutoCBT: An autonomous multi-agent framework for cognitive behavioral therapy in psychological counseling, arXiv:2501.09426 · arXiv
- Lee, 2025, Psyche: A multi-faceted patient simulation framework for evaluation of psychiatric assessment conversational agents, arXiv:2501.01594 · arXiv
- Zhang, 2024, PsyDraw: A multi-agent multimodal system for mental health screening in left-behind children, arXiv:2412.14769 · arXiv
- 10.18653/v1/2025.acl-long.846 · DOI
- Wasenmüller, 2024, Script-based dialog policy planning for LLM-powered conversational agents: A basic architecture for an, arXiv:2412.15242 · arXiv
- 10.18653/v1/2025.emnlp-main.603 · DOI
- Wang, 2024, PatentAgent: Intelligent agent for automated pharmaceutical patent analysis, arXiv:2410.21312 · arXiv
- Inoue, 2024, DrugAgent: Explainable drug repurposing agent with large language model-based reasoning, arXiv:2408.13378 · arXiv
- Chen, 2025, MAP: Evaluation and multi-agent enhancement of large language models for inpatient pathways, arXiv:2503.13205 · arXiv
- 10.18653/v1/2025.findings-acl.729 · DOI
- Lin, 2024, BioKGBench: A knowledge graph checking benchmark of AI agent for biomedical science, arXiv:2407.00466 · arXiv
- Schmidgall, 2025, AgentRxiv: Towards collaborative autonomous research, arXiv:2503.18102 · arXiv
- 10.18653/v1/2025.findings-acl.1016 · DOI
- Dong, 2025, The Ann Arbor architecture for agent-oriented programming, arXiv:2502.09903 · arXiv
- Jain, 2025, R2E-gym: Procedural environments and hybrid verifiers for scaling open-weights SWE agents, arXiv:2504.07164 · arXiv
- 10.18653/v1/2025.findings-acl.642 · DOI
- Chen, 2025, Verbal process supervision elicits better coding agents, arXiv:2503.18494 · arXiv
- 10.18653/v1/2025.acl-long.973 · DOI
- 10.18653/v1/2025.acl-long.426 · DOI
- Gholamzadeh Khoee, 2025, GateLens: A reasoning-enhanced LLM agent for automotive software release analytics, arXiv:2503
- Hu, 2025, An LLM-based agent for reliable Docker environment configuration, arXiv:2502.13681 · arXiv
- 10.1145/3706599.3719729 · DOI
- Pan, 2024, Training software engineering agents and verifiers with SWE-gym, arXiv:2412.21139 · arXiv
- Yang, 2025, Multi-agent collaboration for multilingual code instruction tuning, arXiv:2502.07487 · arXiv
- Guo, 2025, SyncMind: Measuring agent out-of-sync recovery in collaborative software engineering, arXiv:2502.06994 · arXiv
- 10.18653/v1/2025.findings-naacl.285 · DOI
- Wan, 2024, Enhancing the efficiency and accuracy of underlying asset reviews in structured finance: The application of multi-agent framework, arXiv:2405.04294 · arXiv
- Yang, 2025, TwinMarket: A scalable behavioral and socialsimulation for financial markets, arXiv:2502.01506 · arXiv
- 10.52202/079017-4354 · DOI
- Lin, 2024, Strategic collusion of LLM agents: Market division in multi-commodity competitions, arXiv:2410.00031 · arXiv
- 10.1145/3677052.3698686 · DOI
- 10.1145/3677052.3698645 · DOI
- Han, 2025, FinSphere: A conversational stock analysis agent equipped with quantitative tools based on real-time database, arXiv:2501.12399 · arXiv
- 10.1109/ICDMW69685.2025.00105 · DOI
- Zeng, 2025, Cite before you speak: Enhancing context-response grounding in e-commerce conversational LLM-agents, arXiv:2503.04830 · arXiv
- 10.18653/v1/2025.emnlp-industry.191 · DOI
- 10.18653/v1/2025.findings-naacl.420 · DOI
- Lei, 2024, MACM: Utilizing a multi-agent system for condition mining in solving complex mathematical problems, arXiv:2404.04735 · arXiv
- Xie, 2024, MathLearner: A large language model agent framework for learning to solve mathematical problems, arXiv:2408.01779 · arXiv
- Lee, 2024, Expanding search space with diverse prompting agents: An efficient sampling approach for LLM mathematical reasoning, arXiv:2410.09780 · arXiv
- Deng, 2024, Flow-DPO: Improving LLM mathematical reasoning through online multi-agent learning, arXiv:2410.22304 · arXiv
- Li, 2025, Automating mathematical proof generation using large language model agents and knowledge graphs, arXiv:2503.11657 · arXiv
- Wang, 2025, MA-LoT: Multi-agent lean-based long chain-of-thought reasoning enhances formal theorem proving, arXiv:2503.03205 · arXiv
- Yue, 2024, MathVC: An LLM-simulated multi-character virtual classroom for mathematics education, arXiv:2404.06711 · arXiv
- Ma, 2025, LLM knows geometry better than algebra: Numerical understanding of LLM-based agents in a trading arena, arXiv:2502.17967 · arXiv
- Yu, 2024, MineAgent: Towards remote-sensing mineral exploration with multimodal large language models, arXiv:2412.17339 · arXiv
- 10.1080/17538947.2025.2458688 · DOI
- Xu, 2025, FilmAgent: A multi-agent framework for end-to-end film automation in virtual 3D spaces, arXiv:2501.12909 · arXiv
- Wang, 2024, AesopAgent: Agent-driven evolutionary system on story-to-video production, arXiv:2403.07952 · arXiv
- 10.18653/v1/2024.acl-long.88 · DOI
- Maronikolakis, 2024, What should I wear to a party in a Greek taverna? Evaluation for conversational agents in the fashion domain, arXiv:2408.08907 · arXiv
- Deng, 2024, ComposerX: Multi-agent symbolic music composition with LLMs, arXiv:2404.18081 · arXiv
- 10.18653/v1/2023.emnlp-demo.21 · doi:10.18653/v1/2023.emnlp-demo.21
- Zhang, 2024, LLM-based multi-agent poetry generation in non-cooperative environments, arXiv:2409.03659 · arXiv
- 10.1109/O-COCOSDA64382.2024.10800588 · DOI
- 2025, Introduction to MCP
- 2025, BEEAI Now Has Multiple Agents, and a Standardized Way for Them to Talk
- 2025, A2A: A New Era of Agent Interoperability
- 10.1145/3796519 · DOI · Paper page
- Yuan, 2025, NaturalReasoning: Reasoning in the wild with 2.8M challenging questions, arXiv:2502.13124 · arXiv
- Penedo, 2024, FINEWEB2: A Sparkling Update With 1000s of Languages
- 2024, MAGPIE Ultra V0.1
- Perrot, 2025, Implement Human-in-the-Loop Confirmation With Amazon Bedrock Agents
- Wang, 2025, Talk structurally, act hierarchically: A collaborative framework for LLM multi-agent systems, arXiv:2502.11098 · arXiv
- 10.18653/v1/2024.findings-naacl.112 · DOI
- Costello, 2025, Think, prune, train, improve: Scaling reasoning without scaling models, arXiv:2504.18116 · arXiv
- Xiang, 2025, Towards system 2 reasoning in LLMs: Learning how to think with meta chain-of-though, arXiv:2501.04682 · arXiv
200 of 204 shown
Cited by
A Survey of Context Engineering for Large Language Models
Mei, L., Yao, J., Ge, Y., Wang, Y., Bi, B., Cai, Y., Liu, J., Li, M., Li, Z.-Z., Zhang, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.13334 · Cited by 281
Bandi, A., Kongari, B., Naguru, R., Pasnoor, S., & Vilipala, S. V. (2025) · Future Internet · doi:10.3390/fi17090404 · Cited by 207
Madrid-García, A., Benavent, D., & Merino-Barbancho, B. (2025) · EULAR Rheumatology Open · doi:10.1016/j.ero.2025.06.012 · Cited by 9
“Thanks to key technological milestones [15], these agents extend the capabilities of LLMs by equipping them with the ability to use external tools, plan and execute multistep tasks and interact dynamically with their environment [16].”
Shi, K., Sun, W., Zhang, Z., Sun, L., Chawla, N. V., & Ye, Y. (2026) · arXiv · doi:10.48550/arxiv.2602.23452
“LLM-based agents have recently demonstrated strong performance on complex, long-horizon tasks by moving beyond pure text generation toward actionable decision-making pipelines that interleave reasoning with interactions in external environments [13, 14, 23, 30, 32].”
Metadata
- Authors
- Ferrag, M. A., Tihanyi, N., & Debbah, M.
- Affiliations
- Department of Computer and Network Engineering, United Arab Emirates University, Al Ain, United Arab Emirates
- Technology Innovation Institute, Abu Dhabi, United Arab Emirates
- Research Institute for Digital Future, Khalifa University, Abu Dhabi, United Arab Emirates
- Venue
- IEEE Access
- Published
- 2026
- Volume
- 14
- Pages
- 84237-84285
- ISSN
- 2169-3536
- Cited by
- 50
- References
- 38
- Funders
- United Arab Emirates University (G00005769)
- Khalifa University of Science and Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.