CoChat
Sign Up
PreprintCited by 1AI-based Problem Solving and PlanningArtificial Intelligence ApplicationsTopic Modeling

The DOI matches its DataCite record; 7 of the 7 references it cites were found in a registry or an index.

Fundamentals of Building Autonomous LLM Agents

Open access
Castrillo, Victor de Lamo, Gidey, Habtom Kahsay, Lenz, Alexander, Knoll, Alois·2025·arXiv
DOI 10.48550/arxiv.2510.09244arXiv 2510.09244
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper reviews the architecture and implementation methods of agents powered by large language models (LLMs). Motivated by the limitations of traditional LLMs in real-world tasks, the research aims to explore patterns to develop "agentic" LLMs that can automate complex tasks and bridge the performance gap with human capabilities. Key components include a perception system that converts environmental percepts into meaningful representations; a reasoning system that formulates plans, adapts to feedback, and evaluates actions through different techniques like Chain-of-Thought and Tree-of-Thought; a memory system that retains knowledge through both short-term and long-term mechanisms; and an execution system that translates internal decisions into concrete actions. This paper shows how integrating these systems leads to more capable and generalized software bots that mimic human cognitive processes for autonomous and intelligent behavior.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2510.09244

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 62

  1. [1]1. Alazraki, L., Mozes, M., Campos, J.A., Yi-Chern, T., Rei, M., Bartolo, M.: No need for explanations: Llms can implicitly learn from mistakes in-context. arXiv preprint (2025), https://arxiv.org/abs/2502.08550 · arXiv
  2. [2]2. Anthony Brohan, e.a.: Rt-2: Vision-language-action models transfer web knowledge to robotic control. arXiv preprint (2023), https://arxiv.org/abs/2307.15818 · arXiv
  3. [4]4. Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Podstawski, M., Gianinazzi, L., Gajda, J., Lehmann, T., Niewiadomski, H., Nyczyk, P., Hoefler, T.: Graph of Thoughts: Solving Elaborate Problems with Large Language Models. arXiv preprint (2023), https://arxiv.org/abs/2308.09687 · arXiv
  4. [5]5. Cai, W., Jiang, J., Wang, F., Tang, J., Kim, S., Huang, J.: A survey on mixture of experts in large language models. arXiv preprint (2025), https://arxiv.org/pdf/ 2407.06204.pdf
  5. [6]6. Chen, X., Lin, M., Schärli, N., Zhou, D.: Teaching large language models to selfdebug. arXiv preprint (2023), https://arxiv.org/abs/2304.05128 · arXiv
  6. [7]7. Chen, Y., Cui, W., Chen, Y., Tan, M., Zhang, X., Zhao, D., Wang, H.: Robogpt: an intelligent agent of making embodied long-term decisions for daily instruction tasks. arXiv preprint (2024), https://arxiv.org/abs/2311.15649 · arXiv
  7. [8]8. Deng, X., Gu, Y., Zheng, B., Chen, S., Stevens, S., Wang, B., Sun, H., Su, Y.: Mind2web: Towards a generalist agent for the web. arXiv preprint (2023), https: //arxiv.org/abs/2306.06070
  8. [9]9. Florian Bordes, e.a.: An introduction to vision-language models. arXiv preprint arXiv:2405.17247 (2024), https://arxiv.org/pdf/2405.17247.pdf · arXiv
  9. [10]10. Gao, L., Madaan, A., Zhou, S., Alon, U., Liu, P., Yang, Y., Callan, J., Neubig, G.: Pal: Program-aided language models. arXiv preprint (2023), https://arxiv.org/abs/ 2211.10435
  10. [11]11. Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., Wang, H.: Retrieval-augmented generation for large language models: A survey. arXiv preprint (2024), https://arxiv.org/abs/2312.10997 · arXiv
  11. [12]12. Gidey, H.K., Collins, A., Marmsoler, D.: Modeling and verifying dynamic architectures with factum studio. In: Formal Aspects of Component Software,FACS 2019,. Springer (2019). https://doi.org/10.1007/978-3-030-40914-2\_13, https://doi.org/ 10.1007/978-3-030-40914-2\_13 · DOI
  12. [13]13. Gidey, H.K., Hillmann, P., Karcher, A., Knoll, A.: Towards cognitive bots: Architectural research challenges. In: Artificial General Intelligence, AGI 2023,. Springer (2023). https://doi.org/10.1007/978-3-031-33469-6\_11, https://doi.org/10.1007/ 978-3-031-33469-6\_11 · DOI
  13. [14]14. Gidey, H.K., Hillmann, P., Karcher, A., Knoll, A.: User-like bots for cognitive automation: A survey. In: Machine Learning, Optimization, and Data Science, LOD 2023,. Springer (2023). https://doi.org/10.1007/978-3-031-53966-4\_29, https: //doi.org/10.1007/978-3-031-53966-4\_29 · DOI
  14. [15]15. Gidey, H.K., Huber, N., Lenz, A., Knoll, A.: Affordance representation and recognition for Autonomous Agents. In: Proceedings of the Second International Workshop on Hypermedia Multi-Agent Systems (HyperAgents 2025), in conjunction with the 28th European Conference on Artificial Intelligence (ECAI 2025), Bologna, Italy, October 26, 2025. Bologna, Italy (Oct 2025)
  15. [16]16. Gidey, H.K., Hueber, N., Lenz, A., Knoll, A.: Visual perception patterns for software agents (2025), preprint
  16. [17]17. Gidey, H.K., Kesseler, M., Stangl, P., Hillmann, P., Karcher, A.: Document-based knowledge discovery with microservices architecture. In: Bennour, A., Ensari, T., Kessentini, Y., Eom, S. (eds.) Intelligent Systems and Pattern Recognition: ISPR 2022. Communications in Computer and Information Science, vol. 1589, pp. 146161. Springer, Cham (Mar 2022). https://doi.org/10.1007/978-3-031-08277-1\_13, https://doi.org/10.1007/978-3-031-08277-1\_13 · DOI
  17. [19]19. Gidey, H.K., Marmsoler, D., Ascher, D.: Modeling adaptive self-healing systems. CoRR abs/2304.12773 (Apr 2023). https://doi.org/10.48550/arXiv.2304.12773, https://arxiv.org/abs/2304.12773 · DOI
  18. [20]20. Gidey, H.K., Marmsoler, D., Eckhardt, J.: Grounded architectures: Using grounded theory for the design of software architectures. In: 2017 IEEE International Conference on Software Architecture Workshops (ICSAW). pp. 141-148. IEEE, Gothenburg, Sweden (Apr 2017). https://doi.org/10.1109/ICSAW.2017.41, https: //doi.org/10.1109/ICSAW.2017.41 · DOI
  19. [22]22. Hamdan, S., Yuret, D.: How much do llms learn from negative examples? arXiv preprint (2025), https://arxiv.org/abs/2503.14391 · arXiv
  20. [24]24. Hao, S., Gu, Y., Ma, H., Hong, J.J., Wang, Z., Wang, D.Z., Hu, Z.: Reasoning with language model is planning with world model. arXiv preprint (2023), https: //arxiv.org/abs/2305.14992
  21. [23]23. Han, S., Zhang, Q., Yao, Y., Jin, W., Xu, Z.: Llm multi-agent systems: Challenges and open problems. arXiv preprint (2025), https://arxiv.org/abs/2402.03578 · arXiv
  22. [25]25. Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., Liu, T.: A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems 43 (2) (2025). https://doi.org/10.1145/3703155, http://dx.doi.org/10.1145/3703155 · DOI · Paper page
  23. [27]27. Hwang, J., Tani, J.: Seamless integration and coordination of cognitive skills in humanoid robots: A deep learning approach. arXiv preprint (2017), https: //arxiv.org/abs/1706.02423
  24. [26]26. Huang, X., Liu, W., Chen, X., Wang, X., Wang, H., Lian, D., Wang, Y., Tang, R., Chen, E.: Understanding the planning of llm agents: A survey. arXiv preprint (2024), https://arxiv.org/abs/2402.02716 · arXiv
  25. [28]28. Jain, J., Yang, J., Shi, H.: Vcoder: Versatile vision encoders for multimodal large language models. arXiv preprint arXiv:2312.14233 (2023), https://arxiv.org/pdf/ 2312.14233.pdf · arXiv
  26. [30]30. Kil, J., Song, C.H., Zheng, B., Deng, X., Su, Y., Chao, W.L.: Dual-view visual contextualization for web navigation. arXiv preprint (2024), https://arxiv.org/abs/ 2402.04476
  27. [29]29. Jin, H., Huang, L., Cai, H., Yan, J., Li, B., Chen, H.: From LLMs to LLM-based agents for software engineering: A survey of current, challenges and future. arXiv preprint (2024), https://arxiv.org/pdf/2408.02479 · arXiv
  28. [33]33. Li, X., Wang, S., Zeng, S., Wu, Y., Yang, Y.: A survey on LLM-based multi-agent systems: workflow, infrastructure, and challenges. Vicinagearth 1 , 9 (2024). https:// doi.org/10.1007/s44336-024-00009-2, https://doi.org/10.1007/s44336-024-00009-2 · DOI · Paper page
  29. [32]32. Li, M., Zhao, Y., Yu, B., Song, F., Li, H., Yu, H., Li, Z., Huang, F., Li, Y.: Apibank: A comprehensive benchmark for tool-augmented llms. arXiv preprint (2023), https://arxiv.org/abs/2304.08244 · arXiv
  30. [34]34. Li, Y., Lai, Z., Bao, W., Tan, Z., Dao, A., Sui, K., Shen, J., Liu, D., Liu, H., Kong, Y.: Visual large language models for generalized and specialized applications. arXiv preprint arXiv:2501.02765 (2025), https://arxiv.org/abs/2501.02765 · arXiv
  31. [36]36. Lu, Z., Lu, W., Tao, Y., Dai, Y., Chen, Z., Zhuang, H., Chen, C., Peng, H., Zeng, Z.: Decompose, plan in parallel, and merge: A novel paradigm for large language models based planning with multiple constraints. arXiv preprint (2025), https://arxiv.org/abs/2506.02683 · arXiv
  32. [35]35. Liu, T., Ren, J., Zhang, C.: Planning with large language models via corrective re-prompting. arXiv preprint (2023), https://arxiv.org/pdf/2305.018323.pdf
  33. [37]37. Macedo, J., Gidey, H.K., Rebuli, K.B., Machado, P.: Evolving user interfaces: A neuroevolution approach for natural human-machine interaction. In: Johnson, C., Rebelo, S.M., Santos, I. (eds.) Artificial Intelligence in Music, Sound, Art and Design: 13th International Conference, EvoMUSART 2024, Held as Part of EvoStar 2024, Aberystwyth, UK, April 3-5, 2024, Proceedings. Lecture Notes in Computer Science, vol. 14633, pp. 246-264. Springer, Cham (Apr 2024). https://doi.org/10. 1007/978-3-031-56992-0\_16, https://doi.org/10.1007/978-3-031-56992-0\_16 · DOI
  34. [39]39. Mi, Y., Gao, Z., Ma, X., Li, Q.: Building llm agents by incorporating insights from computer systems. arXiv preprint arXiv:2504.04485 (2025), https://arxiv.org/pdf/ 2504.04485v1.pdf · arXiv
  35. [38]38. Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., Gupta, S., Majumder, B.P., Hermann, K., Welleck, S., Yazdanbakhsh, A., Clark, P.: Self-refine: Iterative refinement with self-feedback. arXiv preprint (2023), https://arxiv.org/abs/2303.17651 · arXiv
  36. [40]40. Nakano, R., Hilton, J., Balaji, S., Wu, J., Ouyang, L., Kim, C., Hesse, C., Jain, S., Kosaraju, V., Saunders, W., Jiang, X., Cobbe, K., Eloundou, T., Krueger, G., Button, K., Knight, M., Chess, B., Schulman, J.: Webgpt: Browser-assisted question-answering with human feedback. arXiv preprint (2022), https://arxiv.org/ abs/2112.09332 · arXiv
  37. [41]41. Niu, R., Li, J., Wang, S., Fu, Y., Hu, X., Leng, X., Kong, H., Chang, Y., Wang, Q.: Screenagent: A vision language model-driven computer control agent. In: Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence. pp. 6433-6441. IJCAI-2024, International Joint Conferences on Artificial Intelligence Organization (Aug 2024). https://doi.org/10.24963/ijcai.2024/711, http://dx.doi.org/10.24963/ijcai.2024/711 · DOI
  38. [44]44. Patil, S.G., Zhang, T., Wang, X., Gonzalez, J.E.: Gorilla: Large language model connected with massive apis. arXiv preprint (2023), https://arxiv.org/pdf/2305. 15334
  39. [45]45. Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., Sutskever, I.: Learning transferable visual models from natural language supervision. arXiv preprint arXiv:2103.00020 (2021), https://arxiv.org/abs/2103.00020 · arXiv
  40. [46]46. Rawles, C., Li, A., Rodriguez, D., Riva, O., Lillicrap, T.: Android in the wild: A large-scale dataset for android device control. arXiv preprint (2023), https: //arxiv.org/abs/2307.10088
  41. [48]48. Shen, Y., Song, K., Tan, X., Li, D., Lu, W., Zhuang, Y.: Hugginggpt: Solving ai tasks with chatgpt and its friends in hugging face. arXiv preprint (2023), https: //arxiv.org/abs/2303.17580
  42. [50]50. Song, S., Li, X., Li, S., Zhao, S., Yu, J., Ma, J., Mao, X., Zhang, W.: How to bridge the gap between modalities: Survey on multimodal large language model. arXiv preprint arXiv:2311.07594 (2025), https://arxiv.org/abs/2311.07594 · arXiv
  43. [49]49. Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., Yao, S.: Reflexion: Language agents with verbal reinforcement learning. arXiv preprint (2023), https://arxiv.org/abs/2303.11366 · arXiv
  44. [51]51. Talebirad, Y., Nadiri, A.: Multi-agent collaboration: Harnessing the power of intelligent llm agents. arXiv preprint (2023), https://arxiv.org/abs/2306.03314 · arXiv
  45. [53]53. Wang, H., Li, T., Deng, Z., Roth, D., Li, Y.: Devil's advocate: Anticipatory reflection for llm agents. arXiv preprint (2024), https://arxiv.org/abs/2405.16334 · arXiv
  46. [52]52. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. arXiv preprint arXiv:1706.03762 (2017), https://arxiv.org/pdf/1706.03762.pdf · arXiv
  47. [54]54. Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z.Y., Tang, J., Chen, X., Lin, Y., Zhao, W.X., Wei, Z., Wen, J.R.: A survey on large language model based autonomous agents. arXiv preprint (2025), https://arxiv.org/pdf/2308. 11432.pdf
  48. [56]56. Wang, X., Liu, B.: Oscar: Operating system control via state-aware reasoning and replanning. arXiv preprint arXiv:2410.18963 (2024), https://arxiv.org/abs/2410.18963 · arXiv
  49. [55]55. Wang, L., Xu, W., Lan, Y., Hu, Z., Lan, Y., Lee, R.K.W., Lim, E.P.: Plan-andsolve prompting: Improving zero-shot chain-of-thought reasoning by large language models. arXiv preprint (2023), https://arxiv.org/abs/2305.04091 · arXiv
  50. [57]57. Wang, X., Salmani, M., Omidi, P., Ren, X., Rezagholizadeh, M., Eshaghi, A.: Beyond the limits: A survey of techniques to extend the context length in large language models. arXiv preprint (2024), https://arxiv.org/abs/2402.02244 · arXiv
  51. [59]59. Wang, Z.Z., Mao, J., Fried, D., Neubig, G.: Agent workflow memory. arXiv preprint (2024), https://arxiv.org/abs/2409.07429 · arXiv
  52. [58]58. Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., Zhou, D.: Self-consistency improves chain of thought reasoning in language models. arXiv preprint (2023), https://arxiv.org/abs/2203.11171 · arXiv
  53. [60]60. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., Zhou, D.: Chain-of-thought prompting elicits reasoning in large language models. arXiv preprint (2023), https://arxiv.org/abs/2201.11903 · arXiv
  54. [64]64. Yang, J., Zhang, H., Li, F., Zou, X., Li, C., Gao, J.: Set-of-mark prompting unleashes extraordinary visual grounding in gpt-4v. arXiv preprint arXiv:2310.11441 (2023), https://arxiv.org/abs/2310.11441 · arXiv
  55. [63]63. Xu, B., Peng, Z., Lei, B., Mukherjee, S., Liu, Y., Xu, D.: Rewoo: Decoupling reasoning from observations for efficient augmented language models. arXiv preprint (2023), https://arxiv.org/abs/2305.18323 · arXiv
  56. [65]65. Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T.L., Cao, Y., Narasimhan, K.: Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint (2023), https://arxiv.org/abs/2305.10601 · arXiv
  57. [67]67. Zhang, D., Yu, Y., Dong, J., Li, C., Su, D., Chu, C., Yu, D.: Mm-llms: Recent advances in multimodal large language models. arXiv preprint arXiv:2401.13601 (2024), https://arxiv.org/abs/2401.13601 · arXiv
  58. [68]68. Zhao, Z., Lee, W.S., Hsu, D.: Large language models as commonsense knowledge for large-scale task planning. In: Thirty-seventh Conference on Neural Information Processing Systems (2023), https://openreview.net/forum?id=Wjp1AYB8lH
  59. [70]70. Zhou, S., Xu, F.F., Zhu, H., Zhou, X., Lo, R., Sridhar, A., Cheng, X., Ou, T., Bisk, Y., Fried, D., Alon, U., Neubig, G.: Webarena: A realistic web environment for building autonomous agents. arXiv preprint (2024), https://arxiv.org/abs/2307.13854 · arXiv
  60. [69]69. Zhong, W., Guo, L., Gao, Q., Ye, H., Wang, Y.: Memorybank: Enhancing large language models with long-term memory. arXiv preprint (2023), https://arxiv.org/ abs/2305.10250 · arXiv
  61. [71]71. Zhu, X., Chen, Y., Wang, H., et al.: OSWorld: A realistic benchmark for generalist agents in operating systems. arXiv preprint (2024), https://arxiv.org/pdf/2404. 07972
  62. [72]72. Zhu, X., Li, Q., Cui, L., Liu, Y.: Large language model enhanced text-to-sql generation: A survey. arXiv preprint (2024), https://arxiv.org/abs/2410.06011 · arXiv

Cited by

Sorted by citations

See all 1

Metadata

Authors
Castrillo, V. D. L., Gidey, H. K., Lenz, A., & Knoll, A.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2510.09244
arXiv
2510.09244
OpenAlex
W4417127534
Cited by
1
References
7
Citations by year
2026: 1
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by-nc-nd/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
large language models, agentic LLMs, autonomous agents, agent architecture, perception systems, reasoning systems, memory systems, chain-of-thought, tree-of-thought, task automation, bots, human-like cognition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review