CoChat
Sign Up
PreprintCited by 11Topic ModelingNatural Language Processing TechniquesArtificial Intelligence Applications

Exploring Autonomous Agents through the Lens of Large Language Models: A Review

Open access
Barua, Saikat·2024·arXiv
DOI 10.48550/arxiv.2404.04442arXiv 2404.04442
Open this paper in CoChat — free accountOpen PDF

Abstract

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential to revolutionize sectors from customer service to healthcare. However, they face challenges such as multimodality, human value alignment, hallucinations, and evaluation. Techniques like prompting, reasoning, tool utilization, and in-context learning are being explored to enhance their capabilities. Evaluation platforms like AgentBench, WebArena, and ToolLLM provide robust methods for assessing these agents in complex scenarios. These advancements are leading to the development of more resilient and capable autonomous agents, anticipated to become integral in our digital lives, assisting in tasks from email responses to disease diagnosis. The future of AI, with LLMs at the forefront, is promising.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2404.04442

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Programmatic pipelines automate prompt tuning using task templates, context fillers, and retrieval-augmented variables.

    “Programmatic pipelines automate this process using task templates, context fillers, and retrieval-augmented variables [232,233].”

    From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [233]

    Section 3.4 ('Prompting is all you need'; page unavailable) describes Automatic Prompt Engineer generating and evaluating instruction candidates, supporting the general point that prompt development can be automated. It discusses retrieval-augmented generation separately, but does not say that programmatic pipelines tune prompts using task templates, context fillers, and retrieval-augmented variables. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Programmatic pipelines automate manual prompt tuning using task templates, context fillers, and retrieval-augmented variables.

    “Programmatic pipelines automate this process using task templates, context fillers, and retrieval-augmented variables [235], [236].”

    From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [236]

    Section 3.4, “Prompting is all you need” (page not provided), describes Automatic Prompt Engineer as generating, testing, and selecting task instructions autonomously, supporting the automation aspect. It does not describe programmatic pipelines using task templates, context fillers, or retrieval-augmented variables to do so. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

  • PagedAttention, inspired by virtual memory and paging techniques in operating systems, manages key-value cache memory in LLMs.

    “PagedAttention, inspired by virtual memory and paging techniques in operating systems, manages key-value cache memory in LLMs [57].”

    From A Survey of Context Engineering for Large Language Models (2025) · cites this paper as [57]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 108

  1. Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., Wen, J-R., A Survey on Large Language Model based Autonomous Agents, arXiv preprint arXiv:2308.11432, 2023. · arXiv
  2. Franklin, S., Graesser, A., Is it an Agent, or just a Program?: A Taxon- omy for Autonomous Agents, In International workshop on agent theories, architectures, and languages (pp. 21-35), Springer, 1996.
  3. Boiko, D. A., MacKnight, R., Gomes, G., Emergent autonomous sci- entific research capabilities of large language models, arXiv preprint arXiv:2304.05332, 2023. · arXiv
  4. Chui, M., Manyika, J., Miremadi, M., Four fundamentals of workplace automation, McKinsey Quarterly, 29(3), pp.1-9, 2015.
  5. Gao, C., Lan, X., Li, N., Yuan, Y., Ding, J., Zhou, Z., Xu, F., Li, Y., Large Language Models Empowered Agent-based Modeling and Simula- tion: A Survey and Perspectives, arXiv preprint arXiv:2312.11970, 2023. · arXiv
  6. Reynolds, L., McDonell, K., Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm, arXiv preprint arXiv:2102.07350, 2021. · arXiv
  7. Peng, C., Yang, X., Smith, K. E., Yu, Z., Chen, A., Bian, J., Wu, Y., Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extraction, arXiv preprint arXiv:2310.06239, 2023. · arXiv
  8. Binz, M., Schulz, E., Turning large language models into cognitive models, arXiv preprint arXiv:2306.03917, 2023. · arXiv
  9. Shaki, J., Kraus, S., Wooldridge, M., Cognitive Effects in Large Lan- guage Models, arXiv preprint arXiv:2308.14337, 2023. · arXiv
  10. Cheng, Y., Zhang, C., Zhang, Z., Meng, X., Hong, S., Li, W., Wang, Z., Wang, Z., Yin, F., Zhao, J., He, X., Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects, arXiv preprint arXiv:2401.03428, 2024. · arXiv
  11. Wang, J., Wu, Z., Li, Y., Jiang, H., Shu, P., Shi, E., Hu, H., Ma, C., Liu, Y., Wang, X., Yao, Y., Liu, X., Zhao, H., Liu, Z., Dai, H., Zhao, L., Ge, B., Li, X., Liu, T., Zhang, S., Large Language Models for Robotics: Oppor- tunities, Challenges, and Perspectives, arXiv preprint arXiv:2401.04334, 2024. · arXiv
  12. Mandi, Z., Jain, S., Song, S., RoCo: Dialectic Multi-Robot Collab- oration with Large Language Models, arXiv preprint arXiv:2307.04738, 2023. · arXiv
  13. Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Dal Lago, A., Hubert, T., Choy, P., de Masson d'Autume, C., Babuschkin, I., Chen, X., Huang, P., Welbl, J., Gowal, S., Cherepanov, A., Molloy, J., Mankowitz, D. J., Suther- land Robson, E., Kohli, P., de Freitas, N., Kavukcuoglu, K., Vinyals, O., Competition-level code generation with AlphaCode, Science, 378(6624), pp.1092-1097, 2022.
  14. Sharma, D., Purushotham, S., Reddy, C. K., MedFuseNet: An attention-based multimodal deep learning model for visual question an- swering in the medical domain, Scientific Reports, 11(1), pp.19826, Nature Publishing Group UK London, 2021.
  15. Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al., LLaMA: Open and Efficient Foundation Language Models, arXiv preprint arXiv:2302.13971, 2023. · arXiv
  16. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P. J., Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer, CoRR, abs/1910.10683, 2019, http://arxiv.org/abs/1910.10683. · arXiv
  17. Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., Zettlemoyer, L., BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Compre- hension, CoRR, abs/1910.13461, 2019, http://arxiv.org/abs/1910.13461. · arXiv
  18. Devlin, J., Chang, M-W., Lee, K., Toutanova, K., BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, arXiv preprint arXiv:1810.04805, 2019. · arXiv
  19. Sanh, V., Debut, L., Chaumond, J., Wolf, T., DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter, arXiv preprint arXiv:1910.01108, 2020. · arXiv
  20. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V., RoBERTa: A Robustly Optimized BERT Pretraining Approach, arXiv preprint arXiv:1907.11692, 2019. · arXiv
  21. Sherstinsky, A., Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) network, Physica D: Nonlinear Phenomena, 404, pp.132306, Elsevier BV, 2020.
  22. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al., GPT-4 Technical Report, arXiv preprint arXiv:2303.08774, 2023. · arXiv
  23. Bran, A. M., Cox, S., Schilter, O., Baldassari, C., White, A. D., Schwaller, P., ChemCrow: Augmenting large-language models with chem- istry tools, arXiv preprint arXiv:2304.05376, 2023. · arXiv
  24. Liao, H., Du, Q., Hu, S., He, H., Xu, Y., Tian, J., Jin, Y., Model- ing Complex Mathematical Reasoning via Large Language Model based MathAgent, arXiv preprint arXiv:2312.08926, 2023. · arXiv
  25. Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., Liu, J., Awadallah, A. H., White, R. W., Burger, D., Wang, C., AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation, arXiv preprint arXiv:2308.08155, 2023. · arXiv
  26. Kang, S., Yoon, J., Yoo, S., Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproduction, arXiv preprint arXiv:2209.11515, 2023. · arXiv
  27. Cui, J., Li, Z., Yan, Y., Chen, B., Yuan, L., ChatLaw: Open-Source Legal Large Language Model with Integrated External Knowledge Bases, arXiv preprint arXiv:2306.16092, 2023. · arXiv
  28. Zhang, C., Yang, K., Hu, S., Wang, Z., Li, G., Sun, Y., Zhang, C., Zhang, Z., Liu, A., Zhu, S-C., Chang, X., Zhang, J., Yin, F., Liang, Y., Yang, Y., ProAgent: Building Proactive Cooperative Agents with Large Language Models, arXiv preprint arXiv:2308.11339, 2024. · arXiv
  29. Anjomshoae, S., Najjar, A., Calvaresi, D., Främling, K., Explainable agents and robots: Results from a systematic literature review, In 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2019), Montreal, Canada, May 13-17, 2019 (pp. 1078-1088), International Foundation for Autonomous Agents and Multiagent Systems, 2019.
  30. Crouse, M., Abdelaziz, I., Basu, K., Dan, S., Kumaravel, S., Fokoue, A., Kapanipathi, P., Lastras, L., Formally Specifying the High-Level Behavior of LLM-Based Agents, arXiv preprint arXiv:2310.08535, 2023. · arXiv
  31. Barua, S., Momen, S., KAXAI: An Integrated Environment for Knowl- edge Analysis and Explainable AI, arXiv preprint arXiv:2401.00193, 2023. · arXiv
  32. Hu, Z., Iscen, A., Sun, C., Chang, K-W., Sun, Y., Ross, D. A., Schmid, C., Fathi, A., AVIS: Autonomous Visual Information Seeking with Large Language Model Agent, arXiv preprint arXiv:2306.08129, 2023. · arXiv
  33. Wang, J., Liu, Z., Zhao, L., Wu, Z., Ma, C., Yu, S., Dai, H., Yang, Q., Liu, Y., Zhang, S., Shi, E., Pan, Y., Zhang, T., Zhu, D., Li, X., Jiang, X., Ge, B., Yuan, Y., Shen, D., Liu, T., Zhang, S., Review of Large Vision Models and Visual Prompt Engineering, arXiv preprint arXiv:2307.00855, 2023. · arXiv
  34. Zhou, X., Liu, M., Zagar, B. L., Yurtsever, E., Knoll, A. C., Vision Language Models in Autonomous Driving and Intelligent Transportation Systems, arXiv preprint arXiv:2310.14414, 2023. · arXiv
  35. Zhang, Y., Han, W., Qin, J., Wang, Y., Bapna, A., Chen, Z., Chen, N., Li, B., Axelrod, V., Wang, G., Meng, Z., Hu, K., Rosenberg, A., Prabhavalkar, R., Park, D. S., Haghani, P., Riesa, J., Perng, G., Soltau, H., Strohman, T., Ramabhadran, B., Sainath, T., Moreno, P., Chiu, C-C., Schalkwyk, J., Beaufays, F., Wu, Y., Google USM: Scaling Au- tomatic Speech Recognition Beyond 100 Languages, arXiv preprint arXiv:2303.01037, 2023. · arXiv
  36. Shu, Y., Dong, S., Chen, G., Huang, W., Zhang, R., Shi, D., Xiang, Q., Shi, Y., LLaSM: Large Language and Speech Model, arXiv preprint arXiv:2308.15930, 2023. · arXiv
  37. Fathullah, Y., Wu, C., Lakomkin, E., Jia, J., Shangguan, Y., Li, K., Guo, J., Xiong, W., Mahadeokar, J., Kalinli, O., Fuegen, C., Seltzer, M., Prompting Large Language Models with Speech Recognition Abilities, arXiv preprint arXiv:2307.11795, 2023. · arXiv
  38. Bongard, J. C., Biologically Inspired Computing, Computer, 42(4), pp.95-98, 2009.
  39. Guo, J., Li, N., Qi, J., Yang, H., Li, R., Feng, Y., Zhang, S., Xu, M., Empowering Working Memory for Large Language Model Agents, arXiv preprint arXiv:2312.17259, 2023. · arXiv
  40. Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gon- zalez, J. E., Zhang, H., Stoica, I., Efficient Memory Management for Large Language Model Serving with PagedAttention, arXiv preprint arXiv:2309.06180, 2023. · arXiv
  41. Packer, C., Fang, V., Patil, S. G., Lin, K., Wooders, S., Gonzalez, J. E., MemGPT: Towards LLMs as Operating Systems, arXiv preprint arXiv:2310.08560, 2023. · arXiv
  42. Alizadeh, K., Mirzadeh, I., Belenko, D., Khatamifard, K., Cho, M., Del Mundo, C. C., Rastegari, M., Farajtabar, M., LLM in a flash: Efficient Large Language Model Inference with Limited Memory, arXiv preprint arXiv:2312.11514, 2024. · arXiv
  43. Modarressi, A., Imani, A., Fayyaz, M., Schütze, H., RET-LLM: Towards a General Read-Write Memory for Large Language Models, arXiv preprint arXiv:2305.14322, 2023. · arXiv
  44. Huang, J., Zhang, X., Mei, Q., Ma, J., Can LLMs Effectively Lever- age Graph Structural Information: When and Why, arXiv preprint arXiv:2309.16595, 2023. · arXiv
  45. Guo, J., Du, L., Liu, H., Zhou, M., He, X., Han, S., GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Em- pirical Evaluation and Benchmarking, arXiv preprint arXiv:2305.15066, 2023. · arXiv
  46. Ning, X., Lin, Z., Zhou, Z., Wang, Z., Yang, H., Wang, Y., Skeleton- of-Thought: Large Language Models Can Do Parallel Decoding, arXiv preprint arXiv:2307.15337, 2023. · arXiv
  47. Xie, Y., Yu, C., Zhu, T., Bai, J., Gong, Z., Soh, H., Translating Natural Language to Planning Goals with Large-Language Models, arXiv preprint arXiv:2302.05128, 2023. · arXiv
  48. Yuan, S., Song, K., Chen, J., Tan, X., Shen, Y., Kan, R., Li, D., Yang, D., EASYTOOL: Enhancing LLM-based Agents with Concise Tool In- struction, arXiv preprint arXiv:2401.06201, 2024. · arXiv
  49. Cai, T., Wang, X., Ma, T., Chen, X., Zhou, D., Large Language Models as Tool Makers, arXiv preprint arXiv:2305.17126, 2023. · arXiv
  50. Trinh, T. H., Wu, Y., Le, Q. V., He, H., Luong, T., Solving olympiad geometry without human demonstrations, Nature, 625(7995), pp.476-482, Nature Publishing Group, 2024.
  51. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., Zhou, D., Chain-of-Thought Prompting Elicits Reasoning in Large Language Models, arXiv preprint arXiv:2201.11903, 2023. · arXiv
  52. Shen, Y., Song, K., Tan, X., Li, D., Lu, W., Zhuang, Y., HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face, arXiv preprint arXiv:2303.17580, 2023. · arXiv
  53. Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., Liu, T., A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions, arXiv preprint arXiv:2311.05232, 2023. · arXiv
  54. Zheng, C., Liu, Z., Xie, E., Li, Z., Li, Y., Progressive-Hint Prompt- ing Improves Reasoning in Large Language Models, arXiv preprint arXiv:2304.09797, 2023. · arXiv
  55. Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., Narasimhan, K., Tree of Thoughts: Deliberate Problem Solving with Large Language Models, arXiv preprint arXiv:2305.10601, 2023. · arXiv
  56. Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowd- hery, A., Zhou, D., Self-Consistency Improves Chain of Thought Reasoning in Language Models, arXiv preprint arXiv:2203.11171, 2023. · arXiv
  57. Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Gianinazzi, L., Gajda, J., Lehmann, T., Podstawski, M., Niewiadomski, H., Nyczyk, P., Hoefler, T., Graph of Thoughts: Solving Elaborate Problems with Large Language Models, arXiv preprint arXiv:2308.09687, 2023. · arXiv
  58. Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., Cao, Y., ReAct: Synergizing Reasoning and Acting in Language Models, arXiv preprint arXiv:2210.03629, 2023. · arXiv
  59. Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., Yao, S., Reflexion: Language Agents with Verbal Reinforcement Learning, arXiv preprint arXiv:2303.11366, 2023. · arXiv
  60. Ziegler, D. M., Stiennon, N., Wu, J., Brown, T. B., Radford, A., Amodei, D., Christiano, P., Irving, G., Fine-tuning language models from human preferences, arXiv preprint arXiv:1909.08593, 2019. · arXiv
  61. Rafailov, R., Sharma, A., Mitchell, E., Ermon, S., Manning, C. D., Finn, C., Direct Preference Optimization: Your Language Model is Secretly a Reward Model, arXiv preprint arXiv:2305.18290, 2023. · arXiv
  62. Zhong, W., Guo, L., Gao, Q., Ye, H., Wang, Y., MemoryBank: En- hancing Large Language Models with Long-Term Memory, arXiv preprint arXiv:2305.10250, 2023. · arXiv
  63. Gienapp, L., Scells, H., Deckers, N., Bevendorff, J., Wang, S., Kiesel, J., Syed, S., Fröbe, M., Zuccon, G., Stein, B., Hagen, M., Potthast, M., Evaluating Generative Ad Hoc Information Retrieval, arXiv preprint arXiv:2311.04694, 2023. · arXiv
  64. Paranjape, B., Lundberg, S., Singh, S., Hajishirzi, H., Zettlemoyer, L., Ribeiro, M. T., ART: Automatic multi-step reasoning and tool-use for large language models, arXiv preprint arXiv:2303.09014, 2023. · arXiv
  65. Diao, S., Wang, P., Lin, Y., Zhang, T., Active Prompting with Chain- of-Thought for Large Language Models, arXiv preprint arXiv:2302.12246, 2023. · arXiv
  66. Li, Z., Peng, B., He, P., Galley, M., Gao, J., Yan, X., Guiding Large Language Models via Directional Stimulus Prompting, In NeurIPS 2023, 2023.
  67. Wu, X., Zhou, K., Sun, M., Wang, X., Liu, N., A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges, arXiv preprint arXiv:2303.07275, 2023. · arXiv
  68. Liu, X., Sun, T., Huang, X., Qiu, X., Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts, arXiv preprint arXiv:2210.11292, 2022. · arXiv
  69. Li, X. L., Liang, P., Prefix-Tuning: Optimizing Continuous Prompts for Generation, arXiv preprint arXiv:2101.00190, 2021. · arXiv
  70. Huang, Q., Dong, X., Chen, D., Zhang, W., Wang, F., Hua, G., Yu, N., Diversity-Aware Meta Visual Prompting, arXiv preprint arXiv:2303.08138, 2023. · arXiv
  71. Gu, J., Han, Z., Chen, S., Beirami, A., He, B., Zhang, G., Liao, R., Qin, Y., Tresp, V., Torr, P., A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models, arXiv preprint arXiv:2307.12980, 2023. · arXiv
  72. Mishra, M., Kumar, P., Bhat, R., Murthy, R. V., Contractor, D., Tamil- selvam, S., Prompting with Pseudo-Code Instructions, arXiv preprint arXiv:2305.11790, 2023. · arXiv
  73. Hu, A., Shi, Y., Xu, H., Ye, J., Ye, Q., Yan, M., Li, C., Qian, Q., Zhang, J., Huang, F., mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Model, arXiv preprint arXiv:2311.18248, 2024. · arXiv
  74. Koziolek, H., Koziolek, A., LLM-based Control Code Generation using Image Recognition, arXiv preprint arXiv:2311.10401, 2023. · arXiv
  75. Kirk, J. R., Wray, R. E., Lindes, P., Improving Knowledge Extraction from LLMs for Task Learning through Agent Analysis, arXiv preprint arXiv:2306.06770, 2023. · arXiv
  76. Guo, J., Li, J., Li, D., Tiong, A., Li, B., Tao, D., HOI, S., From Images to Textual Prompts: Zero-shot VQA with Frozen Large Language Models, OpenReview preprint https://openreview.net/forum?id=Ck1UtnVukP8, 2023.
  77. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., Polosukhin, I., Attention Is All You Need, arXiv preprint arXiv:1706.03762, 2023. · arXiv
  78. Xiao, G., Tian, Y., Chen, B., Han, S., Lewis, M., Efficient Streaming Language Models with Attention Sinks, arXiv preprint arXiv:2309.17453, 2023. · arXiv
  79. Wang, Q., Ding, L., Cao, Y., Tian, Z., Wang, S., Tao, D., Guo, L., Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models, arXiv preprint arXiv:2308.15022, 2023. · arXiv
  80. Liu, J., Liu, A., Lu, X., Welleck, S., West, P., Le Bras, R., Choi, Y., Hajishirzi, H., Generated Knowledge Prompting for Commonsense Rea- soning, arXiv preprint arXiv:2110.08387, 2022. · arXiv
  81. Friedman, L., Ahuja, S., Allen, D., Tan, Z., Sidahmed, H., Long, C., Xie, J., Schubiner, G., Patel, A., Lara, H., Chu, B., Chen, Z., Tiwari, M., Leveraging Large Language Models in Conversational Recommender Systems, arXiv preprint arXiv:2305.07961, 2023. · arXiv
  82. Paper, D., Paper, D., Increase the Diversity of Your Dataset with Data Augmentation, State-of-the-Art Deep Learning Models in Tensor- Flow: Modern Machine Learning in the Google Colab Ecosystem, pp.37- 64, Springer, 2021.
  83. Wei, Z., Wang, Y., Wang, Y., Jailbreak and Guard Aligned Lan- guage Models with Only Few In-Context Demonstrations, arXiv preprint arXiv:2310.06387, 2023. · arXiv
  84. Friedman, D., Dieng, A. B., The Vendi Score: A Diversity Evaluation Metric for Machine Learning, arXiv preprint arXiv:2210.02410, 2023. · arXiv
  85. Perez, F., Ribeiro, I., Ignore previous prompt: Attack techniques for language models, arXiv preprint arXiv:2211.09527, 2022. · arXiv
  86. Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M. C., Huang, P., Neu- big, G., Zhou, S., Salakhutdinov, R., Fried, D., VisualWebArena: Evalu- ating Multimodal Agents on Realistic Visual Web Tasks, arXiv preprint arXiv:2401.13649, 2024. · arXiv
  87. Fan, H., Liu, X., Fuh, J. Y. H., Lu, W. F., Li, B., Embodied intelligence in manufacturing: leveraging large language models for autonomous in- dustrial robotics, Journal of Intelligent Manufacturing, pp.1-17, Springer, 2024.
  88. Guo, T., Chen, X., Wang, Y., Chang, R., Pei, S., Chawla, N. V., Wiest, O., Zhang, X., Large Language Model based Multi-Agents: A Survey of Progress and Challenges, arXiv preprint arXiv:2402.01680, 2024. · arXiv
  89. Fu, D., Lei, W., Wen, L., Cai, P., Mao, S., Dou, M., Shi, B., Qiao, Y., LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving, arXiv preprint arXiv:2402.01246, 2024. · arXiv
  90. Wang, Y., Zhong, W., Li, L., Mi, F., Zeng, X., Huang, W., Shang, L., Jiang, X., Liu, Q., Aligning Large Language Models with Human: A Survey, arXiv preprint arXiv:2307.12966, 2023. · arXiv
  91. Tian, Y., Yang, X., Zhang, J., Dong, Y., Su, H., Evil Geniuses: Delving into the Safety of LLM-based Agents, arXiv preprint arXiv:2311.11855, 2024. · arXiv
  92. Arabzadeh, N., Kiseleva, J., Wu, Q., Wang, C., Awadallah, A., Dibia, V., Fourney, A., Clarke, C., Towards better Human-Agent Alignment: Assessing Task Utility in LLM-Powered Applications, arXiv preprint arXiv:2402.09015, 2024. · arXiv
  93. Guan, X., Liu, Y., Lin, H., Lu, Y., He, B., Han, X., Sun, L., Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph- based Retrofitting, arXiv preprint arXiv:2311.13314, 2023. · arXiv
  94. Yao, J., Ning, K., Liu, Z., Ning, M., Yuan, L., LLM Lies: Hallucina- tions are not Bugs, but Features as Adversarial Examples, arXiv preprint arXiv:2310.01469, 2023. · arXiv
  95. Ahmad, M. A., Yaramis, I., Dutta Roy, T., Creating Trustworthy LLMs: Dealing with Hallucinations in Healthcare AI, arXiv preprint arXiv:2311.01463, 2023. · arXiv
  96. Nascimento, N., Alencar, P., Cowan, D., Self-Adaptive Large Language Model (LLM)-Based Multiagent Systems, arXiv preprint arXiv:2307.06187, 2023. · arXiv
  97. Tang, X., Jin, Q., Zhu, K., Yuan, T., Zhang, Y., Zhou, W., Qu, M., Zhao, Y., Tang, J., Zhang, Z., Cohan, A., Lu, Z., Gerstein, M., Prioritizing Safeguarding Over Autonomy: Risks of LLM Agents for Science, arXiv preprint arXiv:2402.04247, 2024. · arXiv
  98. Lu, J., Pan, B., Chen, J., Feng, Y., Hu, J., Peng, Y., Chen, W., AgentLens: Visual Analysis for Agent Behaviors in LLM-based Au- tonomous Systems, arXiv preprint arXiv:2402.08995, 2024. · arXiv
  99. Lanus, E., Hernandez, I., Dachowicz, A., Freeman, L. J., Grande, M., Lang, A., Panchal, J. H., Patrick, A., Welch, S., Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents, In 2021 16th International Conference of System of Systems Engineering (SoSE), IEEE, 2021.
  100. Kinniment, M., Sato, L. J. K., Du, H., Goodrich, B., Hasin, M., Chan, L., Miles, L. H., Lin, T. R., Wijk, H., Burget, J., Ho, A., Barnes, E., Chris- tiano, P., Evaluating Language-Model Agents on Realistic Autonomous Tasks, arXiv preprint arXiv:2312.11671, 2024. · arXiv
  101. Lanus, E., Hernandez, I., Dachowicz, A., Freeman, L. J., Grande, M., Lang, A., Panchal, J. H., Patrick, A., Welch, S., Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents, In 2021 16th International Conference of System of Systems Engineering (SoSE), pp.203-209, IEEE, 2021.
  102. Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., Zheng, R., Fan, X., Wang, X., Xiong, L., Zhou, Y., Wang, W., Jiang, C., Zou, Y., Liu, X., Yin, Z., Dou, S., Weng, R., Cheng, W., Zhang, Q., Qin, W., Zheng, Y., Qiu, X., Huang, X., Gui, T., The Rise and Potential of Large Language Model Based Agents: A Survey, arXiv preprint arXiv:2309.07864, 2023. · arXiv
  103. Huang, X., Liu, W., Chen, X., Wang, X., Wang, H., Lian, D., Wang, Y., Tang, R., Chen, E., Understanding the planning of LLM agents: A survey, arXiv preprint arXiv:2402.02716, 2024. · arXiv
  104. Liu, X., Yu, H., Zhang, H., Xu, Y., Lei, X., Lai, H., Gu, Y., Ding, H., Men, K., Yang, K., Zhang, S., Deng, X., Zeng, A., Du, Z., Zhang, C., Shen, S., Zhang, T., Su, Y., Sun, H., Huang, M., Dong, Y., Tang, J., Agent- Bench: Evaluating LLMs as Agents, arXiv preprint arXiv:2308.03688, 2023. · arXiv
  105. Feldt, R., Kang, S., Yoon, J., Yoo, S., Towards Autonomous Test- ing Agents via Conversational Large Language Models, arXiv preprint arXiv:2306.05152, 2023. · arXiv
  106. Schwartz, S., Yaeli, A., Shlomov, S., Enhancing Trust in LLM-Based AI Automation Agents: New Considerations and Future Challenges, arXiv preprint arXiv:2308.05391, 2023. · arXiv
  107. Zhou, S., Xu, F. F., Zhu, H., Zhou, X., Lo, R., Sridhar, A., Cheng, X., Ou, T., Bisk, Y., Fried, D., Alon, U., Neubig, G., WebArena: A Real- istic Web Environment for Building Autonomous Agents, arXiv preprint arXiv:2307.13854, 2023. · arXiv
  108. Qin, Y., Liang, S., Ye, Y., Zhu, K., Yan, L., Lu, Y., Lin, Y., Cong, X., Tang, X., Qian, B., Zhao, S., Tian, R., Xie, R., Zhou, J., Gerstein, M., Li, D., Liu, Z., Sun, M., ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs, arXiv preprint arXiv:2307.16789, 2023. · arXiv

Cited by

Sorted by citations

Authors
Barua, S.
Affiliations
North South University (BD)
Corresponding author
Barua, Saikat
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2404.04442
arXiv
2404.04442
OpenAlex
W4394708597
Cited by
11
References
0
Citations by year
2026: 4 · 2025: 5 · 2024: 2
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords
large language models, autonomous agents, agent-based AI, multimodality, value alignment, hallucinations, agent evaluation, prompting, reasoning, tool use, in-context learning, WebArena

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review