CoChat
Sign Up
PreprintCited by 32Software Engineering ResearchSoftware Engineering Techniques and PracticesArtificial Intelligence Applications

The DOI matches its DataCite record; 6 of the 6 references it cites were found in a registry or an index.

Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI

Open access
Sapkota, Ranjan, Roumeliotis, Konstantinos I., Karkee, Manoj·2025·arXiv
DOI 10.48550/arxiv.2505.19443arXiv 2505.19443
Open this paper in CoChat — free accountOpen PDF

Abstract

This review presents a comprehensive analysis of two emerging paradigms in AI-assisted software development: vibe coding and agentic coding. While both leverage large language models (LLMs), they differ fundamentally in autonomy, architectural design, and the role of the developer. Vibe coding emphasizes intuitive, human-in-the-loop interaction through prompt-based, conversational workflows that support ideation, experimentation, and creative exploration. In contrast, agentic coding enables autonomous software development through goal-driven agents capable of planning, executing, testing, and iterating tasks with minimal human intervention. We propose a detailed taxonomy spanning conceptual foundations, execution models, feedback loops, safety mechanisms, debugging strategies, and real-world tool ecosystems. Through comparative workflow analysis and 20 detailed use cases, we illustrate how vibe systems thrive in early-stage prototyping and education, while agentic systems excel in enterprise-grade automation, codebase refactoring, and CI/CD integration. We further examine emerging trends in hybrid architectures, where natural language interfaces are coupled with autonomous execution pipelines. Finally, we articulate a future roadmap for agentic AI, outlining the infrastructure needed for trustworthy, explainable, and collaborative systems. Our findings suggest that successful AI software engineering will rely not on choosing one paradigm, but on harmonizing their strengths within a unified, human-centered development lifecycle.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2505.19443

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Fully autonomous software development, predictive incident detection, IT automation, and other tasks do not require a fully autonomous agent to decompose prompts, write and test code, integrate third-party APIs, optimize resource use and performance, manage Git workflows, or manage incidents using coordinated multi-agent planning.

    “Fully autonomous software development, predictive incident detection, IT automation, and other tasks do not require a fully autonomous agent to decompose prompts, write and test code, integrate third-party APIs, optimize resource use and performance, manage Git workflows, or manage incidents using coordinated multi-agent planning [49,51,118].”

    From The Rise of Agentic AI: A Review of Definitions, Frameworks, Architectures, Applications, Evaluation Metrics, and Challenges (2025) · cites this paper as [51]

    The Agentic Coding and AI Autonomy Level sections describe autonomous or semi-autonomous agents that plan tasks, write and test code, use APIs, and work with Git, so the paper does not make full autonomy a prerequisite for those capabilities. Automated Rollback and Recovery describes detecting critical errors and responding to incidents, but not predictive incident detection or incident management through coordinated multi-agent planning. Multi-Agent Collaboration and Specialization discusses resource optimization as a prospective benefit, not an established capability across the listed tasks. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Once code is placed inside the agent loop, the model must not only generate text, but also search repositories, edit code, execute tests, call APIs, query documentation, and verify intermediate results.

    “Once code is placed inside the agent loop, the model must not only generate text, but also search repositories, edit code, execute tests, call APIs, query documentation, and verify intermediate results [218, 219].”

    From Code as Agent Harness (2026) · cites this paper as [219]

  • Code files, including .cs files, represent an input to AI agents like Codex that modify codebases or create Git diffs and logs to allow for agentic autonomous software maintenance and version tracking.

    “Code files, including .cs files, represent an input to AI agents like Codex that modify codebases or create Git diffs and logs to be able to allow for agentic to autonomous software maintenance and version tracking [51].”

    From The Rise of Agentic AI: A Review of Definitions, Frameworks, Architectures, Applications, Evaluation Metrics, and Challenges (2025) · cites this paper as [51]

  • Runtime monitoring is a live, ongoing test to find how well the system is running in real time.

    “Runtime monitoring [51] is a live, ongoing test to find how well the system is running in real time.”

    From The Rise of Agentic AI: A Review of Definitions, Frameworks, Architectures, Applications, Evaluation Metrics, and Challenges (2025) · cites this paper as [51]

  • For agentic coding systems like Codex (OpenAI) and Google Jules, robustness is tested via sandboxed execution, traceability, and rollback.

    “For agentic coding systems like Codex (OpenAI) [51] and Google Jules [51], robustness is tested via sandboxed execution, traceability, and rollback.”

    From The Rise of Agentic AI: A Review of Definitions, Frameworks, Architectures, Applications, Evaluation Metrics, and Challenges (2025) · cites this paper as [51]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 249

  1. M. Chow and O. Ng, "From technology adopters to creators: Leveraging ai-assisted vibe coding to transform clinical teaching and learning," Medical Teacher, pp. 1-3, 2025.
  2. D. Weise and R. Crew, "Programmable syntax macros," in Proceedings of the ACM SIGPLAN 1993 conference on Pro- gramming language design and implementation, pp. 156-165, 1993.
  3. B. McCane, C. Ott, N. Meek, and A. Robins, "Mastery learning in introductory programming," in Proceedings of the nineteenth australasian computing education conference, pp. 1-10, 2017.
  4. A. Luxton-Reilly, B. A. Becker, Y. Cao, R. McDermott, C. Mirolo, A. Mühling, A. Petersen, K. Sanders, Simon, and J. Whalley, "Developing assessments to determine mastery of programming fundamentals," in Proceedings of the 2017 ITiCSE Conference on Working Group Reports, pp. 47-69, 2018.
  5. J. Condit, M. Harren, Z. Anderson, D. Gay, and G. C. Necula, "Dependent types for low-level programming," in Programming Languages and Systems: 16th European Symposium on Pro- gramming, ESOP 2007, Held as Part of the Joint European Conferences on Theory and Practics of Software, ETAPS 2007, Braga, Portugal, March 24-April 1, 2007. Proceedings 16, pp. 520-535, Springer, 2007.
  6. J. Protzenko, J.-K. Zinzindohoué, A. Rastogi, T. Ramananandro, P. Wang, S. Zanella-Béguelin, A. Delignat-Lavaud, C. Hrit ¸cu, K. Bhargavan, C. Fournet, et al., "Verified low-level program- ming embedded in f," Proceedings of the ACM on Programming Languages, vol. 1, no. ICFP, pp. 1-29, 2017.
  7. M. Balliu, M. Dam, and R. Guanciale, "Automating information flow analysis of low level code," in Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security, pp. 1080-1091, 2014.
  8. A. Gadde, "Democratizing software engineering through gen- erative ai and vibe coding: The evolution of no-code develop- ment," Journal of Computer Science and Technology Studies, vol. 7, no. 4, pp. 556-572, 2025.
  9. J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, et al., "Gpt-4 technical report," arXiv preprint arXiv:2303.08774, 2023. · arXiv
  10. J. L. Fiadeiro, Categories for software engineering. Springer Science & Business Media, 2005.
  11. T. Givón, "Iconicity, isomorphism, and non-arbitrary coding in syntax," in Iconicity in syntax, pp. 187-220, John Benjamins Publishing Company, 2011.
  12. F. Maiorana, D. Giordano, and R. Morelli, "Quizly: A live coding assessment platform for app inventor," in 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond), pp. 25-30, IEEE, 2015.
  13. D. A. Tamburri, P. Lago, and H. v. Vliet, "Organizational social structures for software engineering," ACM Computing Surveys (CSUR), vol. 46, no. 1, pp. 1-35, 2013.
  14. P. Dourish, "Algorithms and their others: Algorithmic cul- ture in context," Big Data & Society, vol. 3, no. 2, p. 2053951716665128, 2016.
  15. A. D. Gordon, T. A. Henzinger, A. V. Nori, and S. K. Rajamani, "Probabilistic programming," in Future of software engineering proceedings, pp. 167-181, ACM, 2014.
  16. D. Jenson and M. Riedel, "A deterministic approach to stochas- tic computation," in 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD), pp. 1-8, IEEE, 2016.
  17. B. Liskavets, M. Ushakov, S. Roy, M. Klibanov, A. Etemad, and S. K. Luke, "Prompt compression with context-aware sentence encoding for fast and improved llm inference," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, pp. 24595-24604, 2025.
  18. Y. Li, Y. Peng, Y. Huo, and M. R. Lyu, "Enhancing llm-based coding tools through native integration of ide-derived static context," in Proceedings of the 1st International Workshop on Large Language Models for Code, pp. 70-74, 2024.
  19. R. Sapkota, K. I. Roumeliotis, and M. Karkee, "Ai agents vs. agentic ai: A conceptual taxonomy, applications and chal- lenges," arXiv preprint arXiv:2505.10468, 2025. · arXiv
  20. J. Pöhler, N. Flegel, T. Mentler, and K. Van Laerhoven, "Keeping the human in the loop: are autonomous decisions inevitable?," i-com, vol. 24, no. 1, pp. 9-25, 2025.
  21. U. M. Borghoff, P. Bottoni, and R. Pareschi, "Human-artificial interaction in the age of agentic ai: a system-theoretical ap- proach," Frontiers in Human Dynamics, vol. 7, p. 1579166, 2025.
  22. F. Bousetouane, "Agentic systems: A guide to transform- ing industries with vertical ai agents," arXiv preprint arXiv:2501.00881, 2025. · arXiv
  23. J. Yuan, K. Miao, H. Oh, I. Walker, Z. Xue, T. Katolikyan, and M. Cavallo, "Vibe: A visual analytics workflow for semantic error analysis of cvml models at subgroup level," in Proceed- ings of the 30th International Conference on Intelligent User Interfaces, pp. 1529-1547, 2025.
  24. M. Yin and R. Xiao, "Vibes: Exploring viewer spatial interac- tions as direct input for livestreamed content," arXiv preprint arXiv:2504.09016, 2025. · arXiv
  25. T. De Jong, "Learning and instruction with computer simula- tions," Education and Computing, vol. 6, no. 3-4, pp. 217-229, 1991.
  26. W. D. Maurer, "A theory of computer instructions," Science of Computer Programming, vol. 60, no. 3, pp. 244-273, 2006.
  27. L. K. Smetana and R. L. Bell, "Computer simulations to support science instruction and learning: A critical review of the literature," International Journal of Science Education, vol. 34, no. 9, pp. 1337-1370, 2012.
  28. D. Nam, A. Macvean, V. Hellendoorn, B. Vasilescu, and B. Myers, "Using an llm to help with code understanding," in Proceedings of the IEEE/ACM 46th International Conference on Software Engineering, pp. 1-13, 2024.
  29. H. Liao, H. Shen, Z. Li, C. Wang, G. Li, Y. Bie, and C. Xu, "Gpt-4 enhanced multimodal grounding for autonomous driving: Leveraging cross-modal attention with large language models," Communications in Transportation Research, vol. 4, p. 100116, 2024.
  30. T. Coignion, C. Quinton, and R. Rouvoy, "A performance study of llm-generated code on leetcode," in Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering, pp. 79-89, 2024.
  31. Z. Rasheed, M. A. Sami, M. Waseem, K.-K. Kemell, X. Wang, A. Nguyen, K. Systä, and P. Abrahamsson, "Ai- powered code review with llms: Early results," arXiv preprint arXiv:2404.18496, 2024. · arXiv
  32. J. Wang and Y. Chen, "A review on code generation with llms: Application and evaluation," in 2023 IEEE International Conference on Medical Artificial Intelligence (MedAI), pp. 284- 289, IEEE, 2023.
  33. L. Fichtel, M. Spliethöver, E. Hüllermeier, P. Jimenez, N. Klowait, S. Kopp, A.-C. N. Ngomo, A. Robrecht, I. Scharlau, L. Terfloth, et al., "Investigating co-constructive behavior of large language models in explanation dialogues," arXiv preprint arXiv:2504.18483, 2025. · arXiv
  34. B. Meskó, "Prompt engineering as an important emerging skill for medical professionals: tutorial," Journal of medical Internet research, vol. 25, p. e50638, 2023.
  35. J. White, Q. Fu, S. Hays, M. Sandborn, C. Olea, H. Gilbert, A. Elnashar, J. Spencer-Smith, and D. C. Schmidt, "A prompt pattern catalog to enhance prompt engineering with chatgpt," arXiv preprint arXiv:2302.11382, 2023. · arXiv
  36. E. Y. Chang, "Prompting large language models with the socratic method," in 2023 IEEE 13th annual computing and communication workshop and conference (CCWC), pp. 0351- 0360, IEEE, 2023.
  37. A. Alfageeh, S. A. K. Zarkouei, D. Nam, D. Prol, M. Amoozadeh, S. Chattopadhyay, J. Prather, P. Denny, J. Leinonen, M. Hilton, et al., "From prompts to propositions: A logic-based lens on student-llm interactions," arXiv preprint arXiv:2504.18691, 2025. · arXiv
  38. Z. Xiao, D. Zhang, X. Han, X. Fu, W. Y. Yu, T. Zhong, S. Wu, Y. Wang, J. Yin, and G. Chen, "Enhancing llm reasoning via vision-augmented prompting," Advances in Neural Information Processing Systems, vol. 37, pp. 28772-28797, 2024.
  39. J. Gao, S. A. Gebreegziabher, K. T. W. Choo, T. J.-J. Li, S. T. Perrault, and T. W. Malone, "A taxonomy for human-llm inter- action modes: An initial exploration," in Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pp. 1-11, 2024.
  40. X. Ma, S. Mishra, A. Liu, S. Y. Su, J. Chen, C. Kulkarni, H.- T. Cheng, Q. Le, and E. Chi, "Beyond chatbots: Explorellm for structured thoughts and personalized model responses," in Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pp. 1-12, 2024.
  41. Y.-M. Yan, C.-Q. Chen, Y.-B. Hu, and X.-D. Ye, "Llm-based collaborative programming: impact on students' computational thinking and self-efficacy," Humanities and Social Sciences Communications, vol. 12, no. 1, pp. 1-12, 2025.
  42. A. Xenakis, I. Dimos, M. Feidakis, D. Sotiropoulos, K. Kalovrektis, and G. Nikolaou, "An llm-based smart reposi- tory platform to support educators with computational thinking, ai, and stem activities," in Empowering STEM Educators With Digital Tools, pp. 107-136, IGI Global Scientific Publishing, 2025.
  43. D. Yang, T. Liu, D. Zhang, A. Simoulin, X. Liu, Y. Cao, Z. Teng, X. Qian, G. Yang, J. Luo, et al., "Code to think, think to code: A survey on code-enhanced reasoning and reasoning-driven code intelligence in llms," arXiv preprint arXiv:2502.19411, 2025. · arXiv
  44. H. Subramonyam, R. Pea, C. Pondoc, M. Agrawala, and C. Seifert, "Bridging the gulf of envisioning: Cognitive chal- lenges in prompt based interactions with llms," in Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, pp. 1-19, 2024.
  45. T. Wu, J. Lan, W. Yuan, J. Jiao, J. Weston, and S. Sukhbaatar, "Thinking llms: General instruction following with thought generation," arXiv preprint arXiv:2410.10630, 2024. · arXiv
  46. H. Xu and X.-Y. Yu, "From powerpoint ui sketches to web-based applications: Pattern-driven code generation for gis dashboard development using knowledge-augmented llms, context-aware visual prompting, and the react framework," arXiv preprint arXiv:2502.08756, 2025. · arXiv
  47. Y. Yigit, M. A. Ferrag, M. C. Ghanem, I. H. Sarker, L. A. Maglaras, C. Chrysoulas, N. Moradpoor, N. Tihanyi, and H. Janicke, "Generative ai and llms for critical infrastructure protection: evaluation benchmarks, agentic ai, challenges, and opportunities," Sensors, vol. 25, no. 6, p. 1666, 2025.
  48. A. Wei, N. Haghtalab, and J. Steinhardt, "Jailbroken: How does llm safety training fail?," Advances in Neural Information Processing Systems, vol. 36, pp. 80079-80110, 2023.
  49. Y. Mou, S. Zhang, and W. Ye, "Sg-bench: Evaluating llm safety generalization across diverse tasks and prompt types," Advances in Neural Information Processing Systems, vol. 37, pp. 123032- 123054, 2024.
  50. V.-A. P? durean, P. Denny, and A. Singla, "Bugspotter: Auto- mated generation of code debugging exercises," in Proceedings of the 56th ACM Technical Symposium on Computer Science Education V. 1, pp. 896-902, 2025.
  51. N. Jiang, X. Li, S. Wang, Q. Zhou, S. Hossain, B. Ray, V. Kumar, X. Ma, and A. Deoras, "Ledex: Training llms to better self-debug and explain code," Advances in Neural Information Processing Systems, vol. 37, pp. 35517-35543, 2024.
  52. R. Tian, Y. Ye, Y. Qin, X. Cong, Y. Lin, Y. Pan, Y. Wu, H. Hui, W. Liu, Z. Liu, et al., "Debugbench: Evaluating de- bugging capability of large language models," arXiv preprint arXiv:2401.04621, 2024. · arXiv
  53. C. Lee, C. S. Xia, L. Yang, J.-t. Huang, Z. Zhu, L. Zhang, and M. R. Lyu, "A unified debugging approach via llm-based multi-agent synergy," arXiv preprint arXiv:2404.17153, 2024. · arXiv
  54. S. An, Z. Ma, Z. Lin, N. Zheng, J.-G. Lou, and W. Chen, "Make your llm fully utilize the context," Advances in Neural Information Processing Systems, vol. 37, pp. 62160-62188, 2024.
  55. M. X. Liu, F. Liu, A. J. Fiannaca, T. Koo, L. Dixon, M. Terry, and C. J. Cai, "" we need structured output": Towards user- centered constraints on large language model output," in Ex- tended Abstracts of the CHI Conference on Human Factors in Computing Systems, pp. 1-9, 2024.
  56. S. Kapania, R. Wang, T. J.-J. Li, T. Li, and H. Shen, "'i'm categorizing llm as a productivity tool': Examining ethics of llm use in hci research practices," Proceedings of the ACM on Human-Computer Interaction, vol. 9, no. 2, pp. 1-26, 2025.
  57. X. Hou, Y. Zhao, Y. Liu, Z. Yang, K. Wang, L. Li, X. Luo, D. Lo, J. Grundy, and H. Wang, "Large language mod- els for software engineering: A systematic literature review," ACM Transactions on Software Engineering and Methodology, vol. 33, no. 8, pp. 1-79, 2024.
  58. M. R. Lyu, B. Ray, A. Roychoudhury, S. H. Tan, and P. Thong- tanunam, "Automatic programming: Large language models and beyond," ACM Transactions on Software Engineering and Methodology, 2024.
  59. S. Wijaya, J. Bolano, A. G. Soteres, S. Kode, Y. Huang, and A. Sahai, "Readme. llm: A framework to help llms understand your library," arXiv preprint arXiv:2504.09798, 2025. · arXiv
  60. M. Kumar, J. Xue, M. Zheng, and Q. Lou, "Tfhe-coder: Evaluat- ing llm-agentic fully homomorphic encryption code generation," arXiv preprint arXiv:2503.12217, 2025. · arXiv
  61. A. Roychoudhury, C. Pasareanu, M. Pradel, and B. Ray, "Agentic ai software engineer: Programming with trust," arXiv preprint arXiv:2502.13767, 2025. · arXiv
  62. G. Zhang, W. Liang, O. Hsu, and K. Olukotun, "Adaptive self- improvement llm agentic system for ml library development," arXiv preprint arXiv:2502.02534, 2025. · arXiv
  63. B. Lou, T. Lu, R. Santanam, and Y. Zhang, "Unraveling human-ai teaming: A review and outlook," arXiv preprint arXiv:2504.05755, 2025. · arXiv
  64. H. Shen, L. Shen, W. Wu, and K. Zhang, "Ideationweb: Track- ing the evolution of design ideas in human-ai co-creation," in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, pp. 1-19, 2025.
  65. W. Wang, H. Ning, G. Zhang, L. Liu, and Y. Wang, "Rocks coding, not development: A human-centric, experimental eval- uation of llm-supported se tasks," Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 699-721, 2024.
  66. A. Kasirzadeh and I. Gabriel, "Characterizing ai agents for alignment and governance," arXiv preprint arXiv:2504.21848, 2025. · arXiv
  67. M. Tufano, A. Agarwal, J. Jang, R. Z. Moghaddam, and N. Sundaresan, "Autodev: Automated ai-driven development," arXiv preprint arXiv:2403.08299, 2024. · arXiv
  68. P. J. Sager, B. Meyer, P. Yan, R. von Wartburg-Kottler, L. Etaiwi, A. Enayati, G. Nobel, A. Abdulkadir, B. F. Grewe, and T. Stadel- mann, "Ai agents for computer use: A review of instruction- based computer control, gui automation, and operator assis- tants," arXiv preprint arXiv:2501.16150, 2025. · arXiv
  69. H. Wen, Y. Li, G. Liu, S. Zhao, T. Yu, T. J.-J. Li, S. Jiang, Y. Liu, Y. Zhang, and Y. Liu, "Autodroid: Llm-powered task automation in android," in Proceedings of the 30th Annual International Conference on Mobile Computing and Networking, pp. 543- 557, 2024.
  70. M. Xu, "Every software as an agent: Blueprint and case study," arXiv preprint arXiv:2502.04747, 2025. · arXiv
  71. Q. Ma, W. Peng, C. Yang, H. Shen, K. Koedinger, and T. Wu, "What should we engineer in prompts? training humans in requirement-driven llm use," ACM Transactions on Computer- Human Interaction, 2025.
  72. T. Wu, E. Jiang, A. Donsbach, J. Gray, A. Molina, M. Terry, and C. J. Cai, "Promptchainer: Chaining large language model prompts through visual programming," in CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1-10, 2022.
  73. C. Qian, X. Cong, C. Yang, W. Chen, Y. Su, J. Xu, Z. Liu, and M. Sun, "Communicative agents for software development," arXiv preprint arXiv:2307.07924, vol. 6, no. 3, 2023. · arXiv
  74. J. Luo, W. Zhang, Y. Yuan, Y. Zhao, J. Yang, Y. Gu, B. Wu, B. Chen, Z. Qiao, Q. Long, et al., "Large language model agent: A survey on methodology, applications and challenges," arXiv preprint arXiv:2503.21460, 2025. · arXiv
  75. N. Krishnan, "Advancing multi-agent systems through model context protocol: Architecture, implementation, and applica- tions," arXiv preprint arXiv:2504.21030, 2025. · arXiv
  76. I. Habler, K. Huang, V. S. Narajala, and P. Kulkarni, "Building a secure agentic ai application leveraging a2a protocol," arXiv preprint arXiv:2504.16902, 2025. · arXiv
  77. A. Rath, "Structured prompting and feedback-guided rea- soning with llms for data interpretation," arXiv preprint arXiv:2505.01636, 2025. · arXiv
  78. S.-C. Dai, A. Xiong, and L.-W. Ku, "Llm-in-the-loop: Leverag- ing large language model for thematic analysis," arXiv preprint arXiv:2310.15100, 2023. · arXiv
  79. M. Kazemitabaar, X. Hou, A. Henley, B. J. Ericson, D. Wein- trop, and T. Grossman, "How novices use llm-based code generators to solve cs1 coding tasks in a self-paced learning environment," in Proceedings of the 23rd Koli calling interna- tional conference on computing education research, pp. 1-12, 2023.
  80. J. White, S. Hays, Q. Fu, J. Spencer-Smith, and D. C. Schmidt, "Chatgpt prompt patterns for improving code quality, refactor- ing, requirements elicitation, and software design," in Genera- tive ai for effective software development, pp. 71-108, Springer, 2024.
  81. J. Wang, Y. Dai, Y. Zhang, Z. Ma, W. Li, and J. Chai, "Training turn-by-turn verifiers for dialogue tutoring agents: The curious case of llms as your coding tutors," arXiv preprint arXiv:2502.13311, 2025. · arXiv
  82. H. Ding, Z. Fan, I. Guehring, G. Gupta, W. Ha, J. Huan, L. Liu, B. Omidvar-Tehrani, S. Wang, and H. Zhou, "Reasoning and planning with large language models in code development," in Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 6480-6490, 2024.
  83. M. A. Ferrag, N. Tihanyi, and M. Debbah, "From llm reasoning to autonomous ai agents: A comprehensive review," arXiv preprint arXiv:2504.19678, 2025. · arXiv
  84. R. Pan, H. Zhang, and C. Liu, "Codecor: An llm-based self- reflective multi-agent framework for code generation," arXiv preprint arXiv:2501.07811, 2025. · arXiv
  85. Z. Sun, H. Zhu, B. Xu, X. Du, L. Li, and D. Lo, "Llm as runtime error handler: A promising pathway to adaptive self-healing of software systems," arXiv preprint arXiv:2408.01055, 2024. · arXiv
  86. C. Guo, X. Liu, C. Xie, A. Zhou, Y. Zeng, Z. Lin, D. Song, and B. Li, "Redcode: Risky code execution and generation benchmark for code agents," Advances in Neural Information Processing Systems, vol. 37, pp. 106190-106236, 2024.
  87. R. Qiang, Y. Zhuang, Y. Li, R. Zhang, C. Li, I. S.-H. Wong, S. Yang, P. Liang, C. Zhang, B. Dai, et al., "Mle-dojo: In- teractive environments for empowering llm agents in machine learning engineering," arXiv preprint arXiv:2505.07782, 2025. · arXiv
  88. E. Poitras, B. Crane, and A. Siegel, "Generative ai in in- troductory programming instruction: Examining the assistance dilemma with llm-based code generators," in Proceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 1, pp. 186-192, 2024.
  89. A. Nunez, N. T. Islam, S. K. Jha, and P. Najafirad, "Autosafe- coder: A multi-agent framework for securing llm code gener- ation through static analysis and fuzz testing," arXiv preprint arXiv:2409.10737, 2024. · arXiv
  90. X. Song, Y. Wu, W. Wang, J. Liu, W. Su, and B. Zheng, "Progco: Program helps self-correction of large language mod- els," arXiv preprint arXiv:2501.01264, 2025. · arXiv
  91. A. Askari, C. Poelitz, and X. Tang, "Magic: Generating self- correction guideline for in-context text-to-sql," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, pp. 23433-23441, 2025.
  92. B. Wei, "Requirements are all you need: From requirements to code with llms," in 2024 IEEE 32nd International Requirements Engineering Conference (RE), pp. 416-422, IEEE, 2024.
  93. H. Fang, B. Han, N. Erickson, X. Zhang, S. Zhou, A. Dagar, J. Zhang, A. C. Turkmen, C. Hu, H. Rangwala, et al., "Mlzero: A multi-agent system for end-to-end machine learning automa- tion," arXiv preprint arXiv:2505.13941, 2025. · arXiv
  94. S. Agashe, J. Han, S. Gan, J. Yang, A. Li, and X. E. Wang, "Agent s: An open agentic framework that uses computers like a human," arXiv preprint arXiv:2410.08164, 2024. · arXiv
  95. E. Tzanis and M. E. Klontzas, "maistro: an open-source multi- agentic system for automated end-to-end development of ra- diomics and deep learning models for medical imaging," arXiv preprint arXiv:2505.03785, 2025. · arXiv
  96. A. Mohsin, H. Janicke, A. Wood, I. H. Sarker, L. Maglaras, and N. Janjua, "Can we trust large language models gener- ated code? a framework for in-context learning, security pat- terns, and code evaluations across diverse llms," arXiv preprint arXiv:2406.12513, 2024. · arXiv
  97. A. Tolzin and A. Janson, "Uncovering the mechanisms of common ground in human-agent interaction: review and future directions for conversational agent research," Internet Research, 2025.
  98. Y. Shentu, P. Wu, A. Rajeswaran, and P. Abbeel, "From llms to actions: latent codes as bridges in hierarchical robot control," in 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 8539-8546, IEEE, 2024.
  99. S. Joel, J. J. Wu, and F. H. Fard, "A survey on llm-based code generation for low-resource and domain-specific programming languages," arXiv preprint arXiv:2410.03981, 2024. · arXiv
  100. Q. Wu, G. Bansal, J. Zhang, Y. Wu, B. Li, E. Zhu, L. Jiang, X. Zhang, S. Zhang, J. Liu, et al., "Autogen: Enabling next-gen llm applications via multi-agent conversation," arXiv preprint arXiv:2308.08155, 2023. · arXiv
  101. Y. Ishibashi and Y. Nishimura, "Self-organized agents: A llm multi-agent framework toward ultra large-scale code generation and optimization," arXiv preprint arXiv:2404.02183, 2024. · arXiv
  102. Z. Rasheed, M. A. Sami, K.-K. Kemell, M. Waseem, M. Saari, K. Systä, and P. Abrahamsson, "Codepori: Large-scale system for autonomous software development using multi-agent tech- nology," arXiv preprint arXiv:2402.01411, 2024. · arXiv
  103. M. Puvvadi, S. K. Arava, A. Santoria, S. S. P. Chennupati, and H. V. Puvvadi, "Coding agents: A comprehensive survey of automated bug fixing systems and benchmarks," in 2025 IEEE 14th International Conference on Communication Systems and Network Technologies (CSNT), pp. 680-686, IEEE, 2025.
  104. J. Tang, T. Fan, and C. Huang, "Metachain: A fully-automated and zero-code framework for llm agents," arXiv preprint arXiv:2502.05957, 2025. · arXiv
  105. Z. Liu, H. Li, J. Lu, G. Ma, X. Hong, G. Iacca, A. Kumar, S. Tang, and L. Wang, "Nature's insight: A novel framework and comprehensive analysis of agentic reasoning through the lens of neuroscience," arXiv preprint arXiv:2505.05515, 2025. · arXiv
  106. J. Schneider, "Generative to agentic ai: Survey, conceptualiza- tion, and challenges," arXiv preprint arXiv:2504.18875, 2025. · arXiv
  107. B. Mohammadi, "Pel, a programming language for orchestrating ai agents," arXiv preprint arXiv:2505.13453, 2025. · arXiv
  108. B. Liu, X. Li, J. Zhang, J. Wang, T. He, S. Hong, H. Liu, S. Zhang, K. Song, K. Zhu, et al., "Advances and chal- lenges in foundation agents: From brain-inspired intelligence to evolutionary, collaborative, and safe systems," arXiv preprint arXiv:2504.01990, 2025. · arXiv
  109. W. Xu, K. Mei, H. Gao, J. Tan, Z. Liang, and Y. Zhang, "A-mem: Agentic memory for llm agents," arXiv preprint arXiv:2502.12110, 2025. · arXiv
  110. M. Fabian and M. Dold, "Agentic preferences: a foundation for nudging when preferences are endogenous," Behavioural Public Policy, vol. 9, no. 1, pp. 249-269, 2025.
  111. F. Kamalov, D. S. Calonge, L. Smail, D. Azizov, D. R. Thadani, T. Kwong, and A. Atif, "Evolution of ai in education: Agentic workflows," arXiv preprint arXiv:2504.20082, 2025. · arXiv
  112. M. Worring, J. Zahálka, S. v. d. Elzen, M. Fischer, and D. Keim, "A multimedia analytics model for the foundation model era," arXiv preprint arXiv:2504.06138, 2025. · arXiv
  113. J. Feng, T. Yu, K. Zhang, and L. Cheng, "Integration of multi-agent systems and artificial intelligence in self-healing subway power supply systems: Advancements in fault diagnosis, isolation, and recovery," Processes, vol. 13, no. 4, p. 1144, 2025.
  114. Z. H. Goh and X. Zhang, "Development and validation of the online agentic and communal behaviour scale: implications for emotional well-being," Behaviour & Information Technology, pp. 1-13, 2025.
  115. M. S. Patil, G. Ung, and M. Nyberg, "Towards specification- driven llm-based generation of embedded automotive software," in International Conference on Bridging the Gap between AI and Reality, pp. 125-144, Springer, 2024.
  116. G. Granberry, W. Ahrendt, and M. Johansson, "Seeking speci- fications: The case for neuro-symbolic specification synthesis," arXiv preprint arXiv:2504.21061, 2025. · arXiv
  117. M. A. Haque, "Llms: A game-changer for software engineers?," BenchCouncil Transactions on Benchmarks, Standards and Evaluations, p. 100204, 2025.
  118. P. Yu, Y. Yang, J. Li, Z. Zhang, H. Wang, X. Feng, and F. Zhang, "Multi-mission tool bench: Assessing the robustness of llm based agents through related and dynamic missions," arXiv preprint arXiv:2504.02623, 2025. · arXiv
  119. L. Deng, Q. Zhong, J. Song, H. Lei, and W. Li, "Llm-based unknown function automated modeling in sensor-driven sys- tems for multi-language software security verification," Sensors, vol. 25, no. 9, p. 2683, 2025.
  120. Y. Zhang, Z. Ma, Y. Ma, Z. Han, Y. Wu, and V. Tresp, "Webpilot: A versatile and autonomous multi-agent system for web task execution with strategic exploration," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, pp. 23378-23386, 2025.
  121. H. Hexmoor, J. Lammens, G. Caicedo, and S. C. Shapiro, Be- haviour based AI, cognitive processes, and emergent behaviors in autonomous agents, vol. 1. WIT Press, 2025.
  122. Z. Wan, Y. Du, M. Ibrahim, J. Qian, J. Jabbour, Y. Zhao, T. Kr- ishna, A. Raychowdhury, and V. J. Reddi, "Reca: Integrated acceleration for real-time and efficient cooperative embodied autonomous agents," in Proceedings of the 30th ACM Interna- tional Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2, pp. 982-997, 2025.
  123. S. Chakraborty, S. Bhatt, U. M. Sehwag, S. S. Ghosal, J. Qiu, M. Wang, D. Manocha, F. Huang, A. Koppel, and S. Ganesh, "Collab: Controlled decoding using mixture of agents for llm alignment," arXiv preprint arXiv:2503.21720, 2025. · arXiv
  124. D. Moshkovich, H. Mulian, S. Zeltyn, N. Eder, I. Skarbovsky, and R. Abitbol, "Beyond black-box benchmarking: Observ- ability, analytics, and optimization of agentic systems," arXiv preprint arXiv:2503.06745, 2025. · arXiv
  125. S. Gandhi, D. Shah, M. Patwardhan, L. Vig, and G. Shroff, "Researchcodeagent: An llm multi-agent system for auto- mated codification of research methodologies," arXiv preprint arXiv:2504.20117, 2025. · arXiv
  126. B. Nadimi, G. O. Boutaib, and H. Zheng, "Verimind: Agentic llm for automated verilog generation with a novel evaluation metric," arXiv preprint arXiv:2503.16514, 2025. · arXiv
  127. Y. Y. Sung, H. Kim, and D. Zhang, "Verila: A human-centered evaluation framework for interpretable verification of llm agent failures," arXiv preprint arXiv:2503.12651, 2025. · arXiv
  128. Y. Qi, H. Peng, X. Wang, A. Xin, Y. Liu, B. Xu, L. Hou, and J. Li, "Agentif: Benchmarking instruction following of large language models in agentic scenarios," arXiv preprint arXiv:2505.16944, 2025. · arXiv
  129. K. Wang, G. Zhang, Z. Zhou, J. Wu, M. Yu, S. Zhao, C. Yin, J. Fu, Y. Yan, H. Luo, et al., "A comprehensive survey in llm (-agent) full stack safety: Data, training and deployment," arXiv preprint arXiv:2504.15585, 2025. · arXiv
  130. K. Zhang, J. Li, G. Li, X. Shi, and Z. Jin, "Codeagent: Enhancing code generation with tool-integrated agent systems for real-world repo-level coding challenges," arXiv preprint arXiv:2401.07339, 2024. · arXiv
  131. J. Jiang, F. Wang, J. Shen, S. Kim, and S. Kim, "A survey on large language models for code generation," arXiv preprint arXiv:2406.00515, 2024. · arXiv
  132. L. Chen, Q. Guo, H. Jia, Z. Zeng, X. Wang, Y. Xu, J. Wu, Y. Wang, Q. Gao, J. Wang, et al., "A survey on evaluating large language models in code generation tasks," arXiv preprint arXiv:2408.16498, 2024. · arXiv
  133. A. Rahman, V. Cvetkovic, K. Reece, A. Walters, Y. Hassan, A. Tummeti, B. Torres, D. Cooney, M. Ellis, and D. S. Nikolopoulos, "Marco: A multi-agent system for optimizing hpc code generation using large language models," arXiv preprint arXiv:2505.03906, 2025. · arXiv
  134. Y. Wang, S. Guo, Y. Pan, Z. Su, F. Chen, T. H. Luan, P. Li, J. Kang, and D. Niyato, "Internet of agents: Fundamentals, applications, and challenges," arXiv preprint arXiv:2505.07176, 2025. · arXiv
  135. M. Xu, J. Fan, X. Huang, C. Zhou, J. Kang, D. Niyato, S. Mao, Z. Han, K.-Y. Lam, et al., "Forewarned is forearmed: A survey on large language model-based agents in autonomous cyberattacks," arXiv preprint arXiv:2505.12786, 2025. · arXiv
  136. P. R. Kothamali et al., "Ai-powered quality assurance: Rev- olutionizing automation frameworks for cloud applications," Journal of Advanced Computing Systems, vol. 5, no. 3, pp. 1- 25, 2025.
  137. K. Pu, D. Lazaro, I. Arawjo, H. Xia, Z. Xiao, T. Grossman, and Y. Chen, "Assistance or disruption? exploring and evaluating the design and trade-offs of proactive ai programming support," in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, pp. 1-21, 2025.
  138. J. Zamfirescu-Pereira, E. Jun, M. Terry, Q. Yang, and B. Hart- mann, "Beyond code generation: Llm-supported exploration of the program design space," in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, pp. 1- 17, 2025.
  139. A. Gu, N. Jain, W.-D. Li, M. Shetty, Y. Shao, Z. Li, D. Yang, K. Ellis, K. Sen, and A. Solar-Lezama, "Challenges and paths towards ai for software engineering," arXiv preprint arXiv:2503.22625, 2025. · arXiv
  140. S. Walters, S. Gao, S. Nerd, F. Da, W. Williams, T.-C. Meng, A. Chow, H. Han, F. He, A. Zhang, et al., "Eliza: A web3 friendly ai agent operating system," arXiv preprint arXiv:2501.06781, 2025. · arXiv
  141. L. Berberi, V. Kozlov, G. Nguyen, J. Sáinz-Pardo Díaz, A. Ca- latrava, G. Moltó, V. Tran, and Á. López García, "Machine learning operations landscape: platforms and tools," Artificial Intelligence Review, vol. 58, no. 6, p. 167, 2025.
  142. R. Hu, C. Peng, X. Wang, and C. Gao, "An llm-based agent for reliable docker environment configuration," arXiv preprint arXiv:2502.13681, 2025. · arXiv
  143. S. Chauhan, Z. Rasheed, A. M. Sami, Z. Zhang, J. Rasku, K.- K. Kemell, and P. Abrahamsson, "Llm-generated microservice implementations from restful api definitions," arXiv preprint arXiv:2502.09766, 2025. · arXiv
  144. G. Wölflein, D. Ferber, D. Truhn, O. Arandjelović, and J. N. Kather, "Llm agents making agent tools," arXiv preprint arXiv:2502.11705, 2025. · arXiv
  145. R. Ye, K. Huang, Q. Wu, Y. Cai, T. Jin, X. Pang, X. Liu, J. Su, C. Qian, B. Tang, et al., "Maslab: A unified and comprehensive codebase for llm-based multi-agent systems," arXiv preprint arXiv:2505.16988, 2025. · arXiv
  146. K. Kanellopoulos, K. Sgouras, F. N. Bostanci, A. K. Kakolyris, B. K. Konar, R. Bera, M. Sadrosadati, R. Kumar, N. Vijaykumar, and O. Mutlu, "Virtuoso: Enabling fast and accurate virtual memory research via an imitation-based operating system sim- ulation methodology," in Proceedings of the 30th ACM Inter- national Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2, pp. 1400-1421, 2025.
  147. A. Almorsi, M. Ahmed, and W. Gomaa, "Guided code gen- eration with llms: A multi-agent framework for complex code tasks," arXiv preprint arXiv:2501.06625, 2025. · arXiv
  148. B. Miloradović, B. C ¸ürüklü, M. Ekström, and A. V. Papadopou- los, "Optimizing parallel task execution for multi-agent mission planning," IEEE Access, vol. 11, pp. 24367-24381, 2023.
  149. X. Wang, Y. Chen, L. Yuan, Y. Zhang, Y. Li, H. Peng, and H. Ji, "Executable code actions elicit better llm agents," in Forty-first International Conference on Machine Learning, 2024.
  150. C. Cao, F. Wang, L. Lindley, and Z. Wang, "Managing linux servers with llm-based ai agents: An empirical evaluation with gpt4," Machine Learning with Applications, vol. 17, p. 100570, 2024.
  151. K. Mei, X. Zhu, W. Xu, W. Hua, M. Jin, Z. Li, S. Xu, R. Ye, Y. Ge, and Y. Zhang, "Aios: Llm agent operating system," arXiv preprint arXiv:2403.16971, 2024. · arXiv
  152. Y. Li, H. Wen, W. Wang, X. Li, Y. Yuan, G. Liu, J. Liu, W. Xu, X. Wang, Y. Sun, et al., "Personal llm agents: Insights and survey about the capability, efficiency and security," arXiv preprint arXiv:2401.05459, 2024. · arXiv
  153. J. Liu, C. Yu, J. Gao, Y. Xie, Q. Liao, Y. Wu, and Y. Wang, "Llm-powered hierarchical language agent for real-time human- ai coordination," arXiv preprint arXiv:2312.15224, 2023. · arXiv
  154. D. Roy, X. Zhang, R. Bhave, C. Bansal, P. Las-Casas, R. Fon- seca, and S. Rajmohan, "Exploring llm-based agents for root cause analysis," in Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engi- neering, pp. 208-219, 2024.
  155. S. Long, J. Tan, B. Mao, F. Tang, Y. Li, M. Zhao, and N. Kato, "A survey on intelligent network operations and performance optimization based on large language models," IEEE Commu- nications Surveys & Tutorials, 2025.
  156. L. Xie, C. Zheng, H. Xia, H. Qu, and C. Zhu-Tian, "Waitgpt: Monitoring and steering conversational llm agent in data anal- ysis with on-the-fly code visualization," in Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, pp. 1-14, 2024.
  157. R. Ehsani, S. Pathak, and P. Chatterjee, "Towards detecting prompt knowledge gaps for improved llm-guided issue reso- lution," arXiv preprint arXiv:2501.11709, 2025. · arXiv
  158. A. Alami, V. V. Jensen, and N. A. Ernst, "Accountability in code review: The role of intrinsic drivers and the impact of llms," ACM Transactions on Software Engineering and Methodology, 2025.
  159. C. Huang, J. Wu, Y. Xia, Z. Yu, R. Wang, T. Yu, R. Zhang, R. A. Rossi, B. Kveton, D. Zhou, et al., "Towards agentic recommender systems in the era of multimodal large language models," arXiv preprint arXiv:2503.16734, 2025. · arXiv
  160. M. North, A. Atapour-Abarghouei, and N. Bencomo, "Code gra- dients: Towards automated traceability of llm-generated code," in 2024 IEEE 32nd International Requirements Engineering Conference (RE), pp. 321-329, IEEE, 2024.
  161. J. Hassine, "An llm-based approach to recover traceability links between security requirements and goal models," in Proceed- ings of the 28th International Conference on Evaluation and Assessment in Software Engineering, pp. 643-651, 2024.
  162. R. Chew, J. Bollenbacher, M. Wenger, J. Speer, and A. Kim, "Llm-assisted content analysis: Using large language models to support deductive coding," arXiv preprint arXiv:2306.14924, 2023. · arXiv
  163. Z. Mousavi, C. Islam, K. Moore, A. Abuadbba, and M. A. Babar, "An investigation into misuse of java security apis by large language models," in Proceedings of the 19th ACM Asia Conference on Computer and Communications Security, pp. 1299-1315, 2024.
  164. Z. Yang, S. S. Raman, A. Shah, and S. Tellex, "Plug in the safety chip: Enforcing constraints for llm-driven robot agents," in 2024 IEEE International Conference on Robotics and Automation (ICRA), pp. 14435-14442, IEEE, 2024.
  165. J. He, R. Ghosh, K. Walia, J. Chen, T. Dhadiwal, A. Hazel, and C. Inguva, "Frontiers of large language model-based agentic systems-construction, efficacy and safety," in Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, pp. 5526-5529, 2024.
  166. M. Sanwal, "Layered chain-of-thought prompting for multi- agent llm systems: A comprehensive approach to explainable large language models," arXiv preprint arXiv:2501.18645, 2025. · arXiv
  167. Y. Wu, F. Roesner, T. Kohno, N. Zhang, and U. Iqbal, "Iso- lategpt: An execution isolation architecture for llm-based agen- tic systems," arXiv preprint arXiv:2403.04960, 2024. · arXiv
  168. N. Ashrafi, S. Bouktif, and M. Mediani, "Enhancing llm code generation: A systematic evaluation of multi-agent collaboration and runtime debugging for improved accuracy, reliability, and latency," arXiv preprint arXiv:2505.02133, 2025. · arXiv
  169. C. S. de Witt, "Open challenges in multi-agent security: To- wards secure systems of interacting ai agents," arXiv preprint arXiv:2505.02077, 2025. · arXiv
  170. G. Syros, A. Suri, C. Nita-Rotaru, and A. Oprea, "Saga: A security architecture for governing ai agentic systems," arXiv preprint arXiv:2504.21034, 2025. · arXiv
  171. S. Barua, "Exploring autonomous agents through the lens of large language models: A review," arXiv preprint arXiv:2404.04442, 2024. · arXiv
  172. B. Zhang, Y. Tan, Y. Shen, A. Salem, M. Backes, S. Zannettou, and Y. Zhang, "Breaking agents: Compromising autonomous llm agents through malfunction amplification," arXiv preprint arXiv:2407.20859, 2024. · arXiv
  173. M. Cemri, M. Z. Pan, S. Yang, L. A. Agrawal, B. Chopra, R. Ti- wari, K. Keutzer, A. Parameswaran, D. Klein, K. Ramchandran, et al., "Why do multi-agent llm systems fail?," arXiv preprint arXiv:2503.13657, 2025. · arXiv
  174. N. Rao, Navigating challenges with LLM-based code generation using software-specific insights. PhD thesis, Google INC, 2025.
  175. J. Zhang and I. Arawjo, "Chainbuddy: An ai-assisted agent system for generating llm pipelines," in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, pp. 1-21, 2025.
  176. Z. Ke, F. Jiao, Y. Ming, X.-P. Nguyen, A. Xu, D. X. Long, M. Li, C. Qin, P. Wang, S. Savarese, et al., "A survey of frontiers in llm reasoning: Inference scaling, learning to reason, and agentic systems," arXiv preprint arXiv:2504.09037, 2025. · arXiv
  177. S. Ali, F. Nasim, and K. Haider, "Secure middleware model for public restful apis," Al-Aasar, vol. 2, no. 1, pp. 50-62, 2025.
  178. H.-P. Hsu, "From programming to prompting: Developing com- putational thinking through large language model-based gener- ative artificial intelligence," TechTrends, pp. 1-22, 2025.
  179. H. Jin, L. Huang, H. Cai, J. Yan, B. Li, and H. Chen, "From llms to llm-based agents for software engineering: A survey of cur- rent, challenges and future," arXiv preprint arXiv:2408.02479, 2024. · arXiv
  180. J. He, C. Treude, and D. Lo, "Llm-based multi-agent systems for software engineering: Literature review, vision and the road ahead," ACM Transactions on Software Engineering and Methodology, 2024.
  181. D. B. Acharya, K. Kuppan, and B. Divya, "Agentic ai: Au- tonomous intelligence for complex goals-a comprehensive sur- vey," IEEE Access, 2025.
  182. D. Nam, A. Omran, A. Murillo, S. Thakur, A. Araujo, M. Blis- tein, A. Frömmgen, V. Hellendoorn, and S. Chandra, "Prompt- ing llms for code editing: Struggles and remedies," arXiv preprint arXiv:2504.20196, 2025. · arXiv
  183. Y. Cui, "Tests as prompt: A test-driven-development benchmark for llm code generation," arXiv preprint arXiv:2505.09027, 2025. · arXiv
  184. M. Wu, Y. Zhao, S. Han, M. X. Liu, and H. Shen, "Ai lego: Scaffolding cross-functional collaboration in industrial respon- sible ai practices during early design stages," arXiv preprint arXiv:2505.10300, 2025. · arXiv
  185. B. Niu, Y. Song, K. Lian, Y. Shen, Y. Yao, K. Zhang, and T. Liu, "Flow: A modular approach to automated agentic workflow generation," arXiv preprint arXiv:2501.07834, 2025. · arXiv
  186. A. Caetano, K. Verma, A. Taheri, R. Kumaran, Z. Chen, J. Chen, T. Höllerer, and M. Sra, "Agentic workflows for conversational human-ai interaction design," arXiv preprint arXiv:2501.18002, 2025. · arXiv
  187. Z. Ding, Q. Zhang, M. Chi, and Z. Wang, "Frontend dif- fusion: Empowering self-representation of junior researchers and designers through agentic workflows," arXiv preprint arXiv:2502.03788, 2025. · arXiv
  188. H. Dawid, P. Harting, H. Wang, Z. Wang, and J. Yi, "Agentic workflows for economic research: Design and implementation," arXiv preprint arXiv:2504.09736, 2025. · arXiv
  189. M. J. Buehler, "Preflexor: Preference-based recursive language modeling for exploratory optimization of reasoning and agentic thinking," npj Artificial Intelligence, vol. 1, no. 1, pp. 1-38, 2025.
  190. P. Bobko, L. Hirshfield, L. Eloy, C. Spencer, E. Doherty, J. Driscoll, and H. Obolsky, "Human-agent teaming and trust calibration: a theoretical framework, configurable testbed, em- pirical illustration, and implications for the development of adaptive systems," Theoretical Issues in Ergonomics Science, vol. 24, no. 3, pp. 310-334, 2023.
  191. D. Secchi, R. Gahrn-Andersen, and M. Neumann, "Complexity in systemic cognition: Theoretical explorations with agent-based modeling," Systems, vol. 12, no. 8, p. 287, 2024.
  192. A. Tariverdi, "Trust from ethical point of view: Exploring dynamics through multiagent-driven cognitive modeling," arXiv preprint arXiv:2401.07255, 2024. · arXiv
  193. P. Iyenghar, "Clever hans in the loop? a critical examination of chatgpt in a human-in-the-loop framework for machinery functional safety risk analysis," Eng, vol. 6, no. 2, p. 31, 2025.
  194. J. Sabbah and F. Li, "When humans and large language models collaborate, problem-finding illuminates," Innovation, pp. 1-34, 2025.
  195. J. Gu, Z. Han, S. Chen, A. Beirami, B. He, G. Zhang, R. Liao, Y. Qin, V. Tresp, and P. Torr, "A systematic survey of prompt engineering on vision-language foundation models," arXiv preprint arXiv:2307.12980, 2023. · arXiv
  196. V. Geroimenko, The Essential Guide to Prompt Engineering: Key Principles, Techniques, Challenges, and Security Risks. Springer Nature, 2025.
  197. G. Robino, "Conversation routines: A prompt engineering framework for task-oriented dialog systems," arXiv preprint arXiv:2501.11613, 2025. · arXiv
  198. J. D. Velásquez-Henao, C. J. Franco-Cardona, and L. Cadavid- Higuita, "Prompt engineering: a methodology for optimizing interactions with ai-language models in the field of engineering," Dyna, vol. 90, no. SPE230, pp. 9-17, 2023.
  199. S. Schulhoff, M. Ilie, N. Balepur, K. Kahadze, A. Liu, C. Si, Y. Li, A. Gupta, H. Han, S. Schulhoff, et al., "The prompt report: A systematic survey of prompting techniques," arXiv preprint arXiv:2406.06608, vol. 5, 2024. · arXiv
  200. J. Robertson, C. Ferreira, E. Botha, and K. Oosthuizen, "Game changers: A generative ai prompt protocol to enhance human-ai knowledge co-construction," Business Horizons, vol. 67, no. 5, pp. 499-510, 2024.

200 of 249 shown

Cited by

Sorted by citations

Metadata

Authors
Sapkota, R., Roumeliotis, K. I., & Karkee, M.
Affiliations
  • Cornell University (US)
  • University of Peloponnese (GR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2505.19443
arXiv
2505.19443
OpenAlex
W4414586252
Cited by
32
References
6
Citations by year
2026: 31 · 2025: 1
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Science Foundation
  • U.S. Department of Agriculture
  • Hellenic Academic Libraries Link
  • National Institute of Food and Agriculture (AWD003473., 1029004, AWD004595)
Topics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords
vibe coding, agentic coding, large language models, AI-assisted software development, autonomous software agents, conversational programming, code generation, debugging, refactoring, CI/CD integration, natural language interfaces, developer roles

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review