CoChat

Methods and Techniques of Agentic Software Engineering: A Systematic Literature Review

Otoum, Nesreen, Elkhalili, Nuha · 2026 · IEEE Access
Cited by 10

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2026.3652325

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 23 references

Research works printed but not linked: 45

  1. Jin, 2024, From LLMs to LLMbased agents for software engineering: A survey of current, challenges and future, arXiv:2408.02479 · arXiv
  2. 10.3390/e25060888 · DOI · Paper page
  3. 10.1007/s10515-024-00426-z · DOI · Paper page
  4. 10.20537/2076-7633-2024-16-7-1715-1726 · DOI
  5. Liu, 2024, Large language model-based agents for software engineering: A survey, arXiv:2409.02977 · arXiv
  6. Yehudai, 2025, Survey on evaluation of LLM-based agents, arXiv:2503.16416 · arXiv
  7. Hong, MetaGPT: Meta programming for a multi-agent collaborative framework, 23247
  8. 10.1145/3719351 · DOI
  9. Yang, SWE-agent: Agent-computer interfaces enable automated software engineering, 37, 50528
  10. Esposito, 2025, Generative AI for software architecture. Applications, trends, challenges, and future directions, arXiv:2503.13310v2 · arXiv
  11. Chen, 2022, CodeT: Code generation with generated tests, arXiv:2207.10397 · arXiv
  12. Bucaioni, 2024, Programming with ChatGPT: How far can we go?, Mach. Learn. With Appl., 15
  13. Shinn, 2023, Reflexion: Language agents with verbal reinforcement learning, arXiv:2303.11366 · arXiv
  14. Zhou, 2023, Language agent tree search unifies reasoning acting and planning in language models, arXiv:2310.04406 · arXiv
  15. Wrona, 2023, Overview of software agent platforms available in 2023, Information, 14, 348, 10.3390/info14060348 · DOI
  16. 10.1609/aaai.v39i1.32007 · DOI
  17. 10.18653/v1/2024.emnlp-main.632 · DOI
  18. Huang, 2023, CodeCoT: Tackling code syntax errors in CoT reasoning for code generation, arXiv:2308.08784 · arXiv
  19. 10.1109/tse.2024.3440503 · DOI
  20. 10.1145/3690635 · DOI · Paper page
  21. Zhang, 2023, Planning with large language models for code generation, arXiv:2303.05510 · arXiv
  22. Huang, 2023, AgentCoder: Multi-Agent-based code generation with iterative testing and optimisation, arXiv:2312.13010 · arXiv
  23. Kang, 2022, Large language models are fewshot testers: Exploring LLM-based general bug reproduction, arXiv:2209.11515 · arXiv
  24. Ni, LEVER: Learning to verify language-to-code generation with execution, 202, 26106
  25. Chen, 2023, Teaching large language models to self-debug, arXiv:2304.05128 · arXiv
  26. Coello, 2024, Effectiveness of ChatGPT in coding: A comparative analysis of popular large language models, Digital, 4, 114, 10.3390/digital4010005 · DOI · Paper page
  27. 10.1007/s10664-024-10594-x · DOI · Paper page
  28. Zhang, 2022, Coder reviewer reranking for code generation, arXiv:2211.16490 · arXiv
  29. Christakis, 2025, Evaluating large language models in code generation: INFINITE methodology for defining the inference index, Appl. Sci., 15, 3784, 10.3390/app15073784 · DOI
  30. 10.1109/icse48619.2023.00181 · DOI · Paper page
  31. 10.3897/jucs.134739 · DOI
  32. 10.1145/3708522 · DOI · Paper page
  33. 10.1109/tai.2023.3318183 · DOI · Paper page
  34. 10.1017/dsj.2024.8 · DOI
  35. Hussein, 2024, Usability of LLMs for Assisting Software Engineering: A Literature Review
  36. 10.3389/frai.2024.1436350 · DOI
  37. Zubair, 2025, The use of large language models for program repair, Comput. Standards Interface, 93, 10.1016/j.csi.2024.103951 · DOI
  38. 10.3389/fcomp.2025.1519437 · DOI
  39. Rasheed, 2024, CodePori: Large-scale system for autonomous software development using multi-agent technology, arXiv:2402.01411 · arXiv
  40. Wang, 2024, OpenHands: An open platform for AI software developers as generalist agents, arXiv:2407.16741 · arXiv
  41. Wu, 2024, OScopilot: Towards generalist computer agents with self-improvement, arXiv:2402.07456 · arXiv
  42. 10.1007/s10515-025-00544-2 · DOI
  43. Murphy, 2024, Combining LLM code generation with formal specifications and reactive program synthesis, arXiv:2410.19736 · arXiv
  44. 10.1080/08874417.2025.2482571 · DOI
  45. 10.1007/s10796-025-10581-7 · DOI

Metadata

Authors
Otoum, N., & Elkhalili, N.
Venue
IEEE Access
Published
2026
Volume
14
Pages
7443-7465
ISSN
2169-3536
Cited by
10
References
23
Funders
Deanship of Scientific Research and Graduate Studies at the University of Petra, Jordan

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Methods and Techniques of Agentic Software Engineering: A Systematic Literature Review. https://app.cochat.ai/papers/10.1109/access.2026.3652325
The paper
Otoum, N., & Elkhalili, N. (2026). Methods and Techniques of Agentic Software Engineering: A Systematic Literature Review. IEEE Access. https://doi.org/10.1109/access.2026.3652325

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.