The Future of AI-Driven Software Engineering
Open accessThe DOI matches its Crossref record; 112 of the 112 references it cites were found in a registry or an index.
Abstract
A paradigm shift is underway in Software Engineering, with AI systems such as LLMs playing an increasingly important role in boosting software development productivity. This trend is anticipated to persist. In the next years, we expect a growing symbiotic partnership between human software developers and AI. The Software Engineering research community cannot afford to overlook this trend; we must address the key research challenges posed by the integration of AI into the software development process. In this article, we present our vision of the future of software development in an AI-driven world and explore the key challenges that our research community should address to realize this vision.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This transformation changes the traditional software development paradigms, not only in tooling and automation, but also in developer collaboration and decision-making [160, 189].”
From A 2030 Roadmap for Software Engineering (2025) · cites this paper as [189]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Explainable AI (XAI): Core Ideas, Techniques, and Solutions
Dwivedi, R., Dave, D., Naik, H., Singhal, S., Omer, R., Patel, P., Qian, B., Wen, Z., Shah, T., Morgan, G., et al. (2023) · ACM Computing Surveys · doi:10.1145/3561048 · Cited by 1,386
EvoSuite: automatic test suite generation for object-oriented software
Fraser, G., & Arcuri, A. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025179 · Cited by 1,110
A survey on large language model (LLM) security and privacy: The Good, The Bad, and The Ugly
Yao, Y., Duan, J., Xu, K., Cai, Y., Sun, Z., & Zhang, Y. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100211 · Cited by 1,083
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
Feedback-Directed Random Test Generation
Pacheco, C., Lahiri, S. K., Ernst, M. D., & Ball, T. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.37 · Cited by 863
Explainable AI: A Brief Survey on History, Research Areas, Approaches and Challenges
Xu, F., Uszkoreit, H., Du, Y., Fan, W., Zhao, D., & Zhu, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32236-6_51 · Cited by 758
Metamorphic Testing: A Review of Challenges and Opportunities
Chen, T. Y., Kuo, F.-C., Liu, H., Poon, P.-L., Towey, D., Tse, T. H., & Zhou, Z. Q. (2019) · ACM Computing Surveys · doi:10.1145/3143561 · Cited by 665
Research works printed but not linked: 16
- Vivek Basanagoudar and Abhijay Srekanth. 2023. Copyright conundrums in generative AI: Github Copilot’s not-so-fair use of open-source licensed code. Journal of Intellectual Property Studies 7 (2023), 58–68.
- Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et al. 2021. Evaluating large language models trained on code. arXiv:2107.03374. Retrieved from https://arxiv.org/abs/2107.03374 · arXiv
- T. Y. Chen, S. C. Cheung, and S. M. Yiu. 1998. Metamorphic Testing: A New Approach for Generating Next Test Cases. Technical Report. Technical Report HKUST-CS98-01, Department of Computer Science, The Hong Kong University of Science and Technology.
- Wenpin Hou and Zhicheng Ji. 2024. A systematic evaluation of large language models for generating programming code. arXiv:2403.00894. Retrieved from https://arxiv.org/abs/2403.00894 · arXiv
- Dong Huang Qingwen Bu Jie Zhang Xiaofei Xie Junjie Chen and Heming Cui. 2023. Bias assessment and mitigation in LLM-based code generation. arXiv:2309.14345. Retrieved from https://arxiv.org/abs/2309.14345 · arXiv
- Dhanushka Jayasuriya, Valerio Terragni, Jens Dietrich, and Kelly Blincoe. 2024. Understanding the impact of APIs behavioral breaking changes on client applications. In Proceedings of the 1st ACM on Software Engineering (PACMSE), 1238–1261.
- Michael Konstantinou Renzo Degiovanni and Mike Papadakis. 2024. Do LLMs generate test oracles that capture the actual or the expected program behaviour? arXiv:2410.21136. Retrieved from https://arxiv.org/abs/2410.21136 · arXiv
- Sebastian Lubos, Alexander Felfernig, Thi Ngoc Trang Tran, Damian Garber, Merfat El Mansi, Seda Polat Erdeniz, and Viet-Man Le. 2024. Leveraging LLMs for the quality assurance of software requirements. In Proceedings of the 2024 IEEE 32nd International Requirements Engineering Conference (RE). IEEE, 389–397.
- Quang-Hung Luu Huai Liu and Tsong Yueh Chen. 2023. Can ChatGPT advance software testing intelligence? An experience report on metamorphic testing. arXiv:2310.19204. Retrieved from https://arxiv.org/abs/2310.19204 · arXiv
- Garima Malik Mucahit Cevik Devang Parikh and Ayse Basar. 2024. Supervised semantic similarity-based conflict detection algorithm: S3CDA. arXiv:2206.13690. Retrieved from https://arxiv.org/abs/2206.13690 · arXiv
- Siddharth Samsi, Dan Zhao, Joseph McDonald, Baolin Li, Adam Michaleas, Michael Jones, William Bergeron, Jeremy Kepner, Devesh Tiwari, and Vijay Gadepally. 2023. From words to watts: Benchmarking the energy costs of large language model inference. In Proceedings of the 2023 IEEE High Performance Extreme Computing Conference (HPEC). IEEE, 1–9.
- Seung Yeob Shin Fabrizio Pastore Domenico Bianculli and Alexandra Baicoianu. 2024. Towards generating executable metamorphic relations using large language models. arXiv:2401.17019. Retrieved from https://arxiv.org/abs/2401.17019 · arXiv
- Christos Tsigkanos, Pooja Rani, Sebastian Müller, and Timo Kehrer. 2023. Large language models: The next frontier for variable discovery within metamorphic testing? In Proceedings of the 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 678–682.
- Simon Van Oordt and Emitza Guzman. 2021. On the role of user feedback in software evolution: A practitioners’ perspective. In Proceedings of the 2021 IEEE 29th International Requirements Engineering Conference (RE). IEEE, 221–232.
- Zhuokui Xie Yinghao Chen Chen Zhi Shuiguang Deng and Jianwei Yin. 2023. ChatUniTest: A ChatGPT-based automated unit test generation tool. arXiv:2305.04764. Retrieved from https://arxiv.org/abs/2305.04764 · arXiv
- Burak Yetiştiren Işık Özsoy Miray Ayerdem and Eray Tüzün. 2023. Evaluating the code quality of AI-assisted code generation tools: An empirical study on GitHub Copilot Amazon CodeWhisperer and ChatGPT. arXiv:2304.10778. Retrieved from https://arxiv.org/abs/2304.10778 · arXiv
Cited by
Quantum Software Engineering: Roadmap and Challenges Ahead
Murillo, J. M., García-Alonso, J. M., Moguel, E., Barzen, J., Leymann, F., Ali, S., Yue, T., Arcaini, P., Pérez‐Castillo, R., de Guzmán, I. G., et al. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3712002 · Cited by 199
Generative AI in Agile Software Development: A Comprehensive Survey
Malladi, N. V., & Reddy, K. S. (2025) · International Conference on Innovative Data Communication Technologies and Application (ICIDCA) · doi:10.1109/icidca66325.2025.11280486 · Cited by 21
A 2030 Roadmap for Software Engineering
Pezzè, M., Abrahão, S., Penzenstadler, B., Poshyvanyk, D., Roychoudhury, A., & Yue, T. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3731559 · Cited by 13
Ibáñez, M. B., Estrada, M. L. B., & Cabada, R. Z. (2025) · Computer Applications in Engineering Education · doi:10.1002/cae.70080 · Cited by 19
Amalfitano, D., Metzger, A., Autili, M., Fulcini, T., Hey, T., Keim, J., Pelliccione, P., Scotti, V., Koziolek, A., Mirandola, R., et al. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3788879 · Cited by 30
LLMLOOP: Improving LLM-Generated Code and Tests Through Automated Iterative Feedback Loops
Ravi, R., Bradshaw, D., Ruberto, S., Jahangirova, G., & Terragni, V. (2025) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme64153.2025.00109 · Cited by 44
Self-citationSoftware Engineering for Collective Cyber-Physical Ecosystems
Casadei, R., Aguzzi, G., Audrito, G., Damiani, F., Pianini, D., Scarso, G., Torta, G., & Viroli, M. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3712004 · Cited by 12
Generative AI and Empirical Software Engineering: A Paradigm Shift
Treude, C., & Storey, M. (2025) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1109/aiware69974.2025.00033 · Cited by 41
Understanding LLM-Driven Test Oracle Generation
Bodicoat, A., Jahangirova, G., & Terragni, V. (2025) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1109/aiware69974.2025.00011 · Cited by 16
Self-citationAgentic Software Engineering: Foundational Pillars and a Research Roadmap
Hassan, A. E., Li, H., Lin, D., Adams, B., Chen, T.-H., Kashiwa, Y., & Qiu, D. (2025) · arXiv · doi:10.48550/arxiv.2509.06216 · Cited by 7
Challenges and Opportunities for Generative AI in Software Engineering: A Managerial View
Rico, S., & Öberg, L. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728718 · Cited by 13
Semantic Commit: Helping Users Update Intent Specifications for AI Memory at Scale
Vaithilingam, P., Kim, M. G., Acosta-Parenteau, F.-C., Lee, D. W., Mhedhbi, A., Glassman, E. L., & Arawjo, I. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747778 · Cited by 31
Ruberto, S., Perera, J., Jahangirova, G., & Terragni, V. (2025) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw64639.2025.10962503 · Cited by 6
Self-citationFrom benchmarks to deployment: a comprehensive review of agentic AI evaluation
Kehkashan, T., Abdullah, M. I., Al‐Shamayleh, A. S., Ivković, N., Ismail, N. A., Ahmad, S. S. S., Rehman, A., & Akhunzada, A. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11571-0 · Cited by 19
Saleem, S., Asim, M. N., & Dengel, A. R. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-025-02143-w · Cited by 10
Gröpler, R., Klepke, S., Johns, J., Dreschinski, A., Schmid, K., Dornauer, B., Tüzün, E., Noppen, J., Mousavi, M. R., Tang, Y., et al. (2025) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1109/aiware69974.2025.00026 · Cited by 18
LLMorph: Automated Metamorphic Testing of Large Language Models
Cho, S., Ruberto, S., & Terragni, V. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00385 · Cited by 9
Self-citationMarlowe, T. J., Ku, C. S., Laracy, J. R., Kirova, V. D., & Herbert, K. G. (2026) · Journal of Integrated Design and Process Science · doi:10.1177/10920617251405471 · Cited by 13
Artificial Intelligent Technologies to Support Software Engineering: A Survey
Cante, L. C., Espósito, A., Graziano, M., & Martino, B. D. (2025) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-96096-3_23 · Cited by 3
MoRe: LLM-Based Domain Model Generation with Hybrid Self-Refinement
Ru, C., Shen, J., & He, X. (2026) · Electronics · doi:10.3390/electronics15061239 · Cited by 2
Configuring Agentic AI Coding Tools: An Exploratory Study
Galster, M., Mohsenimofidi, S., Lulla, J. L., Auwal, A. M., Treude, C., & Baltes, S. (2026) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3805760.3814887 · Cited by 54
Measuring AI Impact on Software Engineering Productivity and Quality
Bağrıyanık, S., & Ersoy, E. (2025) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk67458.2025.11206890 · Cited by 2
WIP: Generative Artificial Intelligence in Undergraduate Software Engineering Education
Hemmes, J., & Blumenthal, R. L. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328493 · Cited by 1
Migliarini, P., Autili, M., Inverardi, P., & Pelliccione, P. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3801980 · Cited by 1
Si, Y., Li, D., Shi, H., & Zhang, J. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808163 · Cited by 17
How Do Developers Interact with AI? An Exploratory Study on Modeling Developer Programming Behavior
Wu, Y., Li, Z. S., Stolee, K. T., & Xu, B. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808120 · Cited by 3
Agentic Pipelines in Embedded Software Engineering: Emerging Practices and Challenges
Sun, S., & Staron, M. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00024 · Cited by 6
Brieva, E. D. C. S. (2025) · Congresso Ibero-Americano em Engenharia de Software (CIbSE) · doi:10.5753/cibse.2025.35307
MultiMind: A Plug-in for the Implementation of Development Tasks Aided by AI Assistants
Donato, B., Mariani, L., Micucci, D., Riganelli, O., & Somaschini, M. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3730564
SOFTWARE ENGINEERING WITH THE HELP OF ARTIFICIAL INTELLIGENCE: MODERN TOOLS AND FUTURE DIRECTIONS
Kiselyov, O. (2025) · Наука і техніка сьогодні · doi:10.52058/2786-6025-2025-7(48)-1085-1096
Evaluating Large Language Models for Graphical PLC Programming: A Temperature Control Case Study
Żukowski, Ł., & Możaryn, J. (2025) · International Conference on Methods and Models in Automation and Robotics · doi:10.1109/mmar65820.2025.11151006
How Can Copilot Assist in Creating Accessible Websites? An Empirical Study
Teran, L. A., da Rocha, T. A., da Silva, I. M. M., de Salles, R. B., Melo, G. L. N., Mota, M. P., & de Souza, C. R. B. (2025) · Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais (IHC) · doi:10.5753/ihc.2025.10811
Contingencies of Usage Systems and Methods in Strategic Management Accounting
Karmańska, A. M., & Piosik, A. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.628 · Cited by 1
Gage to Engage: Fueling Collaboration
Niemelä, P., Hukkanen, J., Rajala, J., & Scaico, P. D. (2025) · International Academic Mindtrek Conference (Mindtrek) · doi:10.1145/3757980.3757991
Miļūne, M. K., Ņikiforova, O., & Pastor, Ó. (2025) · International Scientific Conference on Information Technology and Management Science of Riga Technical University (ITMS) · doi:10.1109/itms67030.2025.11236707
CodeProphet: A Predictive LLM Based Framework for Proactive Software Development Planning
Pisal, P., Gupta, N., Ambavaram, R. R., Jadhav, A., & Mahendran, P. K. R. (2025) · International Conference on Artificial Intelligence, Blockchain, and Internet of Things (AIBThings) · doi:10.1109/aibthings66987.2025.11296271
Toward Explaining Large Language Models in Software Engineering Tasks
Vitale, A., Nguyen, K.-N., Poshyvanyk, D., Oliveto, R., Scalabrino, S., & Mastropaolo, A. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3837084 · Cited by 2
Use of Generative AI Tools in Software Quality Assurance Work
Maxim, B. R., Song, Z., de Hurtado, B. G., Hassan, F., & Shijo, S. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328290
A 3-Layer Agentic Model for Nonfunctional Requirements in Software Engineering
Zabardast, E., Vieira, T., & Gorschek, T. (2025) · IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW) · doi:10.1109/asew67777.2025.00020
From Code to Intent: Re-Architecting Internet Computing for the AI Era
Schmidt, D. C. (2025) · IEEE Internet Computing · doi:10.1109/mic.2026.3651157
Generative AI solutions for software quality: Assessing industrial readiness
Gheventer, A., Gurgel, P. D. A., Brito, C. H., de Mello, R., Rocha, S., Gonçalves, R. F., & Travassos, G. B. S. (2026) · Software Quality Journal · doi:10.1007/s11219-026-09754-7 · Cited by 4
A Report on Winter School on AI-Infused Software Engineering- Research and Practice (AISE 2026)
Tiwari, S., Rathore, S. S., Chimalakonda, S., Arora, C., D’Souza, M., & Dutta, S. (2026) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/3800646.3800655
Lyashkevych, V. (2026) · Applied Computer Systems · doi:10.2478/acss-2026-0010 · Cited by 5
Wang, Y., Rizi, M. B., Khashei, F., & Rubin, J. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797092 · Cited by 2
Iqbal, F., Khan, M. A., Weerakoon, O., Oyedeji, S., & Porras, J. (2026) · IEEE/ACM International Workshop on Green and Sustainable Software (GREENS) · doi:10.1145/3786148.3788622
Developers’ Blind Spot: Designing Systems to Enable Stakeholders’ Understanding of Ethical Qualities
Ninno, G. D., Sanctis, M. D., Inverardi, P., Spalazzese, R., & Tsigkanos, C. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786581.3786935
Feature Selection for Commercialising Machine Learning-Based Source Code Bad Smell Detection
Buhari, M. A., Mashuk, M. S., & Bass, J. M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-24804-6_34
AI landscape of software engineering
Нестеренко, О. В., Федоров, В. В., & Yatsuk, P. (2026) · PROBLEMS IN PROGRAMMING · doi:10.15407/pp2026.02.004
Agile Software Development Status and Next StepsPreprint
Yohn, D., & Slhoub, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7180228
AI-Driven Code Quality Assessment Model and Implementation for Complex Power Grid Software Systems
Zhang, W. (2026) · International Conference on Computer Intelligence and Software Engineering (CICSE) · doi:10.1109/cicse70286.2026.11621056
Low-Code Platforms Adoption: A Motivational Adoption Process Perspective
Coster, E. D., Simonofski, A., & Snoeck, M. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-35043-5_6
Использование ИИ-инструментов в конкурентном развитии ИТ-компаний: прикладное исследование 2026
Pashchenko, D. S. (2026) · Информатика Экономика Управление - Informatics Economics Management · doi:10.47813/2782-5280-2026-5-3-2012-2024
AI-Based Validation of Software Releases
Fedorov, S. (2026) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd69640.2026.11637277
Maxim, B. R., Ghammam, A., Roy, M., Gandi, S., & Gujarathi, A. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--60806
Brieva, E. D. C. S., Pardo, C., & Pérez‐Castillo, R. (2026) · Software & Systems Modeling · doi:10.1007/s10270-026-01413-6
Software quality assurance in the era of Agentic AI: a systematic mapping study
Ouaarous, R., Hilal, I., & Mezrioui, A. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1936730 · Cited by 1
Human-Centric Integration of Large Language Models into Software Engineering Tasks
Ferino, S. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3787649
LLM-Enhanced Stochastic Generation of Class Diagram Datasets
He, X., Shen, J., & Ru, C. (2026) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3822455.3830323
CoLSM: Collaborative Large and Small Models for Automatic Software Generation
Wen, Q., Zhao, L., Zhang, X., Zhang, J., Wang, C., & Zhang, P. (2026) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia71496.2026.11684680
Hidden Licensing Risks in the PTMware Ecosystem
Wang, B., Chen, Y., Shi, J., Li, M., Lyu, Y., Wu, Y., Lin, Y., & Yang, Z. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832175
Phung, T.-N., & Nguyen, V. T. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108363
Mendes, E., & Estragués, M. S. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.113153
Mendes, E., & Marc (2026) · Research Square · doi:10.21203/rs.3.rs-11319252/v1
Metadata
- Authors
- Terragni, V., Vella, A., Roop, P., & Blincoe, K.
- Affiliations
- University of Auckland (NZ)
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2025-05-26
- Volume
- 34
- Issue
- 5
- Pages
- 1-20
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W4406798194
- Cited by
- 62
- References
- 97
- Citations by year
- 2026: 33 · 2025: 29
- FWCI
- 65.00
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Transactions on Software Engineering and Methodology (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Marsden Fund Council
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- large language models, human-AI collaboration, software productivity, future of software development, research challenges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
