The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agents
Abstract
Software process models are essential to facilitate collaboration and communication among software teams to solve complex development tasks. Inspired by these software engineering practices, we present FlowGen - a code generation framework that emulates software process models based on multiple Large Language Model (LLM) agents. We emulate three process models, FlowGenWaterfall, FlowGenTDD, and FlowGenScrum, by assigning LLM agents to embody roles (i.e., requirement engineer, architect, developer, tester, and scrum master) that correspond to everyday development activities and organize their communication patterns. The agents work collaboratively using chain-of-thought and prompt composition with continuous selfrefinement to improve the code quality. We use GPT3.5 as our underlying LLM and several baselines (RawGPT, CodeT, Reflexion) to evaluate code generation on four benchmarks: HumanEval, HumanEval-ET, MBPP, and MBPP-ET. Our findings show that FlowGenScrumexcels compared to other process models, achieving a Pass@1 of 75.2, 65.5, 82.5, and 56.7 in HumanEval, HumanEval-ET, MBPP, and MBPP-ET, respectively (an average of 15% improvement overRawGPT). Compared with other state-of-the-art techniques, FlowGenScrumachieves a higher Pass@1 in MBPP compared to CodeT, with both outperforming Reflexion. Notably, integrating CodeT into FlowGenScrumresulted in statistically significant improvements, achieving the highest Pass@1 scores. Our analysis also reveals that the development activities impacted code smell and exception handling differently, with design and code review adding more exception handling and reducing code smells. Finally, FlowGen models maintain stable Pass@1 scores across GPT3.5 versions and temperature values, highlighting the effectiveness of software process models in enhancing the quality and stability of LLM-generated code.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · cited 2×
“We design testers using a prompt composition technique, which is shown to improve the LLM-generated result [22, 50].”
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 2×
“We design testers using a prompt composition technique, which is shown to improve the LLM-generated result [22, 50].”
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
How Is ChatGPT’s Behavior Changing Over Time?
Chen, L., Zaharia, M., & Zou, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.5317da47 · Cited by 507
Research works printed but not linked: 34
- 10.1145/3643991.3645081 · DOI
- 2024, Repository & dataset
- Bassil, 2012, A simulation model for the waterfall software development life cycle, arXiv preprint
- Chen, 2021, Evaluating large language models trained on code, arXiv preprint
- 10.1007/978-1-4302-0439-8_11 · DOI
- 10.1145/3695991 · DOI
- Dong, 2023, Selfcollaboration code generation via chatgpt, arXiv preprint
- 10.1109/TSE.2004.35 · DOI
- Fowler, 2005, The new methodology
- Huang, 2023, Codecot and beyond: Learning to program and test like a developer, arXiv preprint
- Huang, 2023, Agentcoder: Multi-agent-based code generation with iterative testing and optimisation, arXiv preprint
- 10.1109/ICSE48619.2023.00194 · DOI · Paper page
- 10.1145/3690635 · DOI
- 10.1145/3597503.3623304 · DOI
- 10.1145/3597503.3639150 · DOI
- Madaan, 2024, Selfrefine: Iterative refinement with self-feedback, Advances in Neural Information Processing Systems, 36
- 10.1109/ICSE.2003.1201238 · DOI
- 2023, Chatgpt
- 2005, Built-in exceptions
- Ruiz, 2024, A novel approach for automatic program repair using round-trip translation with large language models, arXiv preprint
- 10.18653/v1/2023.emnlp-main.814 · DOI · Paper page
- 10.1109/QRS60937.2023.00031 · DOI
- 2024, Pylint
- 2024, What is devtestops?
- 10.1007/978-3-031-55642-5_4 · DOI · Paper page
- Xie, 2023, Chatunitest: a chatgpt-based automated unit test generation tool, arXiv preprint
- Xu, 2022, Alleviating the sample selection bias in few-shot learning by removing projection to the centroid, Advances in Neural Information Processing Systems, 35, 21073
- Xu, 2023, Exploring large language models for communication games: An empirical study on werewolf, arXiv preprint
- 10.1109/ICSM.2012.6405287 · DOI · Paper page
- Yetiştiren, 2023, Evaluating the code quality of ai-assisted code generation tools: An empirical study on github copilot, amazon codewhisperer, and chatgpt, arXiv preprint
- Yuan, 2023, Evaluating instructiontuned large language models on code comprehension and generation, arXiv preprint
- Yuan, 2023, No more manual tests? evaluating and improving ChatGPT for unit test generation, arXiv preprint
- 10.1109/TSE.2024.3364675 · DOI
- Zhong, 2024, Ldb: A large language model debugger via verifying runtime execution step-by-step, arXiv preprint
Cited by
On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub
Watanabe, M., Li, H., Kashiwa, Y., Reid, B., Iida, H., & Hassan, A. E. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3798166 · Cited by 34
Metadata
- Authors
- Lin, F., Kim, D. J., & Chen, T.-H.
- Affiliations
- Concordia University,Software PErformance, Analysis, and Reliability (SPEAR) lab,Montreal,Canada
- DePaul University,Chicago,USA
- Venue
- 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE)
- Publisher
- IEEE
- Published
- 2025-04-26
- Pages
- 1527-1539
- Cited by
- 32
- References
- 27
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agents. https://app.cochat.ai/papers/10.1109/icse55347.2025.00140
- The paper
- Lin, F., Kim, D. J., & Chen, T.-H. (2025). SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agents. 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). https://doi.org/10.1109/icse55347.2025.00140
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.