The Impact of Generative AI on Creativity in Software Development: A Research Agenda
Open accessThe DOI matches its Crossref record; 140 of the 140 references it cites were found in a registry or an index; 24 of the 70 sources its claims cite were checked for support.
Abstract
As GenAI becomes embedded in developer toolchains and practices, and routine code is increasingly generated, human creativity will be increasingly important for generating competitive advantage. This article uses the McLuhan tetrad alongside scenarios of how GenAI may disrupt software development more broadly, to identify potential impacts GenAI may have on creativity within software development. The impacts are discussed along with a future research agenda comprising five connected themes that consider how individual capabilities, team capabilities, the product, unintended consequences, and society can be affected.
Overview
CoChat Summary
## TL;DR
This is a research agenda paper, not an empirical study: it uses speculative future scenarios and McLuhan’s tetrad to map how GenAI could affect creativity in software development. The paper proposes five research themes—individual capabilities, team capabilities, products, unintended consequences, and society—to guide future work.
## Key findings
- The authors derive their agenda from four McLuhan tetrads (Person, Product, Process, Press), each structured around enhances, obsolesces, retrieves, and reverses into questions about GenAI’s effects on creativity.
- They present five future scenarios ranging from “GenAI as idea generator” and “GenAI as creative partner” to “GenAI as dev team,” “GenAI as creative director,” and “GenAI canceled,” plus two bookend extremes: optimistic and pessimistic futures.
- The resulting research agenda has five connected themes: individual capabilities, team capabilities, products, unintended consequences, and societal impact.
- The paper argues that GenAI may both enhance creativity (e.g., idea generation, cross-domain inspiration, rapid prototyping) and undermine it (e.g., rubber-stamping, loss of skills, homogenized products, reduced trust, unintended bias/security issues).
## Methods
- Conceptual / perspective paper using a two-phased approach: first, the authors speculated future scenarios of GenAI in software development; second, they applied parts of the Disruptive Research Playbook together with the McLuhan tetrad.
- The analysis is organized around the 4P creativity framework: Person, Product, Process, Press, and also considers the 4C model of creativity.
- The authors brainstormed and refined scenario-based impacts across the tetrads, then grouped them into the five research themes.
## Limitations
- The authors explicitly state that the scenarios and tetrads are not exhaustive and that different groups may produce different scenarios, questions, and impacts.
- They also say the framework does not directly encourage consideration of ethical, legal, and sustainability issues; they note these should be incorporated when researching the themes.
- Evident from the text: the paper is speculative and not empirically tested, so its claims are projections rather than measured outcomes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
17 Valid · 2 Not valid · 25 Not checked · 8 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“existing studies of GenAI for other types of creative work document mixed results (e.g., [22])”
What the sources say
- Supportedcites [22] source
Section 5.1 (p. 8) reports that prior studies found LLMs capable of generating coherent stories and assisting creative writers, while noting that those studies did not establish whether a quality gap remained. This paper’s own results (p. 2) find a substantial creativity gap between LLM-generated and expert-written stories. Together, these passages support the broad characterization of mixed results for GenAI in creative work. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Factors such as the diversity of perspectives brought by different team members [81], psychological safety to contribute nonsense ideas or make mistakes [137], and enabling everyone to meaningful participate [101] are just a few factors that have been shown to play an important role in improving the creativity of teams.”
What the sources say
- Not checked — no full text of the sourcecites [81] source
- Supportedcites [137] Amy Zadow, May Young Loh, Maureen Frances Dollard, Gro Ellen Mathisen, and Bella Yantcheva. 2023. Psychosocial safety climate as a predictor of work engagement, creativity, innovation, and work performance: A case study of software engineers. Frontiers in Psychology 14 (2023). 1664–1078 [138] Yunpu Zhao, Rui Zhang, Wenyi Li, Di Huang, Jiaming Guo, Shaohui Peng, Yifan Hao, Yuanbo Wen, Xing Hu, Zidong Du, et al. 2024. Assessing and understanding creativity in large language models. arXiv:2401.12491. Retrieved from https://arxiv.org/abs/2401.12491 [139] Eric Zhou and Dokyun Lee. 2024. Generative source
The Psychosocial safety climate section states that psychological safety lets employees voice opinions without embarrassment or undesirable consequences and reports research linking it to increased creativity. The Discussion also links creative output to feeling secure enough to take interpersonal risks. These passages support the part of the citing sentence attached to this source: psychological safety to offer ideas or make mistakes. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites [101] source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Much research on GenAI and its promise for creativity tends to be about singular, relatively short tasks that are mostly unconstrained (e.g., write a poem on some topic and in a certain style, generate alternative uses, provide a list of ideas).”
What the sources say
- Partly supportedcites [98] William Orwig, Emma R. Edenbaum, Joshua D. Greene, and Daniel L. Schacter. 2024. The language of creativity: Evidence from humans and large language models. The Journal of Creative Behavior 58, 1 (2024), 128–136. sourceExperimental — accuracy not yet measured
The paper’s opening discussion describes GenAI creativity studies using the Alternative Uses Task and poetry, supporting the examples of brief, stand-alone creative tasks. It does not establish that most research uses mostly unconstrained tasks; its own Methods describe a five-sentence story task requiring three specified words. (LLM, conf=0.82)
- Not checked — no full text of the sourcecites [30] Fabrizio Dell’Acqua, Edward McFowland III, Ethan R. Mollick, Hila Lifshitz-Assaf, Katherine Kellogg, Saran Rajendran, Lisa Krayer, François Candelon, and Karim R. Lakhani. 2023. Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Harvard Business School Technology & Operations Mgt. Unit Working Paper 24–013 (2023). source
- Could not verifycites [17] Noah Bohren, Rustamdjan Hakimov, and Rafael Lalive. 2024. Creative and Strategic Capacities of Generative AI: Evidence from Large-Scale Experiments. Technical Report. Institute of Labor Economics (IZA). sourceExperimental — accuracy not yet measured
Our copy contains no passage characterizing the broader GenAI-creativity literature as resting on singular, short, mostly unconstrained tasks. The Introduction (p. 5) instead says existing GenAI research shows productivity gains in customer efficiency, professional writing and legal services 'but these tasks require relatively little creativity', and the related-work discussion (p. 8) credits specific studies (Charness and Grieco 2024 on open vs closed tasks; Girotra et al. 2023b on product ideas) without generalizing about their task length or constraint level. The Tasks section (pp. 29-30) only concedes 'one potential criticism is the specificity of the tasks chosen' and calls other creative/strategic tasks future research, and the description of the authors' own design (p. 10, 'a divergent (unconstrained) creative task ... up to 1000 characters ... maximum time ... 10 minutes') is about this study, not about 'much research'. Searched: prior AI creativity literature narrow/single task, open-ended unconstrained short task, alternative uses and Guilford divergent thinking — none state the attributed characterization. (LLM, conf=0.62)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Understudied [6], creativity in software engineering is at a watershed moment, as the emergence of Generative AI (GenAI) could have a major impact on individuals, employers, and the products they build.”
- Also stated in: § Related Work · plain
“Creativity within software development is an understudied topic [55, 91].”
What the sources say
- Not checked — no full text of the sourcecites [6] Aamir Amin, Shuib Basri, Mohd Fadzil Hassan, and Mobashar Rehman. 2018. A snapshot of 26 years of research on creativity in software engineering-A systematic literature review. In International Conference on Mobile and Wireless Technologies (ICMWT), 430–438. source
- Supportedcites [55] source
The Creativity Versus Productivity section describes a knowledge gap in understanding creativity in software engineering and says the authors have posed more questions than answers. This supports the citing sentence’s characterization of the topic as understudied. (LLM, conf=0.88)
- Supportedcites [91] Rahul Mohanani, Prabhat Ram, Ahmed Lasisi, Paul Ralph, and Burak Turhan. 2017. Perceptions of creativity in software engineering research and practice. In Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, 210–217. source
The Introduction (p. 1) states that only 'a handful of software engineering (SE) studies seek to understand creativity in SE contexts' and that 'most SE studies involving creativity rush to prescribe tools or techniques to enhance it', and that unlike psychology/philosophy 'SE researchers and practitioners have not' built consensus around creativity's dimensions — i.e. our copy treats creativity in SE as under-explored. The Conclusion (p. 7) reinforces this with 'More research is therefore needed on at least four fronts' (objective assessment, creative processes in projects, person/potential/process/environment effects, autonomy-motivation-creativity). The related-work section (p. 6) likewise confines prior SE attention to RE, design, Agile, collaboration and open source. Minor nuance: the paper's own mapping did include 84 primary studies (p. 2-3), so its emphasis is on shallow/narrow coverage rather than near-absence of literature, but the understudied characterisation is clearly the paper's own. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Related Work · plain
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Empirical evidence on the creativity of LLM outputs is mixed.”
What the sources say
- Supportedcites [98] William Orwig, Emma R. Edenbaum, Joshua D. Greene, and Daniel L. Schacter. 2024. The language of creativity: Evidence from humans and large language models. The Journal of Creative Behavior 58, 1 (2024), 128–136. source
The paper contrasts prior findings: it says Stevenson et al. (2022) would lead one to expect human stories to be rated more creative than GPT-3 stories, whereas poetry studies suggest human and GPT-3 writing might be indistinguishable in creativity. That supports the broad statement that empirical evidence is mixed (passage labeled Abstract; page not provided). (LLM, conf=0.87)
- Not checked — no full text of the sourcecites [30] Fabrizio Dell’Acqua, Edward McFowland III, Ethan R. Mollick, Hila Lifshitz-Assaf, Katherine Kellogg, Saran Rajendran, Lisa Krayer, François Candelon, and Karim R. Lakhani. 2023. Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Harvard Business School Technology & Operations Mgt. Unit Working Paper 24–013 (2023). source
- Supportedcites [118] Orit Shaer, Angelora Cooper, Osnat Mokryn, Andrew L. Kun, and Hagit Ben Shoshan. 2024. AI-augmented brain-writing: Investigating the use of LLMs in group ideation. In CHI Conference on Human Factors in Computing Systems. ACM, 1–17. source
The Results for RQ1 (p. 12) report mixed assessments of GPT-3’s ideas: 50% of students said it offered a unique or expanded viewpoint, while 31% said its output was redundant and lacked creativity. This empirical finding supports the claim, within the paper’s group-ideation setting. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
11 more claims · 1 with their cited sources checked
Create a free account to see all 52 claims and to verify the 10 references still open.
- Probably not a substantial claim. 35
- It may state two separate claims as one. 8
Citations
Cites
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756
International Conference on Learning Representations (ICLR 2013)
松尾, 豊. (2013) · 人工知能学会誌 = Journal of Japanese Society for Artificial Intelligence · Cited by 6,286
A model of creativity and innovation in organizations.
Amabile, T. M. (2020) · Figshare · doi:10.6084/m9.figshare.13040693.v1 · Cited by 4,522
A model of creativity and innovation in organizations.
Amabile, T. M. (2020) · Figshare · doi:10.6084/m9.figshare.13040693 · Cited by 4,492
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895
Psychological Safety: The History, Renaissance, and Future of an Interpersonal Construct
Edmondson, A. C., & Lei, Z. (2014) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-031413-091305 · Cited by 3,311 · cited 1×
“Working in a psychologically safe climate [34] can aid creativity [137], as can having a supportive manager who encourages new ideas [27].”
Anderson, N., Potočnik, K., & Zhou, J. (2014) · Journal of Management · doi:10.1177/0149206314527128 · Cited by 3,103
Boden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775
Beyond Big and Little: The Four C Model of Creativity
Kaufman, J. C., & Beghetto, R. A. (2009) · Review of General Psychology · doi:10.1037/a0013688 · Cited by 2,669
Is It an agent, or just a program?: A taxonomy for autonomous agents
Franklin, S., & Graesser, A. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0013570 · Cited by 2,286 · cited 1×
“Such is the purpose of this article: to raise awareness of the issue and identify important directions for future research.”
Conceptual Integration Networks
Fauconnier, G., & Turner, M. B. (1998) · Cognitive Science · doi:10.1016/s0364-0213(99)80038-x · Cited by 2,038
West, M. A. (2002) · Applied Psychology · doi:10.1111/1464-0597.00951 · Cited by 1,536
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
Society, Culture, and Person: A Systems View of Creativity
Csikszentmihalyi, M. (2014) · The Systems Model of Creativity · doi:10.1007/978-94-017-9085-7_4 · Cited by 1,289 · cited 1×
“This article takes the first step to drawing attention to this topic via two contributions: The Impact of GenAI on Creativity in Sw. Dev.”
Venkatesh, V., Thong, J. Y. L., & Xin, X. (2012) · Journal of the Association for Information Systems · doi:10.5281/zenodo.897039 · Cited by 1,277
What Differences Make a Difference?: The Promise and Reality of Diverse Teams in Organizations
Mannix, E., & Neale, M. A. (2005) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2005.00022.x · Cited by 1,276
From creativity to innovation: The social network drivers of the four phases of the idea journey
Perry-Smith, J. E., & Mannucci, P. V. (2017) · Academy of Management Review · doi:10.5465/amr.2014.0462 · Cited by 1,121 · cited 1×
“Just as recent studies cast some doubt on the productivity effects of GenAI (e.g., [70]), and existing studies of GenAI for other types of creative work document mixed results (e.g., [22]), studies need to be performed that carefully assess the impact of GenAI on creativity in software development,…”
A survey on large language model (LLM) security and privacy: The Good, The Bad, and The Ugly
Yao, Y., Duan, J., Xu, K., Cai, Y., Sun, Z., & Zhang, Y. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100211 · Cited by 1,083
Large Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695988 · Cited by 1,029
Shneiderman, B. (2022) · doi:10.1093/oso/9780192845290.001.0001 · Cited by 955
The Dark (Patterns) Side of UX Design
Gray, C. M., Kou, Y., Battles, B., Hoggatt, J., & Toombs, A. L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174108 · Cited by 848
Idea Generation in Groups: A Basis for Creativity in Organizations
Paulus, P. B., & Yang, H.-C. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2888 · Cited by 833
Can We Trust Creativity Tests? A Review of the Torrance Tests of Creative Thinking (TTCT)
Kim, K. H. (2006) · Creativity Research Journal · doi:10.1207/s15326934crj1801_2 · Cited by 830 · cited 1×
“This article takes the first step to drawing attention to this topic via two contributions: The Impact of GenAI on Creativity in Sw. Dev.”
The creative mind: Myths and mechanisms
Lustig, R. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(95)90025-x · Cited by 823
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
Large language models for software engineering: survey and open problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00008 · Cited by 650
Large Language Models for Software Engineering: Survey and Open Problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · arXiv · doi:10.48550/arxiv.2310.03533 · Cited by 523
The progress principle: using small wins to ignite joy, engagement, and creativity at work
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0377 · Cited by 484
Generative artificial intelligence, human creativity, and art
Zhou, E., & Lee, D. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae052 · Cited by 459
Bouschery, S. G., Blazevic, V., & Piller, F. T. (2023) · Journal of Product Innovation Management · doi:10.1111/jpim.12656 · Cited by 444
Thinking responsibly about responsible AI and ‘the dark side’ of AI
Mikalef, P., Conboy, K., Lundström, J. E., & Popovič, A. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2022.2026621 · Cited by 435
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · cited 1×
“Such tools can, and should, build upon the rich research into Creativity Support Tools [43].”
Prompt Engineering in Large Language Models
Marvin, G., Hellen, N., Jjingo, D., & Nakatumba-Nabende, J. (2024) · Algorithms for Intelligent Systems · doi:10.1007/978-981-99-7962-2_30 · Cited by 403
Gender bias and stereotypes in Large Language Models
Kotek, H., Dockum, R., & Sun, D. (2023) · Proceedings of The ACM Collective Intelligence Conference · doi:10.1145/3582269.3615599 · Cited by 381
Wordcraft: Story Writing With Large Language Models
Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511105 · Cited by 374
Paulus, P. B., & Brown, V. R. (2007) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00006.x · Cited by 364
Biases in Large Language Models: Origins, Inventory, and Discussion
Navigli, R., Conia, S., & Ross, B. (2023) · Journal of Data and Information Quality · doi:10.1145/3597307 · Cited by 364
Lee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345
The Crowdless Future? Generative AI and Creative Problem Solving
Boussioux, L., N. Lane, J., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2023) · doi:10.2139/ssrn.4533642 · Cited by 343
The Crowdless Future? Generative AI and Creative Problem-Solving
Boussioux, L., Lane, J. N., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2024) · Organization Science · doi:10.1287/orsc.2023.18430 · Cited by 329
Generative AI for Software Practitioners
Ebert, C., & Louridas, P. (2023) · IEEE Software · doi:10.1109/ms.2023.3265877 · Cited by 293
Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
Louie, R., Coenen, A., Huang, C. Z., Terry, M., & Cai, C. J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376739 · Cited by 271 · cited 1×
“One common research theme is investigating how humans can co-create with GenAI for a variety of tasks commonly considered as creative including interaction design [63, 117, 129], music composition [77], writing [64, 72, 136], and research ideation [75, 108].”
Barricelli, B. R., Cassano, F., Fogli, D., & Piccinno, A. (2019) · Journal of Systems and Software · doi:10.1016/j.jss.2018.11.041 · Cited by 265
Best humans still outperform artificial intelligence in a creative divergent thinking task
Koivisto, M., & Grassini, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-40858-3 · Cited by 247
Lessons from open-source software development
O'Reilly, T. (1999) · Communications of the ACM · doi:10.1145/299157.299164 · Cited by 236
Artificial intelligence as a tool for creativity
Ivčević, Z., & Grandinetti, M. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2024.100079 · Cited by 224
Navigating the Complexity of Generative AI Adoption in Software Engineering
Russo, D. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3652154 · Cited by 217 · cited 1×
“…years, with a commensurate explosion in research exploring new opportunities for LLM use in support of different development tasks (e.g., coding [14], code review [28], testing [115], debugging [60]) and research studying how industry is grappling with adopting LLM driven tools (e.g., [104, 113]).”
Self-citationCreativity in innovative projects: How teamwork matters
Hoegl, M., & Parboteeah, K. P. (2007) · Journal of Engineering and Technology Management · doi:10.1016/j.jengtecman.2007.01.008 · Cited by 212
Creativity and Well‐being: A Meta‐analysis
Acar, S., Tadik, H., Myers, D., van der Sman, C., & Uysal, R. (2021) · The Journal of Creative Behavior · doi:10.1002/jocb.485 · Cited by 208
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188 · cited 1×
“Distance can lead to reduced creativity since distributed software designers spend less time exploring the problem space than co-located designers [58].”
Creativity and artificial intelligence: A multilevel perspective
Grilli, L., & Pedota, M. (2024) · Creativity and Innovation Management · doi:10.1111/caim.12580 · Cited by 179
Provoking Creativity: Imagine What Your Requirements Could Be Like
Maiden, N., Gizikis, A., & Robertson, S. (2004) · IEEE Software · doi:10.1109/ms.2004.1331305 · Cited by 170
The originality of machines: AI takes the Torrance test
Guzik, E. E., Byrge, C., & Gilde, C. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100065 · Cited by 165 · cited 1×
“Distance can lead to reduced creativity since distributed software designers spend less time exploring the problem space than co-located designers [58].”
Kajzer Mitchell, I., & Walinga, J. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.09.162 · Cited by 164 · cited 1×
“Creativity helps companies produce novel products and improve their processes [79] as well as work towards meeting their sustainability efforts [89].”
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Bird, C., Ford, D., Zimmermann, T., Forsgren, N., Kalliamvakou, E., Lowdermilk, T., & Gazit, I. (2022) · Queue · doi:10.1145/3582083 · Cited by 158
"I wouldn't say offensive but...": Disability-Centered Perspectives on Large Language Models
Gadiraju, V., Kane, S., Dev, S., Taylor, A., Wang, D., Denton, R., & Brewer, R. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3593989 · Cited by 155
McGuire, J., De Cremer, D., & Van de Cruys, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-69423-2 · Cited by 150
Suh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148
Art or Artifice? Large Language Models and the False Promise of Creativity
Chakrabarty, T., Laban, P., Agarwal, D., Muresan, S., & Wu, C.-S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642731 · Cited by 135
The Temperature Feature of ChatGPT: Modifying Creativity for Clinical Research
Davis, J., Bulck, L. V., Durieux, B. N., & Lindvall, C. J. (2024) · JMIR Human Factors · doi:10.2196/53559 · Cited by 135
AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Shaer, O., Cooper, A., Mokryn, O., Kun, A. L., & Ben Shoshan, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642414 · Cited by 130 · cited 1×
“Conversely, other studies highlight LLMs under-performance in comparison to humans [118].”
A Quantitative and Qualitative Evaluation of LLM-Based Explainable Fault Localization
Kang, S., An, G., & Yoo, S. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660771 · Cited by 128 · cited 1×
“…years, with a commensurate explosion in research exploring new opportunities for LLM use in support of different development tasks (e.g., coding [14], code review [28], testing [115], debugging [60]) and research studying how industry is grappling with adopting LLM driven tools (e.g., [104, 113]).”
Measuring GitHub Copilot's Impact on Productivity
Ziegler, A., Kalliamvakou, E., Li, X. A., Rice, A., Rifkin, D., Simister, S., Sittampalam, G., & Aftandilian, E. (2024) · Communications of the ACM · doi:10.1145/3633453 · Cited by 124 · cited 1×
“…although most research, studies, and discussions in the media have concentrated on GenAI and programmer productivity (e.g., [14, 140]), understanding the short-term, medium-term, and long-term impacts and connections between GenAI and creativity in software development warrants equal, if…”
CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI
Choi, D., Hong, S., Park, J., Chung, J. J. Y., & Kim, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642794 · Cited by 124
Exploring Trust in Self-Driving Vehicles Through Text Analysis
Lee, J. D., & Kolodge, K. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819872672 · Cited by 118
The effect of AI-based inspiration on human design ideation
Kim, J., & Maher, M. L. (2023) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2023.2167124 · Cited by 114 · cited 1×
“Product creativity also has received little attention beyond a few studies on Open Source Software (OSS) , with some claiming it is more creative than commercial software [62, 97] and another study framing innovation in OSS projects as novel reuse of existing libraries [37].”
Large Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2308.10620 · Cited by 114
On the creativity of large language models
Franceschelli, G., & Musolesi, M. (2025) · AI & SOCIETY · doi:10.1007/s00146-024-02127-3 · Cited by 113
Kidane, Y. H., & Gloor, P. A. (2006) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-006-9006-3 · Cited by 107
Mumford, M. D., Hester, K. S., & Robledo, I. C. (2012) · Handbook of Organizational Creativity · doi:10.1016/b978-0-12-374714-3.00001-x · Cited by 107 · cited 1×
“Creativity is considered an antecedent to the innovation [9] critical for companies to perform and grow [93].”
What Makes a Great Software Engineer?
Li, P. L., Ko, A. J., & Zhu, J. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.335 · Cited by 106
Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty EvaluationPreprint
Radensky, M., Shahid, S., Fok, R., Siangliulue, P., Hope, T., & Weld, D. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.14634 · Cited by 105
Simulating the Human in HCD with ChatGPT: Redesigning Interaction Design with AI
Schmidt, A., Elagroudy, P., Draxler, F., Kreuter, F., & Welsch, R. (2024) · interactions · doi:10.1145/3637436 · Cited by 102
The effects of the six thinking hats and speed on creativity in brainstorming
Göçmen, Ö., & Coşkun, H. (2019) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2019.02.006 · Cited by 96
Lu, L.-C., Chen, S.-J., Pai, T.-M., Yu, C.-H., Lee, H.-Y., & Sun, S.-H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.06373 · Cited by 95
Trustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps
Lo, D. (2023) · IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00010 · Cited by 91
In Pursuit of Everyday Creativity
Amabile, T. M. (2017) · The Journal of Creative Behavior · doi:10.1002/jocb.200 · Cited by 86
Lua, E., Liu, D., & Shalley, C. E. (2024) · Journal of Organizational Behavior · doi:10.1002/job.2690 · Cited by 84
Collaborative Diffusion: Boosting Designerly Co-Creation with Generative AI
Verheijden, M. P., & Funk, M. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585680 · Cited by 83 · cited 1×
“Product creativity also has received little attention beyond a few studies on Open Source Software (OSS) , with some claiming it is more creative than commercial software [62, 97] and another study framing innovation in OSS projects as novel reuse of existing libraries [37].”
Motivation and Satisfaction of Software Engineers
Franca, C., da Silva, F. Q. B., & Sharp, H. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2842201 · Cited by 79
The impact of personality traits and knowledge collection behavior on programmer creativity
Amin, A., Basri, S. B., Rehman, M., Capretz, L. F., Akbar, R., Gilal, A. R., & Shabbir, M. F. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106405 · Cited by 77
In Pursuit of Everyday Creativity.
Amabile, T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3010179 · Cited by 77
Generative Artificial Intelligence for Software Engineering - a Research Agenda
NguyenDuc, A., Cabrero-Daniel, B., Arora, C., Przybylek, A., Khanna, D., Herda, T., Rafiq, U., Melegati, J., Guerra, E., Kemell, K.-K., et al. (2023) · doi:10.2139/ssrn.4622517 · Cited by 71
PopBlends: Strategies for Conceptual Blending with Large Language Models
Wang, S., Petridis, S., Kwon, T., Ma, X., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580948 · Cited by 64
Ulfsnes, R., Moe, N. B., Stray, V., & Skarpen, M. (2024) · Generative AI for Effective Software Development · doi:10.1007/978-3-031-55642-5_10 · Cited by 62
Santos, R., Santos, Í., de Magalhães, C. V. C., & Santos, R. D. S. (2024) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst60714.2024.00039 · Cited by 62
Kim, J., Suh, S., Chilton, L. B., & Xia, H. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595996 · Cited by 61 · cited 1×
“Product creativity also has received little attention beyond a few studies on Open Source Software (OSS) , with some claiming it is more creative than commercial software [62, 97] and another study framing innovation in OSS projects as novel reuse of existing libraries [37].”
Experimental narratives: A comparison of human crowdsourced storytelling and AI storytelling
Beguš, N. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03868-8 · Cited by 60
Granados, C., & Pareja‐Eastaway, M. (2019) · Innovation · doi:10.1080/14479338.2019.1585190 · Cited by 59
Ulfsnes, R., Moe, N. B., Stray, V., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2405.01543 · Cited by 58
Assessing and understanding creativity in large language models
Zhao, Y., Zhang, R., Li, W., & Li, L. (2025) · Machine Intelligence Research · doi:10.1007/s11633-025-1546-4 · Cited by 57
The language of creativity: Evidence from humans and large language models
Orwig, W., Edenbaum, E. R., Greene, J. D., & Schacter, D. L. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.636 · Cited by 56
Exploring the Role of Creativity in Software Engineering
Groeneveld, W., Luyten, L., Vennekens, J., & Aerts, K. (2021) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1109/icse-seis52602.2021.00009 · Cited by 53
Putting GPT-3's Creativity to the (Alternative Uses) Test
Stevenson, C., Smal, I., Baas, M., Grasman, R., & van der Maas, H. (2022) · arXiv · doi:10.48550/arxiv.2206.08932 · Cited by 51
Comparative Analysis of Generative AI Risks in the Public Sector
Navarro, M. A. B., Mondragón, M. I. R., & Han, S. H. (2024) · Annual International Conference on Digital Government Research · doi:10.1145/3657054.3657125 · Cited by 49
Generative AI for Effective Software Development
Nguyen-Duc, A., Abrahamsson, P., & Khomh, F. (2024) · Springer eBooks · doi:10.1007/978-3-031-55642-5 · Cited by 45
Proceedings of the 5th conference on Creativity & cognition
Edmonds, E. A., Candy, L., Brown, P. H., et al. (2005) · Creativity and Cognition · Cited by 44
Shi, J., Yang, Z., & Lo, D. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708525 · Cited by 43
Mirowski, P., Love, J., Mathewson, K., & Mohamed, S. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658993 · Cited by 37
Generative AI in Software Engineering Must Be Human-Centered: The Copenhagen Manifesto
Russo, D., Baltes, S., van Berkel, N., Avgeriou, P., Calefato, F., Cabrero-Daniel, B., Catolino, G., Cito, J., Ernst, N., Fritz, T., et al. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112115 · Cited by 34 · cited 2×
“Such is the purpose of this article: to raise awareness of the issue and identify important directions for future research.”
Self-citationNon-cognitive Abilities of Exceptional Software Engineers: A Delphi Study
Groeneveld, W., Jacobs, H., Vennekens, J., & Aerts, K. (2020) · Proceedings of the 51st ACM Technical Symposium on Computer Science Education · doi:10.1145/3328778.3366811 · Cited by 25
Davila, N., Melegati, J., & Wiese, I. (2024) · IEEE Software · doi:10.1109/ms.2024.3428439 · Cited by 25
Perceptions of Creativity in Software Engineering Research and Practice
Mohanani, R., Ram, P., Lasisi, A., Ralph, P., & Turhan, B. (2017) · 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2017.21 · Cited by 24
Self-citationHow Templated Requirements Specifications Inhibit Creativity in Software Engineering
Mohanani, R., Ralph, P., Turhan, B., & Mandić, V. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3112503 · Cited by 22
Self-citationDoes Writing with Language Models Reduce Content Diversity?
Padmakumar, V., & He, H. (2023) · arXiv · doi:10.48550/arxiv.2309.05196 · Cited by 21
Zadow, A., Loh, M. Y., Dollard, M. F., Mathisen, G. E., & Yantcheva, B. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1082283 · Cited by 20
The Return of Formal Requirements Engineering in the Era of Large Language Models
Spoletini, P., & Ferrari, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-57327-9_22 · Cited by 20
Amin, A., Basri, S., Hassan, M. F., & Rehman, M. (2018) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-5281-1_47 · Cited by 18
How Software Development Group Leaders Influence Team Members' Innovative Behavior
da Silva, F. Q. B., Monteiro, C. V. F., dos Santos, I. E., & Capretz, L. F. (2016) · IEEE Software · doi:10.1109/ms.2016.120 · Cited by 17
Requirements Engineering: Foundation for Software Quality
Vincenzo Gervasi, A. V., Gervasi, V., & Vogelsang, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98464-9 · Cited by 16
A disruptive research playbook for studying disruptive innovations
Storey, M.-A., Russo, D., Novielli, N., Kobayashi, T., & Wang, D. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3678172 · Cited by 15
Self-citationThe Effects of Developer Dynamics on Fitness in an Evolutionary Ecosystem Model of the App Store
Lim, S. L., Bentley, P. J., & Ishikawa, F. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2494382 · Cited by 13
Generative Artificial Intelligence for Software Engineering -- A Research AgendaPreprint
Nguyen‐Duc, A., Cabrero‐Daniel, B., Przybyłek, A., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.18648 · Cited by 13
How much creative potential is expressed at work?
Runco, M. A., Shepard, A. C., & Tadık, H. (2021) · Journal of Creativity · doi:10.1016/j.yjoc.2021.100016 · Cited by 12
Fang, H., Herbsleb, J. D., & Vasilescu, B. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3608142 · Cited by 11
Self-citationOutcomes of creativity in organizations: From organization to human-centered benefits
Puccio, G., & Schwartz, M. (2023) · Handbook of Organizational Creativity · doi:10.1016/b978-0-323-91840-4.00004-9 · Cited by 10
Teaching Software Metrology: The Science of Measurement for Software Engineering
Ralph, P., Kuutila, M., Arif, H., & Ayoola, B. (2024) · Springer eBooks · doi:10.1007/978-3-031-71769-7_5 · Cited by 10
Self-citationBorum, N., Brooks, E. P., & Frimodt-Møller, S. R. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07233-3_3 · Cited by 9
Developer productivity for humans, part 8: Creativity in software engineering
Inman, S., D’Angelo, S., & Vasilescu, B. (2024) · IEEE Software · doi:10.1109/ms.2023.3340831 · Cited by 9
Self-citationTeam Creativity in a Hybrid Software Development World: Eight Approaches
Jackson, V., Prikladnicki, R., van der Hoek, A., & Marshall, L. (2023) · IEEE Software · doi:10.1109/ms.2022.3229353 · Cited by 9
Self-citationKamath, U., Keenan, K., Somers, G., & Sorenson, S. (2024) · Large Language Models: A Deep Dive · doi:10.1007/978-3-031-65647-7_6 · Cited by 9
Mob programming: From avant-garde experimentation to established practice
Ståhl, D., & Mårtensson, T. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111017 · Cited by 9
The Rise and Fall of the Segway
Clark, A. V., Atkinson-Palombo, C., & Garrick, N. W. (2019) · Transfers · doi:10.3167/trans.2019.090203 · Cited by 8
Poth, A., Wildegger, A., & Levien, D.-A. (2024) · Communications in Computer and Information Science · doi:10.1007/978-3-031-71142-8_12 · Cited by 8
Early Results from a Study of GenAI Adoption in a Large Brazilian Company: The Case of Globo
Pereira, G. V., Prikladnicki, R., Jackson, V., van der Hoek, A., Fortes, L., & Macaubas, I. (2024) · Springer eBooks · doi:10.1007/978-3-031-55642-5_13 · Cited by 8
Self-citationTowards AI for Software Systems
Eskandani, N., & Salvaneschi, G. (2024) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3664646.3664767 · Cited by 7
Generative Monoculture in Large Language Models
Wu, F., Black, E., & Chandrasekaran, V. (2024) · arXiv · doi:10.48550/arxiv.2407.02209 · Cited by 7 · cited 1×
“…transformational creativity” [40], and that there continues to be a risk of generative monoculture, i.e., “a significant narrowing of model output diversity relative to available training data for a given task” despite countermeasures such as altering sampling or prompting strategies [134].”
Design thinking and creativity of colocated versus globally distributed software developers
Jolak, R., Wortmann, A., Liebel, G., Umuhoza, E., & Chaudron, M. R. V. (2021) · Journal of Software Evolution and Process · doi:10.1002/smr.2377 · Cited by 7
Creative and Strategic Capabilities of Generative Ai: Evidence from Large-Scale Experiments
Bohren, N., Hakimov, R., & Lalive, R. (2024) · doi:10.2139/ssrn.4963992 · Cited by 7
Design thinking and creativity of colocated versus globally distributed software developers
Jolak, R., Wortmann, A., Liebel, G., Umuhoza, E., & Chaudron, M. R. V. (2021) · RWTH Publications (RWTH Aachen) · Cited by 6
Shi, J., Yang, Z., & Lo, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.04566 · Cited by 4
A Disruptive Research Playbook for Studying Disruptive InnovationsPreprint
Storey, M., Russo, D., Novielli, N., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.13329 · Cited by 3
Self-citationWang, J., & Carroll, J. M. (2011) · Creativity and Cognition · doi:10.1145/2069618.2069714 · Cited by 2
Teaching Software Metrology: The Science of Measurement for Software EngineeringPreprint
Ralph, P., Kuutila, M., Arif, H., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.14494 · Cited by 1
Self-citationMohanani, R., Ralph, P., Turhan, B., & Mandić, V. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4006444 · Cited by 1
Self-citationMcLuhan, M. (1977) · ETC.: A Review of General Semantics · doi:10.66774/etc_3402_173 · Cited by 1
Atemkeng, M., Hamlomo, S., Welman, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2408.10554
PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation
Liu, Y., Sharma, P., Oswal, M. J., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.12538
Assessing and Understanding Creativity in Large Language Models
Zhao, Y., Zhang, R., Li, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2401.12491
Research works printed but not linked: 8
- Teresa M. Amabile. 1996. Creativity in Context (2nd. ed.). Westview Press, Inc., Boulder, Colorado.
- Robert L. Glass. 1994. Software Creativity. Prentice-Hall, Inc., Atlanta.
- Rochelle King, Elizabeth F. Churchill, and Caitlin Tan. 2017. Designing with Data: Improving the User Experience with A/B Testing. O’Reilly Media, Inc.
- Brian Merchant. 2023. Blood in the Machine: The Origins of the Rebellion against Big Tech (1st. ed.). Little, Brown and Company.
- Gavin Mueller. 2021. Breaking Things at Work (1st. ed.). Verso, London, UK.
- Surabhi S. Nath, Peter Dayan, and Claire Stevenson. 2024. Characterising the creative process in humans and large language models. In International Conference on Computational Creativity (ICCC).
- Max Peeperkorn, Tom Kouwenhoven, Dan Brown, and Anna Jordanous. 2024. Is temperature the creativity parameter of large language models? In International Conference on Computational Creativity (CC).
- Mel Rhodes. 1961. An analysis of creativity. The Phi Delta Kappan 42, 7 (1961), 305–310.
Cited by
Software Engineering by and for Humans in an AI Era
Abrahão, S., Grundy, J., Pezzè, M., Storey, M., & Tamburri, D. A. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715111 · Cited by 81
A 2030 Roadmap for Software Engineering
Pezzè, M., Abrahão, S., Penzenstadler, B., Poshyvanyk, D., Roychoudhury, A., & Yue, T. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3731559 · Cited by 13
Mellado, R., & Cubillos, C. (2025) · Applied Sciences · doi:10.3390/app15115867 · Cited by 22
Ferino, S., Hoda, R., Grundy, J., & Treude, C. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3800580 · Cited by 40
From Disruptions to Discussions: How GenAI Impacts Human Interactions in Software Development
Salomon, M., Koshchenko, E., Sergeyuk, A., Holmes, R., Murphy, G. C., & Fritz, T. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3655626 · Cited by 1
“We chose to apply this model as it has been previously used for such purposes for similar software engineering impact assessments (e.g., [42]–[44]).”
Metadata
- Authors
- Jackson, V., Vasilescu, B., Russo, D., Ralph, P., Prikladnicki, R., Izadi, M., D’Angelo, S., Inman, S., Andrade, A., & van der Hoek, A.
- Affiliations
- University of California, Irvine (US)
- Carnegie Mellon University (US)
- Aalborg University (DK)
- Dalhousie University (CA)
- Pontifícia Universidade Católica do Rio Grande do Sul (BR)
- Google Inc, Canterbury, New Zealand
- Google (United States) (US)
- University of California Irvine, Irvine, California, USA
- ORCID
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2025-05-24
- Volume
- 34
- Issue
- 5
- Pages
- 1-28
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W4405570253
- Cited by
- 23
- References
- 111
- Citations by year
- 2026: 15 · 2025: 8
- FWCI
- 8.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Transactions on Software Engineering and Methodology (publishedVersion, cc-by)
- ePrints Soton (University of Southampton) (submittedVersion, public-domain)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion, cc-by)
- Funders
- Copenhagen Symposium on Human-Centered Software Engineering (G-2023-21020 and CF23-0208)
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brazil (CAPES)—Finance (001)
- NSERC Discovery (RGPIN-2020-05001)
- NSF awards (1901311, 2107298, and 2317168)
- Google Open Source Programs Office, and a Google Award
- National Science Foundation (CCF-2210812 and 2326489)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- generative AI, creativity, software development, human creativity, competitive advantage, future of software development, team competence, unintended consequences, social impact
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.