The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index; 13 of the 26 sources its claims cite were checked for support.
Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
Open accessAbstract
Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it’s unclear how this will impact unassisted human creativity. We conducted two large pre-registered parallel experiments involving 1,100 participants attempting tasks targeting the two core components of creativity, divergent and convergent thinking. We compare the effects of two forms of large language model (LLM) assistance—a standard LLM providing direct answers and a coach-like LLM offering guidance—with a control group receiving no AI assistance, and focus particularly on how all groups perform in a final, unassisted stage. Our findings reveal that while LLM assistance can provide short-term boosts in creativity during assisted tasks, it may inadvertently hinder independent creative performance when users work without assistance, raising concerns about the long-term impact on human creativity and cognition.
Overview
CoChat Summary
TL;DR
Two pre-registered randomized experiments with 1,100 participants tested whether standard LLM answers or coach-like LLM guidance affect later unassisted divergent and convergent thinking. LLM assistance helped during assisted exposure rounds but did not improve—and sometimes worsened—independent performance afterward, with persistent idea homogenization in the strategy-guidance condition.
Key findings
- In divergent thinking (AUT), exposure to LLM assistance did not improve later unassisted originality or fluency; participants exposed to the List of Strategies performed significantly worse on test-round originality than those with no LLM exposure (p = 0.009), and test-round fluency did not differ significantly across conditions (H(2) = 1.14, p = 0.566).
- In convergent thinking (RAT), LLM Answer users did better during exposure, but in unassisted test rounds LLM Guidance participants performed significantly worse than no-LLM participants (p = 0.005; mean difference = -10.6, 95% CI [-18.6, -2.7]); LLM Answer did not differ significantly from no LLM (p = 0.682).
- Homogenization persisted for LLM-generated strategies: in the AUT test phase, List of Strategies participants generated more similar ideas than no-LLM participants (p = 0.017), while List of Ideas did not show the same lasting effect.
- Across both experiments, self-reported creativity declined after the experiment; in the RAT study, LLM Guidance showed an average reduction more than twice that of no LLM assistance, and no-LLM participants were most likely to find exposure rounds helpful.
Methods
- Two pre-registered between-subjects experiments recruited 1,100 Prolific participants (US/UK, fluent English): Experiment 1 had 460 participants for divergent thinking using the Alternate Uses Test (AUT), and Experiment 2 had 640 participants for convergent thinking using the Remote Associates Test (RAT).
- Both used exposure rounds with randomized conditions—Exp. 1: None, List of Ideas, List of Strategies; Exp. 2: None, LLM Answer, LLM Guidance—followed by a 1-minute Snake distractor and then unassisted test rounds.
- Exp. 1 analyzed 9,457 ideas using Kruskal-Wallis tests with Dunn’s post-hoc Bonferroni correction; originality was scored with a fine-tuned GPT-3 classifier (r = 0.81 with human judgments), and diversity used SBERT embeddings plus 150 Monte Carlo runs for group-level diversity. Exp. 2 used ANCOVA controlling for verbal fluency, followed by Tukey’s HSD.
Limitations
- Stated: creativity was measured only through short, verbal lab tasks; the short exposure period may yield smaller effects than real-world prolonged LLM use; only five AUT objects were used; LLM guidance was more verbose and introduced more cognitive load; mechanisms such as fatigue or dependency were not isolated; and the static LLM interaction may not reflect dynamic conversational AI use.
- Evident from the text: participants were Prolific crowdworkers in the US/UK who were fluent in English, so generalization to other populations and non-English contexts is uncertain; several pairwise comparisons were non-significant after correction, and the study measures only short-term residual effects after brief exposure.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
7 Valid · 0 Not valid · 8 Not checked · 103 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Across both experiments, we observed that LLM assistance was helpful during the exposure phase, aligning with previous research that highlights LLMs' ability to enhance creative task performance when users have access to AI-generated ideas or strategies [2,14].”
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 5.1.1 LLMs Boost Performance During Exposure, but Unassisted Participants Excel in Test.
What the sources say
- Supportedcites [2] source
The citation supports the background point about LLM-assisted creative performance, not the citing authors’ observation about their own two experiments. In §4.3 (pp. 5–6), participants using ChatGPT generated more ideas and covered more idea categories than participants using the non-AI tool. (LLM, conf=0.88)
- Could not verifycites [14] sourceExperimental — accuracy not yet measured
The claim that assistance helped during the exposure phase is the citing authors’ own finding, not a finding attributed to this source. The cited paper’s Introduction (p. 1) says prior work has explored LLMs as creative-writing assistants, and §7.3 (p. 17) envisions future co-writing support, but neither reports that access to AI-generated ideas or strategies enhances users’ creative-task performance. Searches for that benefit and for an exposure phase found no supporting passage. (LLM, conf=0.70)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We selected this task due to its widespread use in prior research [16,34], and its compatibility with LLMs.”
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 4.1 Experimental Design
What the sources say
- Not checked — no full text of the sourcecites [16] source
- Partly supportedcites [34] sourceExperimental — accuracy not yet measured
The Introduction identifies the Remote Associates Task as an assessment that predominantly calls on convergent thinking, and the Methods describe its use in this study. The paper does not establish that the RAT was widely used in prior research; its statements that a task was often or extensively used refer to the Alternative Uses Task. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Existing research has shown that LLM usage can lead to the homogenization of ideas within groups, where participants tend to converge on similar outcomes when using AIgenerated suggestions [2,19,45].”
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 5.1.3 Persistent Homogenization of Ideas and the Challenges of Designing LLM Coaches.
What the sources say
- Supportedcites [2] source
The Discussion (p. 8) reports that ChatGPT-assisted ideas were significantly less semantically diverse at the group level than ideas produced with a non-AI tool. It attributes the effect to the LLM suggesting similar ideas to different users. (LLM, conf=0.93)
- Supportedcites [19] source
The paper’s Abstract reports that stories written with LLM-generated ideas were more similar to one another than stories written without them. The Discussion likewise says generative AI reduced the variance in creative outputs. This supports the claim that AI suggestions can lead participants’ outputs to converge. (LLM, conf=0.92)
- Supportedcites [45] source
The Introduction reports increased homogenization when writers used InstructGPT, and Section 5 says different users wrote similar essays on the same topic. This supports the hedged claim that LLM-generated suggestions can lead to convergence, though the paper did not find a statistically significant effect for the base GPT-3 model. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Interestingly, participants who received the List of Ideas performed slightly worse than other conditions, despite being exposed to LLM ideas with a mean originality of 3.25 (±0.1).”
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 3.2.1 Originality.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is nearly 0.5 points higher than the average originality of ideas generated by participants in this condition (on a scale of 1 to 5).”
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 3.2.1 Originality.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
63 more claims
Create a free account to see all 118 claims and every source verdict.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 27
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“that experimental and clinical evidence documents accessdependent rather than transferable performance gains from AI assistance (Wiles et al., 2024;Budzyń et al., 2025;Kumar et al., 2025;Bangerl et al., 2025)”
From The Tragedy of the Cognitive Commons: How AI Could Disrupt the Regeneration of Professional Expertise (2026) · cites this paper as Kumar et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Kumar et al. (2025) andBangerl et al. (2025) found limited skill carryover from AI-assisted ideation tasks, with the effect most pronounced on tasks requiring domain judgment.”
From The Tragedy of the Cognitive Commons: How AI Could Disrupt the Regeneration of Professional Expertise (2026) · cites this paper as Kumar et al. (2025)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, AI-assisted performance does not transfer to unassisted contexts.”
From The Tragedy of the Cognitive Commons: How AI Could Disrupt the Regeneration of Professional Expertise (2026) · cites this paper as Kumar et al. (2025)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This observation aligns with previous research indicating that LLMs may improve short-term creative performance but potentially impair independent creative ability over time [55].”
From Decoupling of Usefulness and Novelty: Evaluating the Impact of Generative AI on Design Outputs and Novice Designers' Creative Thinking (2026) · cites this paper as [55]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Emerging evidence shows measurable shifts in human writing styles, creative ideation, and divergent thinking following the widespread adoption of systems like ChatGPT [46, 6, 7, 24, 44, 79].”
From Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond) (2025) · cites this paper as [46]
Experimental — accuracy not yet measured
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(1, 1256) = 16.715reported p < .001 · recomputed p < .001
“F (1, 1256) = 16.715,p < .001”
- ConsistentF(2, 1256) = 5.134reported p = .006 · recomputed p = .006
“F (2, 1256) = 5.134, p = .006”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 3.1.3 Dependent Variables.
“We measure this by finding the maximum cosine similarity between the embedding of an idea in the Test set and all the ideas in the Exposure set.”
§ Human Creativity in the Age of LLMs Randomized Experiments on Divergent and Convergent Thinking > 3.2.3 Creative Flexibility.
“Figure 4c shows the average creative flexibility across conditions, which measures how different the ideas produced in the Test round are from those produced in the Exposure rounds (a higher value indicates more dissimilarity).”
Citations
Cites
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 2×
“We calculated the median pairwise cosine distances between the embeddings of these ideas, using SBERT to encode them.”
Divergent Thinking as an Indicator of Creative Potential
Runco, M. A., & Acar, S. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.652929 · Cited by 1,427 · cited 4×
“Divergent thinking can be hypothesized to contribute primarily to P-creativity, where the generation of new ideas is the key [51–53].”
InfluentialGenerative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350 · cited 1×
“Existing research has shown that LLM usage can lead to the homogenization of ideas within groups, where participants tend to converge on similar outcomes when using AI-generated suggestions [2, 19, 45].”
In Praise of Convergent Thinking
Cropley, A. (2006) · Creativity Research Journal · doi:10.1207/s15326934crj1803_13 · Cited by 1,216 · cited 2×
“This is consistent with the idea that convergent thinking is more structured and goal-oriented, making it easier for participants to recognize when LLMs are effectively guiding them toward the correct solution [17, 42, 56].”
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Creativity: Yesterday, today and tomorrow
GUILFORD, J. P. (1967) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1967.tb00002.x · Cited by 1,008 · cited 7×
“Convergent thinking, in contrast, focuses on refining these ideas to select the most effective solutions [4, 25].”
InfluentialArt and the science of generative AI
Epstein, Z., Hertzmann, A., the Investigators of Human Creativity, Akten, M., Farid, H., Fjeld, J., Frank, M. R., Groh, M., Herman, L., Leach, N., et al. (2023) · Science · doi:10.1126/science.adh4451 · Cited by 788 · cited 2×
“While there are concerns that this could lead to a deterioration of creative abilities, there is also optimism that these tools, if properly designed, could enhance human creativity while providing momentary assistance [20, 27].”
Normative data for 144 compound remote associate problems
Bowden, E. M., & Jung-Beeman, M. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195543 · Cited by 649 · cited 1×
“For the Remote Associates Test (RAT), we employed a widely-used dataset from Bowden and Jung-Beeman [11].”
Gilhooly, K. J., Fioratou, E., Anthony, S. H., & Wynn, V. (2007) · British Journal of Psychology · doi:10.1111/j.2044-8295.2007.tb00467.x · Cited by 643 · cited 1×
“We draw on key theories by Poincaré and Boden to frame our investigation [9, 21, 38].”
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
(2025) · doi:10.1145/3706598 · Cited by 534
MEDNICK, S. A. (1968) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1968.tb00104.x · Cited by 412 · cited 2×
“This is consistent with the idea that convergent thinking is more structured and goal-oriented, making it easier for participants to recognize when LLMs are effectively guiding them toward the correct solution [17, 42, 56].”
Lee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345 · cited 1×
“Lee et al. [37] introduced a dataset for analyzing GPT-3’s use in creative and argumentative writing, suggesting that the HCI community could foster more detailed examinations of LLMs’ generative capabilities through such datasets.”
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · arXiv · doi:10.48550/arxiv.1908.10084 · Cited by 343
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341 · cited 1×
“We follow a long tradition of scoring responses to the AUT computationally [6, 7].”
Generative AI without guardrails can harm learning: Evidence from high school mathematics
Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2422633122 · Cited by 309
Divergent Thinking, Creativity, and Ideation
Runco, M. A. (2010) · The Cambridge Handbook of Creativity · doi:10.1017/cbo9780511763205.026 · Cited by 258
Best humans still outperform artificial intelligence in a creative divergent thinking task
Koivisto, M., & Grassini, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-40858-3 · Cited by 247 · cited 4×
“Koivisto et al. [33] compared LLM vs. human performance in a divergent thinking task, but without examining how LLM use affects human creativity.”
InfluentialMetacontrol of human creativity: The neurocognitive mechanisms of convergent and divergent thinking
Zhang, W., Sjoerds, Z., & Hommel, B. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116572 · Cited by 242 · cited 1×
“Divergent and convergent thinking constitute critical components of the creative process [16, 18, 24, 32, 48, 62].”
Linkographic Evidence for Concurrent Divergent and Convergent Thinking in Creative Design
Goldschmidt, G. (2016) · Creativity Research Journal · doi:10.1080/10400419.2016.1162497 · Cited by 222 · cited 1×
“Divergent and convergent thinking constitute critical components of the creative process [16, 18, 24, 32, 48, 62].”
Hubert, K. F., Awa, K. N., & Zabelina, D. L. (2024) · Scientific Reports · doi:10.1038/s41598-024-53303-w · Cited by 221 · cited 1×
“However, they still fall short when compared to the best human performers, particularly experts [31, 33].”
Building machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi‐Xuan, T., Ho, M. K., Mansinghka, V. K., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 216
Generative AI Can Harm Learning
Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2024) · doi:10.2139/ssrn.4895486 · Cited by 208
Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101356 · Cited by 202
Lee, C. S., Huggins, A. C., & Therriault, D. J. (2014) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0036773 · Cited by 196 · cited 1×
“For convergent thinking, we use the Remote Associates Test (RAT), where participants find a single word that connects three seemingly unrelated words, assessing their ability to converge on a correct and meaningful solution [36, 42, 61].”
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188 · cited 5×
“Across both experiments, we observed that LLM assistance was helpful during the exposure phase, aligning with previous research that highlights LLMs’ ability to enhance creative task performance when users have access to AI-generated ideas or strategies [2, 14].”
InfluentialCreativity and Art: Three Roads to Surprise
Gaut, B. (2012) · The British Journal of Aesthetics · doi:10.1093/aesthj/ayr041 · Cited by 175
Incubation of creative performance and specific associative priming.
Mednick, M. T., Mednick, S. A., & Mednick, E. V. (1964) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045994 · Cited by 164 · cited 1×
“Research has shown that priming with related words and manually writing responses can enhance performance on RATs— strategies a coach might use for guidance [13, 43].”
Bilingualism and Creativity: Benefits in Convergent Thinking Come with Losses in Divergent Thinking
Hommel, B., Colzato, L. S., Fischer, R., & Christoffels, I. K. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00273 · Cited by 155 · cited 1×
“This model underscores that creativity involves not only generating numerous ideas, but also selecting and refining them [29, 63].”
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606756 · Cited by 151
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · arXiv · doi:10.48550/arxiv.2305.11483 · Cited by 151
Suh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148 · cited 1×
“Suh et al. [58, 59] highlighted that the current interaction paradigm with LLMs tends to converge on a limited set of ideas, potentially stifling creative exploration.”
Scientific Creativity: Divergent and Convergent Thinking and the Impact of Culture
de Vries, H., & Lubart, T. (2017) · The Journal of Creative Behavior · doi:10.1002/jocb.184 · Cited by 143 · cited 1×
“Divergent and convergent thinking constitute critical components of the creative process [16, 18, 24, 32, 48, 62].”
Convergent Thinking Moderates the Relationship between Divergent Thinking and Scientific Creativity
Zhu, W., Shang, S., Jiang, W., Pei, M., & Su, Y. (2019) · Creativity Research Journal · doi:10.1080/10400419.2019.1641685 · Cited by 142
Serrat, O. (2017) · Springer eBooks · doi:10.1007/978-981-10-0983-9_33 · Cited by 137 · cited 1×
“of GPT-4o, using a specialized system prompt Strategies: (shown in Figure 11), generated seven strategies based on the SCAMPER technique [54].”
Art or Artifice? Large Language Models and the False Promise of Creativity
Chakrabarty, T., Laban, P., Agarwal, D., Muresan, S., & Wu, C.-S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642731 · Cited by 135 · cited 2×
“For instance, Chakrabarty et al. [14] found that while LLMs performed competently in creative writing tasks, professionals consistently outperformed them.”
Brinkmann, L., Baumann, F., Bonnefon, J.-F., Derex, M., Müller, T. F., Nussberger, A.-M., Czaplicka, A., Acerbi, A., Griffiths, T. L., Henrich, J., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01742-2 · Cited by 132
Beaty, R. E., Johnson, D. R., Zeitlen, D. C., & Forthmann, B. (2022) · Creativity Research Journal · doi:10.1080/10400419.2022.2025720 · Cited by 130 · cited 1×
“We follow a long tradition of scoring responses to the AUT computationally [6, 7].”
Boden, M. A. (2007) · Think · doi:10.1017/s147717560000230x · Cited by 129 · cited 1×
“Boden’s theory further introduces measures of creativity, distinguishing between P-creativity (psychological creativity) and H-creativity (historical creativity) [8, 9].”
Incubation and creativity: Do something different
Gilhooly, K. J., Georgiou, G. J., & Devery, U. (2012) · Thinking & Reasoning · doi:10.1080/13546783.2012.749812 · Cited by 121 · cited 1×
“Divergent thinking is vital during the Preparation and Incubation phases, where the mind explores various possibilities [4, 23].”
The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
Lu, C., Lu, C., Lange, R. T., Foerster, J., Clune, J., & Ha, D. (2024) · arXiv · doi:10.48550/arxiv.2408.06292 · Cited by 118
Re-examining prominent measures of divergent and convergent creativity
Cortes, R. A., Weinberger, A. B., Daker, R. J., & Green, A. E. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.09.017 · Cited by 116 · cited 2×
“We selected this task due to its widespread use in prior research [16, 34], and its compatibility with LLMs. Similarly to the previous experiment, this study included both exposure (paired) and test (solo) phases.”
Contributions of Processing Ability and Knowledge to Verbal Memory Tasks across the Adult Life-Span
Hedden, T., Lautenschlager, G., & Park, D. C. (2005) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/02724980443000179 · Cited by 114 · cited 1×
“We implemented this measure to account for participants with low English language proficiency, which can significantly confound performance on the RAT [26, 60].”
Wu, C., Huang, S.-Y., Chen, P.-Z., & Chen, H. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.573432 · Cited by 95 · cited 1×
“For convergent thinking, we use the Remote Associates Test (RAT), where participants find a single word that connects three seemingly unrelated words, assessing their ability to converge on a correct and meaningful solution [36, 42, 61].”
Lu, L.-C., Chen, S.-J., Pai, T.-M., Yu, C.-H., Lee, H.-Y., & Sun, S.-H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.06373 · Cited by 95
Creative reasoning across developmental levels: Convergence and divergence in problem creation
Jaarsveld, S., Lachmann, T., & van Leeuwen, C. (2012) · Intelligence · doi:10.1016/j.intell.2012.01.002 · Cited by 91 · cited 1×
“Divergent and convergent thinking constitute critical components of the creative process [16, 18, 24, 32, 48, 62].”
Creativity and Divergent Thinking
Baer, J. (2014) · Psychology Press eBooks · doi:10.4324/9781315806785 · Cited by 84
Qin, H. X., Jin, S., Gao, Z., Fan, M., & Hui, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642105 · Cited by 82 · cited 1×
“Beyond performing tasks autonomously, LLMs can also be utilized to guide users through the conceptual spaces of creative thinking, serving as tools for ‘creativity support’ [1, 30, 46].”
Emergent autonomous scientific research capabilities of large language models
Boiko, D. A., MacKnight, R., & Gomes, G. (2023) · arXiv · doi:10.48550/arxiv.2304.05332 · Cited by 72
On Praising Convergent Thinking: Creativity as Blind Variation and Selective Retention
Simonton, D. K. (2015) · Creativity Research Journal · doi:10.1080/10400419.2015.1063877 · Cited by 69 · cited 2×
“This is consistent with the idea that convergent thinking is more structured and goal-oriented, making it easier for participants to recognize when LLMs are effectively guiding them toward the correct solution [17, 42, 56].”
CREATIVITY AND CONVERGENT THINKING: REFLECTIONS, CONNECTIONS AND PRACTICAL CONSIDERATIONS
Lubart, T. (2016) · Вестник Российского университета дружбы народов. Серия: Психология и педагогика · doi:10.22363/2313-1683-2016-4-7-15 · Cited by 64 · cited 1×
“Experiments using visual creativity tasks, such as the Test of Creative Thinking Drawing Production (TCT-DP) or the Evaluation of Potential Creativity (EoPC) [41], would provide deeper insights into how LLMs impact creativity in non-text domains.”
Role and challenges of ChatGPT and similar generative artificial intelligence in arts and humanities
Rane, N., & Choudhary, S. (2024) · Studies in Humanities and Education · doi:10.48185/she.v5i1.999 · Cited by 59
Math Education with Large Language Models: Peril or Promise?
Kumar, H., Rothschild, D. M., Goldstein, D. G., & Hofman, J. (2023) · doi:10.2139/ssrn.4641653 · Cited by 54
Self-citationMath Education With Large Language Models: Peril or Promise?
Kumar, H., Rothschild, D. M., Goldstein, D. G., & Hofman, J. M. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-98459-4_5 · Cited by 54
Self-citationCan LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
Si, C., Yang, D., & Hashimoto, T. (2024) · arXiv · doi:10.48550/arxiv.2409.04109 · Cited by 48
Use of large language models might affect our cognitive skills
Heersmink, R. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01859-y · Cited by 44 · cited 4×
“Ensuring that users can effectively transition from AI-supported creativity to autonomous creative work will help mitigate potential long-term harms associated with over-reliance on LLMs, as highlighted by concerns in the literature about cognitive decline with repeated AI use [27].”
InfluentialAutomating Creativity Assessment with SemDis: An Open Platform for Computing Semantic DistancePreprint
Beaty, R. E., & Johnson, D. R. (2020) · doi:10.31234/osf.io/nwvps · Cited by 42
Hsueh, S., Ciolfi Felice, M., Alaoui, S. F., & Mackay, W. E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642854 · Cited by 33 · cited 2×
“State-of-the-art generative AI systems have reached proficiency levels that not only match human creativity in certain evaluations [20, 33], but can also enhance the creative output of knowledge workers [1, 2, 30].”
Ashkinaze, J., Mendelsohn, J., Qiwei, L., Budak, C., & Gilbert, E. (2025) · Proceedings of the ACM Collective Intelligence Conference · doi:10.1145/3715928.3737481 · Cited by 33
Capturing, clarifying, and consolidating the curiosity-creativity connection
Koutstaal, W., Kedrick, K., & Gonzalez-Brito, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-19694-4 · Cited by 31 · cited 1×
“We selected this task due to its widespread use in prior research [16, 34], and its compatibility with LLMs. Similarly to the previous experiment, this study included both exposure (paired) and test (solo) phases.”
Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experiment
Spatharioti, S. E., Rothschild, D. M., Goldstein, D. G., & Hofman, J. M. (2023) · arXiv · doi:10.48550/arxiv.2307.03744 · Cited by 26 · cited 2×
“Although the long-term effects of Generative AI use has been studied empirically in domains such as education [5, 35], web search [57], etc., there is a lack of empirical evidence on the effect of Generative AI tools on our convergent and divergent thinking abilities.”
Roemmele, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.04007 · Cited by 26
Does Writing with Language Models Reduce Content Diversity?
Padmakumar, V., & He, H. (2023) · arXiv · doi:10.48550/arxiv.2309.05196 · Cited by 21
Steroids, Sneakers, Coach: The Spectrum of Human-AI RelationshipsPreprint
Hofman, J. M., Goldstein, D. G., & Rothschild, D. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4578180 · Cited by 16 · cited 2×
“Hofman et al. [28] introduced a sports metaphor to conceptualize the spectrum of the impact of Generative AI on human cognition.”
Divergent Versus Convergent Thinking
Разумникова, О. М. (2020) · Springer eBooks · doi:10.1007/978-3-319-15347-6_362 · Cited by 11 · cited 1×
“Divergent and convergent thinking constitute critical components of the creative process [16, 18, 24, 32, 48, 62].”
Chapter Seven. Poincaré’s ‘Delicate Sieve’: On Creativity And Constraints In The Arts
Livingston, P. N. (2009) · BRILL eBooks · doi:10.1163/ej.9789004174443.i-348.46 · Cited by 9 · cited 1×
“We draw on key theories by Poincaré and Boden to frame our investigation [9, 21, 38].”
Carlsson, I., Davidson, P., & Ors, M. (2019) · Creativity Research Journal · doi:10.1080/10400419.2019.1606619 · Cited by 7 · cited 1×
“Research has shown that priming with related words and manually writing responses can enhance performance on RATs— strategies a coach might use for guidance [13, 43].”
Building Machines that Learn and Think with PeoplePreprint
Collins, K. M., Sucholutsky, I., Bhatt, U., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.03943 · Cited by 2
Ashkinaze, J., Mendelsohn, J., Qiwei, L., et al. (2024) · arXiv · doi:10.48550/arxiv.2401.13481
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · arXiv · doi:10.48550/arxiv.2402.01536
Koivisto, M., & Grassini, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-54745-y
Research works printed but not linked: 3
- Kat Agres, Stephen McGregor, Matthew Purver, and Geraint A Wiggins. 2015. Conceptualizing Creativity: From Distributional Semantics to Conceptual Spaces.. In ICCC. 118–125.
- Mark A Runco. 1991. Divergent thinking. Ablex Publishing Corporation Norwood, NJ.
- Xinyi Wang. 2016. The Effect of Language Ability in Creativity Assessment. Ph. D. Dissertation.
Cited by
Student-AI collaborative creative Problem-Solving: The role of human agency
Guoa, W., Liang, Z., Wang, C., Li, X., Hu, H., Chen, S., Yu, Q., & Zhao, Q. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105433 · Cited by 51
Zhou, Y., Liu, Q., Huang, J., & Li, G. (2026) · Technology in Society · doi:10.1016/j.techsoc.2025.103087 · Cited by 24
CreAItive Collaboration? Users' Misjudgment of AI-Creativity Affects Their Collaborative Performance
Bangerl, M. M., Disch, L., David, T., & Pammer-Schindler, V. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713886 · Cited by 13
“A growing body of literature explores human-AI co-creation in divergent thinking tasks [ 47, 50, 63, 68, 88, 94, 108, 116].”
Desdevises, J. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1628486 · Cited by 32
Zheng, E., Fu, H., Thelwall, M. A., & Fang, Z. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70028 · Cited by 13
“Persistent trust in model outputs could diminish researchers' agency and creativity in making independent critical evaluations (Kumar et al., 2025).”
Metadata
- Authors
- Kumar, H., Vincentius, J., Jordan, E., & Anderson, A.
- Affiliations
- University of Toronto (CA)
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-18
- OpenAlex
- W4409746216
- Cited by
- 129
- References
- 53
- Citations by year
- 2026: 93 · 2025: 36
- FWCI
- 306.19
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- University of Toronto
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- large language models, human creativity, divergent thinking, convergent thinking, AI-assisted creativity, pre-registered experiment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-12, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-12 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.