The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index; 17 of the 38 sources its claims cite were checked for support.
Decoupling of Usefulness and Novelty: Evaluating the Impact of Generative AI on Design Outputs and Novice Designers' Creative Thinking
Open accessAbstract
People are increasingly leveraging generative AI (GenAI) for design tasks, making it critical to understand GenAI’s impact on design outcomes and users’ creative capabilities. We conducted a within-subjects experiment where 36 participants designed advertisements both with and without GenAI. Evaluations from clients and online volunteers revealed that GenAI-supported designs were perceived as significantly more creative and unconventional. Additionally, online volunteers, but not clients, rated these designs as more visually appealing. However, neither group perceived differences in usefulness, and clients noted no improvement in brand alignment, highlighting a notable decoupling of novelty and usefulness (two established components of creativity) in GenAI-supported design outputs. Although short-term GenAI use did not broadly influence participants’ creative thinking or experience, subgroup analyses indicated increases in divergent thinking among participants new to GenAI relative to participants with GenAI experience. We discuss the implications of the decoupling effect and GenAI’s influence on humans’ creativity.
Overview
CoChat Summary
TL;DR
In a within-subjects lab experiment, 36 participants designed social media advertisements with and without generative AI support, and their outputs were rated by five client stakeholders and 155 blinded online volunteers. GenAI-supported designs were judged significantly more creative and unconventional, but not more useful, revealing a decoupling of novelty and usefulness in GenAI-supported design outputs.
Key findings
- Client evaluators rated GenAI-supported designs as significantly more creative (β = 0.805, SE = 0.183, Z = 4.405, p < .001) and more unconventional (β = 1.300, SE = 0.193, Z = 6.721, p < .001) than human-only designs, but found no significant differences in perceived usefulness (β = 0.019, SE = 0.163, Z = 0.119, p = .905), visual appeal (β = 0.264, p = .153), or brand alignment (β = −0.188, p = .359).
- Online volunteers likewise rated GenAI-supported designs as more creative (β = 0.900, SE = 0.149, Z = 6.040, p < .001), more unconventional (β = 0.658, SE = 0.106, Z = 6.218, p < .001), and more visually appealing (β = 0.447, SE = 0.138, Z = 3.245, p < .01), with no usefulness difference (β = 0.001, SE = 0.112, Z = 0.006, p = .995).
- No overall condition differences appeared in mood (relaxation, pleasure, energy), self-efficacy, divergent thinking (AUT), or convergent thinking (Anagram). In subgroup analysis, participants without prior GenAI design tool experience showed higher fluency (M = 14.333, SD = 4.384 vs. M = 12.500, SD = 4.573, Z = −2.112, p < .05) and flexibility (M = 12.250, SD = 3.562 vs. M = 10.167, SD = 3.131, Z = −2.203, p < .05) after the GenAI session; those with prior experience showed no significant differences.
- Of 105 eligible designs (52 human-only, 53 GenAI-supported), participants selected their own GenAI-supported design as "best" in 17 of 36 cases (47.2%). Client qualitative comments praised GenAI designs' bright colors and diversity but criticized them as "too busy," illegible, or socially inappropriate/uncanny.
Methods
- Study One: within-subjects lab experiment with 36 participants (94% under 30; 81% women; 67% with at least some prior GenAI design experience), each completing two counterbalanced 25-minute sessions — one using ChatGPT (DALL-E 3) and one using their own preferred tools — producing 110 designs (105 eligible). Measures: Alternative Uses Test (divergent thinking), Anagram Test (convergent thinking), and self-reported mood and self-efficacy; analyzed with Wilcoxon signed-rank tests.
- Study Two: five "client" evaluators (members of the target research group) rated all 105 designs (N = 525 ratings) on usefulness, creativity, unconventionality, brand alignment, and visual appeal, plus optional free-response comments; 155 online volunteers (LabintheWild, aged 9–64, M = 25.6) each rated 10 randomly presented designs (N = 1550 ratings), blinded to condition.
- Analysis: Generalized Linear Mixed Models with fixed effect of GenAI support and random intercepts for raters and for designs nested within participants; thematic analysis of client qualitative comments.
Limitations
- Stated by the authors: reliance on subjective rater evaluations rather than objective metrics such as click-through rates; use of only GPT-4/DALL-E 3 rather than design-specific tools, limiting generalizability; the artificial controlled lab setting; qualitative analysis drawn from optional free-response text from only five clients; and a sample of mostly novice/early-career designers from a college community and alumni networks, limiting generalizability to experienced industry designers.
- Evident in the text: the intervention was a single 25-minute session, so findings speak only to short-term effects; the client rater pool was very small (n = 5), and the study notes that knowing a design is AI-generated might itself influence evaluator ratings, which was not tested.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
10 Valid · 1 Not valid · 10 Not checked · 76 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We also saw recurring patterns such as very bright colors and complex compositions, hinting at a converging “AI style,” which echoes concerns that generative AI homogenizes outputs [99] and reduces diversity at a collective level [25].”
§ 7 Discussion > 7.1 GenAI’s Impact on Decoupling Novelty vs. Usefulness of Design Outputs
What the sources say
- Partly supportedcites [99] [99] Veera Vimpari, Annakaisa Kultima, Perttu Hämäläinen, and Christian Guckelsberger. 2023. “An Adapt-or-Die Type of Situation”: Perception, Adoption, and Use of Text-to-Image-Generation AI by Game Industry Professionals. Proc. ACM Hum.-Comput. Interact. 7, CHI PLAY, Article 379 (Oct. 2023), 34 pages. Digital Library Google Scholar a [...] that GenAI may homogenize creative outputs b [...] that generative AI homogenizes outputs sourceExperimental — accuracy not yet measured
The cited paper reports participants’ concerns about a lack of true novelty in text-to-image outputs (Comparison to Related Work, p. 23), which partly supports the cited concern about homogenization. It does not establish that outputs converge on a shared visual style. The bright colors and complex compositions are the citing authors’ own observations, not findings attributed to this source. (LLM, conf=0.72)
- Supportedcites [25] [25] Anil R Doshi and Oliver P Hauser. 2024. Generative AI enhances individual creativity but reduces the collective diversity of novel content. Science Advances 10, 28 (2024), eadn5290. Google Scholar a [...] rather than self-assessed by creators b [...] begun to probe GenAI’s role in creativity c [...] conceptual diversity at a collective level d [...] ], fictional stories e [...] and reduces diversity at a collective level f [...] inadvertently homogenize design outcomes source
The Results section (‘Similarity of stories’; page unavailable) reports that stories written with access to generative AI ideas were more similar to other stories in the same condition. The Discussion says this could reduce collective novelty. The bright colors and complex compositions are the citing authors’ own observations, not findings attributed to this source. (LLM, conf=0.92)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Using GenAI in design also places metacognitive demands [94] on users, requiring sustained monitoring and control.”
§ 7 Discussion > 7.1 GenAI’s Impact on Decoupling Novelty vs. Usefulness of Design Outputs
What the sources say
- Supportedcites [94] [94] Lev Tankelevitch, Viktor Kewenig, Auste Simkute, Ava Elizabeth Scott, Advait Sarkar, Abigail Sellen, and Sean Rintel. 2024. The metacognitive demands and opportunities of generative AI. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 1–24. Go to Citation Digital Library Google Scholar source
Section 3 says that working with GenAI imposes extensive metacognitive monitoring and control demands, and names design among the domains affected. The paper describes these demands across prompting, evaluating outputs, and deciding how to incorporate GenAI into workflows. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that there were no significant differences between conditions in mood (relaxation, pleasure, energy), self-efficacy, inherent divergent thinking (AUT), or convergent thinking (Anagram).”
§ 4 Study One Results: Participants’ Experience > 4.1 Overall Effects on Participants’ Mood, Self-Efficacy, and Creativity
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, clients also pointed out that some GenAI-supported designs misaligned with social norms and could unintentionally convey inappropriate messages.”
§ 6 Study Two Results: Design Product Evaluation > 6.3 Qualitative Analysis of Client Evaluation Comments
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, there were no significant condition differences in convergent thinking, mood, or self-efficacy regardless of prior GenAI experience.”
§ 4 Study One Results: Participants’ Experience > 4.2 Subgroup Analysis: Prior Experience with GenAI
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
51 more claims
Create a free account to see all 97 claims and to verify the 6 references still open.
- Probably not a substantial claim. 25
- It may state two separate claims as one. 25
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = -2.112reported p < .05 · recomputed p = .035
“Z = −2.112, p < .05”
- Consistentz = -2.203reported p < .05 · recomputed p = .028
“Z = −2.203, p < .05”
- Consistentz = 4.405reported p < .001 · recomputed p < .001
“Z = 4.405, p < .001”
- Consistentz = 6.721reported p < .001 · recomputed p < .001
“Z = 6.721, p < .001”
- Consistentz = 0.119reported p = .905 · recomputed p = .905
“Z = 0.119, p = .905”
6 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
Braun, V., & Clarke, V. (2012) · APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. · doi:10.1037/13620-004 · Cited by 10,299
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · cited 1×
“Creativity fundamentally requires both novelty and usefulness [61, 63, 73, 88].”
Creativity in the design process: co-evolution of problem–solution
Dorst, K., & Cross, N. (2001) · Design Studies · doi:10.1016/s0142-694x(01)00009-6 · Cited by 2,357
Plucker, J. A., Beghetto, R. A., & Dow, G. T. (2004) · Educational Psychologist · doi:10.1207/s15326985ep3902_1 · Cited by 1,794 · cited 1×
“…creativity’s significant role in improving problem-solving, fostering innovation, boosting productivity, and contributing to personal socio-emotional well-being, satisfaction, and life success [6, 76, 93, 96, 97], noting its significance for both individual development and societal advancement.”
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
The Cambridge Handbook of Creativity
(2010) · doi:10.1017/cbo9780511763205 · Cited by 1,291
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · Societies · doi:10.3390/soc15010006 · Cited by 1,248
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · doi:10.2139/ssrn.5082524 · Cited by 1,238
Creativity: Yesterday, today and tomorrow
GUILFORD, J. P. (1967) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1967.tb00002.x · Cited by 1,008 · cited 2×
“Divergent thinking relates to the ability to generate multiple creative ideas, typically assessed via tests like the Alternative Uses Test (AUT) [35] and Torrance Tests of Creative Thinking [17, 95], which measures how creatively participants can think of non-common uses for common objects like a…”
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765 · cited 1×
“With the advancement of computer technology, modern software tools have been created to support creative processes, which have been classified broadly as creativity support tools (CSTs) [30, 41, 90, 91].”
Normative data for 144 compound remote associate problems
Bowden, E. M., & Jung-Beeman, M. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195543 · Cited by 649 · cited 1×
“Clients also evaluated brand alignment with their organization. solution [11–13 , 60].”
The disposition toward originality
Barron, F. (1955) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0048073 · Cited by 623 · cited 1×
“Creativity drives the production of novel and useful outputs [10] that meet client needs and enable businesses to stand out in competitive markets.”
Give your ideas some legs: The positive effect of walking on creative thinking.
Oppezzo, M., & Schwartz, D. L. (2014) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0036577 · Cited by 553
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Generative artificial intelligence, human creativity, and art
Zhou, E., & Lee, D. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae052 · Cited by 459
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · cited 1×
“With the advancement of computer technology, modern software tools have been created to support creative processes, which have been classified broadly as creativity support tools (CSTs) [30, 41, 90, 91].”
Colzato, L. S., Ozturk, A., & Hommel, B. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00116 · Cited by 389
Parallel prototyping leads to better design results, more divergence, and increased self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. R. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879836 · Cited by 367 · cited 4×
“In visual design and marketing contexts, prior research also assesses design products’ alignment with client branding [26, 27, 37] and overall visual appeal [37, 82].”
InfluentialThe Effects of Generative AI on Design Fixation and Divergent Thinking
Wadinambiarachchi, S., Kelly, R. M., Pareek, S., Zhou, Q., & Velloso, E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642919 · Cited by 320
Sleep Loss and “Divergent” Thinking Ability
Horne, J. A. (1988) · Sleep · doi:10.1093/sleep/11.6.528 · Cited by 311
Reinecke, K., Yeh, T., Miratrix, L., Mardiko, R., Zhao, Y., Liu, J., & Gajos, K. Z. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481281 · Cited by 305
Self-citationEEG alpha synchronization is related to top-down processing in convergent and divergent thinking
Benedek, M., Bergner, S., Könen, T., Fink, A., & Neubauer, A. C. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.09.004 · Cited by 297 · cited 1×
“Clients also evaluated brand alignment with their organization. solution [11–13 , 60].”
Shneiderman, B. (2002) · Communications of the ACM · doi:10.1145/570907.570945 · Cited by 280 · cited 2×
“These CSTs are designed to enhance both the creative person and the creative activity [41], aiming to “make people more creative more often” [90] and facilitating creative activities by improving the processes, usability, and workflows involved in creative work [83].”
The Cambridge handbook of creativity
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5383 · Cited by 248
Metacontrol of human creativity: The neurocognitive mechanisms of convergent and divergent thinking
Zhang, W., Sjoerds, Z., & Hommel, B. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116572 · Cited by 242 · cited 1×
“Creativity from the Person perspective involves key components such as divergent and convergent thinking [108].”
Torrance, E. P. (1981) · Gifted Child Quarterly · doi:10.1177/001698628102500203 · Cited by 239 · cited 1×
“…creativity’s significant role in improving problem-solving, fostering innovation, boosting productivity, and contributing to personal socio-emotional well-being, satisfaction, and life success [6, 76, 93, 96, 97], noting its significance for both individual development and societal advancement.”
A Dynamic Definition of Creativity
Walia, C. (2019) · Creativity Research Journal · doi:10.1080/10400419.2019.1641787 · Cited by 238 · cited 1×
“Creativity, commonly defined as the ability to generate novel and useful ideas [102], is increasingly recognized as a pivotal skill in modern society.”
Problem discovery, divergent thinking, and the creative process
Runco, M. A., & Okuda, S. M. (1988) · Journal of Youth and Adolescence · doi:10.1007/bf01538162 · Cited by 237 · cited 1×
“Divergent thinking is defined as the measure of the varied potential of creative thought and focuses on the processes of creative ideation [86, 89].”
The power of generative marketing: Can generative AI create superhuman visual marketing content?
Hartmann, J., Exner, Y., & Domdey, S. (2025) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2024.09.002 · Cited by 229
The Impact of AI on the Advertising Process: The Chinese Experience
Qin, X., & Jiang, Z. (2019) · Journal of Advertising · doi:10.1080/00913367.2019.1652122 · Cited by 225 · cited 1×
“In marketing and advertisement design, studies have found that GenAI-created imagery has potential for better quality designs [37] and also the potential to transform the industry into a data-driven, tool-based, synchronized, and more efficient system [77].”
Quantifying visual preferences around the world
Reinecke, K., & Gajos, K. Z. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557052 · Cited by 190
Self-citationLarge-scale Text-to-Image Generation Models for Visual Artists’ Creative Works
Ko, H.-K., Park, G., Jeon, H., Jo, J., Kim, J., & Seo, J. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584078 · Cited by 189
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188
May AI? Design Ideation with Cooperative Contextual Bandits
Koch, J., Lucero, A., Hegemann, L., & Oulasvirta, A. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300863 · Cited by 174
The Nature of Human Creativity
Sternberg, R. J., & Kaufman, J. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108185936 · Cited by 166 · cited 1×
“Through creative endeavors like writing, art, music, and problem-solving, individuals can explore and articulate who they are [87] alongside providing a sense of authenticity and fulfillment [47, 92].”
Divergent Thinking, Creativity, and Giftedness
Runco, M. A. (1993) · Gifted Child Quarterly · doi:10.1177/001698629303700103 · Cited by 163 · cited 1×
“Divergent thinking is defined as the measure of the varied potential of creative thought and focuses on the processes of creative ideation [86, 89].”
The effect of reportable and unreportable hints on anagram solution and the aha! experience.
Bowden, E. M. (1997) · Consciousness and Cognition · doi:10.1006/ccog.1997.0325 · Cited by 149 · cited 3×
“After the first session, researchers measured participants’ mood, self-efficacy, divergent thinking with the Alternative Uses Test [4], and convergent thinking with the Anagram Test [12].”
InfluentialDeveloping Creativity: Artificial Barriers in Artificial Intelligence
Jennings, K. E. (2010) · Minds and Machines · doi:10.1007/s11023-010-9206-y · Cited by 148 · cited 1×
“…creative outputs [99], and reduce conceptual diversity at a collective level [25], Additionally, others caution that an overreliance on AI might constrain human creativity by promoting conformity or limiting exploration [43, 46], and by encouraging cognitive offloading and dependence [32].”
FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion Design
Jeon, Y., Jin, S., Shih, P. C., & Han, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445093 · Cited by 145
Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis
Holzner, N., Maier, S., & Feuerriegel, S. (2025) · arXiv · doi:10.48550/arxiv.2505.17241 · Cited by 143
Harrison, L., Reinecke, K., & Chang, R. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702545 · Cited by 142
Self-citationCan artificial intelligence support creativity in early design processes?
Chandrasekera, T., Hosseini, Z., & Perera, U. (2025) · International Journal of Architectural Computing · doi:10.1177/14780771241254637 · Cited by 140
Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results
Dow, S., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D., & Klemmer, S. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979359 · Cited by 138
LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples
Reinecke, K., & Gajos, K. Z. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675246 · Cited by 135
Self-citationArt or Artifice? Large Language Models and the False Promise of Creativity
Chakrabarty, T., Laban, P., Agarwal, D., Muresan, S., & Wu, C.-S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642731 · Cited by 135
Gu, C., Jia, S., Lai, J., Chen, R., & Chang, X. (2024) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer19030108 · Cited by 132
Gmeiner, F., Yang, H., Yao, L., Holstein, K., & Martelaro, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580999 · Cited by 130
Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
Kumar, H., Vincentius, J., Jordan, E., & Anderson, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714198 · Cited by 129
Stylette: Styling the Web with Natural Language
Kim, T. S., Choi, D., Choi, Y., & Kim, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501931 · Cited by 123
The Generative AI Paradox: "What It Can Create, It May Not Understand"Preprint
West, P., Lu, X., Dziri, N., Brahman, F., Li, L., Hwang, J. D., Jiang, L., Fisher, J., Ravichander, A., Chandu, K. R., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.00059 · Cited by 122
Mixed-Initiative Creative Interfaces
Deterding, S., Hook, J., Fiebrink, R., Gillies, M., Gow, J., Akten, M., Smith, G., Liapis, A., & Compton, K. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3027072 · Cited by 117 · cited 2×
“One promising approach to human-AI collaboration that researchers have noted is the concept of mixed-initiative co-creativity [23, 106].”
Evolving Roles and Workflows of Creative Practitioners in the Age of Generative AI
Palani, S., & Ramos, G. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656190 · Cited by 110
Bridging the Gap Between UX Practitioners’ Work Practices and AI-Enabled Design Support Tools
Lu, Y., Zhang, C., Zhang, I., & Li, T. J.-J. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519809 · Cited by 107
Hwang, Y., & Wu, Y. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1455015 · Cited by 104
Evaluating Creativity Support Tools in HCI Research
Remy, C., MacDonald Vermeulen, L., Frich, J., Biskjaer, M. M., & Dalsgaard, P. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395474 · Cited by 96 · cited 1×
“These CSTs are designed to enhance both the creative person and the creative activity [41], aiming to “make people more creative more often” [90] and facilitating creative activities by improving the processes, usability, and workflows involved in creative work [83].”
Vimpari, V., Kultima, A., Hämäläinen, P., & Guckelsberger, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3611025 · Cited by 77 · cited 2×
“…novel and unconventional ideas [39], others found that GenAI outputs can be overly generic [57] and fear that GenAI may homogenize creative outputs [99], and reduce conceptual diversity at a collective level [25], Additionally, others caution that an overreliance on AI might constrain human…”
Measuring and Improving User Experience Through Artificial Intelligence-Aided Design
Yang, B., Wei, L., & Pu, Z. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.595374 · Cited by 77 · cited 1×
“These GenAI tools claim to accelerate the creative process by automating repetitive tasks [7], suggesting innovative design concepts [105], and providing real-time feedback [109].”
Career Patterns and Peak Creative Achievements of Creative High School Students Twelve Years Later
Torrance, E. P. (1972) · Gifted Child Quarterly · doi:10.1177/001698627201600201 · Cited by 74 · cited 1×
“…creativity’s significant role in improving problem-solving, fostering innovation, boosting productivity, and contributing to personal socio-emotional well-being, satisfaction, and life success [6, 76, 93, 96, 97], noting its significance for both individual development and societal advancement.”
A Word is Worth a Thousand Pictures: Prompts as AI Design MaterialPreprint
Kulkarni, C. E., Druga, S., Chang, M., Fiannaca, A., Cai, C. J., & Terry, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.12647 · Cited by 74
To understand is to create: An epistemological perspective on human nature and personal creativity.
Runco, M. A. (2007) · American Psychological Association eBooks · doi:10.1037/11595-004 · Cited by 72 · cited 1×
“Through creative endeavors like writing, art, music, and problem-solving, individuals can explore and articulate who they are [87] alongside providing a sense of authenticity and fulfillment [47, 92].”
Creativity and fixation in the real world: A literature review of case study research
Crilly, N. (2019) · Design Studies · doi:10.1016/j.destud.2019.07.002 · Cited by 67 · cited 1×
“Literature shows that GenAI can homogenize the ideas generated by different users [8] and limit human agency and lead to creative fixation [5, 21, 101].”
Evaluating creativity in humans, computers, and collectively intelligent systems
Maher, M. L. (2010) · doi:10.5555/1854969.1854977 · Cited by 61
Wu, Y., & Koutstaal, W. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234473 · Cited by 61
Lloyd-Cox, J., Pickering, A., & Bhattacharya, J. (2022) · Creativity Research Journal · doi:10.1080/10400419.2022.2125721 · Cited by 59
How does AI promote design iteration? The optimal time to integrate AI into the design process
Zhou, C., Zhang, X., & Yu, C. (2023) · Journal of Engineering Design · doi:10.1080/09544828.2023.2290915 · Cited by 56
Thinking on your back: Solving anagrams faster when supine than when standing
Lipnicki, D. M., & Byrne, D. G. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.03.003 · Cited by 54 · cited 1×
“Clients also evaluated brand alignment with their organization. solution [11–13 , 60].”
Sketch2Prototype: rapid conceptual design exploration and prototyping with generative AI
Edwards, K. M., Man, B., & Ahmed, F. (2024) · Proceedings of the Design Society · doi:10.1017/pds.2024.201 · Cited by 53
Enabling Designers to Foresee Which Colors Users Cannot See
Reinecke, K., Flatla, D. R., & Brooks, C. A. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858077 · Cited by 52
Self-citationChoudhury, M. M., Eisenbart, B., & Kuys, B. (2025) · Proceedings of the Design Society · doi:10.1017/pds.2025.10077 · Cited by 51 · cited 1×
“Regarding design output, we discover that GenAI-supported designs are consistently perceived by both clients and online volunteers as significantly more creative and unconventional compared to human-only designs, which aligns with recent studies on GenAI’s influence on design outcome [18, 19, 110].”
Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design SystemPreprint
Karimi, P., Maher, M. L., Davis, N. M., & Grace, K. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.10188 · Cited by 50
Generative AI in Game Design: Enhancing Creativity or Constraining Innovation?
Alharthi, S. A. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13060060 · Cited by 49
Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. (2011) · Springer eBooks · doi:10.1007/978-3-642-21643-5_8 · Cited by 48
Creativity in the Here and Now: A Generic, Micro-Developmental Measure of Creativity
Küpers, E., van Dijk, M., & Lehmann-Wermser, A. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02095 · Cited by 46 · cited 1×
“The approach provides a flexible, domain-general framework for quantifying creativity “in the here and now” [56].”
A review of design fixation: research directions and key factors
Alipour, L., Faizi, M., Moradi, A. M., & Akrami, G. (2018) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2017.1320232 · Cited by 44 · cited 1×
“Literature shows that GenAI can homogenize the ideas generated by different users [8] and limit human agency and lead to creative fixation [5, 21, 101].”
Hsueh, S., Ciolfi Felice, M., Alaoui, S. F., & Mackay, W. E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642854 · Cited by 33
”Clay to Play With”: Generative AI Tools in UX and Industrial Design Practice
Uusitalo, S., Salovaara, A., Jokela, T., & Salmimaa, M. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661624 · Cited by 33
Ashkinaze, J., Mendelsohn, J., Qiwei, L., Budak, C., & Gilbert, E. (2025) · Proceedings of the ACM Collective Intelligence Conference · doi:10.1145/3715928.3737481 · Cited by 33
Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Production
Fu, Y., Newman, M., Going, L., Feng, Q., & Lee, J. H. (2025) · Proceedings of the 2025 ACM Designing Interactive Systems Conference · doi:10.1145/3715336.3735829 · Cited by 30
Self-citationExploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Production
Fu, Y., Newman, M., Going, L., Feng, Q., & Lee, J. H. (2025) · arXiv · Cited by 30
Self-citationPrototyping Dynamics: Sharing Multiple Designs Improves Exploration, Group Rapport, and Results
Dow, S. P., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D. L., & Klemmer, S. (2012) · Springer eBooks · doi:10.1007/978-3-642-31991-4_4 · Cited by 30
The Effect of Brief Stair-Climbing on Divergent and Convergent Thinking
Matsumoto, K., Chen, C., Hagiwara, K., Shimizu, N., Hirotsu, M., Oda, Y., Lei, H., Takao, A., Fujii, Y., Higuchi, F., et al. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.834097 · Cited by 26
Shneiderman, B. (2002) · Creativity and Cognition · doi:10.1145/581710.581711 · Cited by 23
Does Writing with Language Models Reduce Content Diversity?
Padmakumar, V., & He, H. (2023) · arXiv · doi:10.48550/arxiv.2309.05196 · Cited by 21
Getting to the Novel Ideas: Exploring the Alternative Uses Test of Divergent Thinking
Kudrowitz, B. M., & Dippo, C. (2013) · doi:10.1115/detc2013-13262 · Cited by 20 · cited 1×
“…to the ability to generate multiple creative ideas, typically assessed via tests like the Alternative Uses Test (AUT) [35] and Torrance Tests of Creative Thinking [17, 95], which measures how creatively participants can think of non-common uses for common objects like a “paper clip” [35, 53].”
The value of creativity: A scoping review
Oppert, M. L., O'Keeffe, V., Bensnes, M. S., Grecu, A. L., & Cropley, D. H. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100059 · Cited by 19
Generative AI, Human Creativity, and Art
Zhou, E., & Lee, D. (2023) · doi:10.2139/ssrn.4594824 · Cited by 19
Performance evaluation and creativity: Balancing originality and usefulness
Ostermaier, A., & Uhl, M. (2020) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2020.101552 · Cited by 16 · cited 1×
“Creativity fundamentally requires both novelty and usefulness [61, 63, 73, 88].”
Work in Progress: Assessing Creativity of Alternative Uses Task Responses: A Detailed Procedure
Alhashim, A., Marshall, M., Hartog, T., Jonczyk, R., Dickson, D., van Hell, J., Okudan-Kremer, G., & Siddique, Z. (2020) · 2020 ASEE Virtual Annual Conference Content Access Proceedings · doi:10.18260/1-2--35612 · Cited by 14
Kawashima, C., Chen, C., Hagiwara, K., Mizumoto, T., Watarai, M., Koga, T., Higuchi, F., Fujii, Y., Okabe, E., & Nakagawa, S. (2024) · Scientific Reports · doi:10.1038/s41598-023-50282-2 · Cited by 14
Klas, C.-P. (2018) · User Studies for Digital Library Development · doi:10.29085/9781856049269.009 · Cited by 8 · cited 1×
“Although subjective ratings are common proxies for real-world design effectiveness [26, 50], they may not fully capture objective performance metrics, such as actual click-through rates on social media platforms.”
Ye, T., Reinecke, K., & Robert, L. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3022198.3026339 · Cited by 8
Self-citationThe 7Vs of AI Slop: A Typology of Generative Waste
Madsen, D. Ø., & Puyt, R. W. (2026) · International Journal of Generative Artificial Intelligence in Business · doi:10.1504/ijgaib.2026.10081546 · Cited by 8
Generative artificial intelligence enhances creativity but reduces the diversity of novel contentPreprint
Doshi, A. R., & Hauser, O. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.00506 · Cited by 7
The 7Vs of AI Slop: A Typology of Generative Waste
Madsen, D. Ø., & Puyt, R. W. (2025) · doi:10.2139/ssrn.5558018 · Cited by 6
The Role of Generative AI in Human Creative Processes: Experimental Evidence
Zhu, F., & Zou, W. (2024) · doi:10.2139/ssrn.4676053 · Cited by 4
Research works printed but not linked: 6
- Teresa M Amabile. 1996. Creativity and innovation in organizations. Vol. 5. Harvard Business School Boston.
- Oxford Analytica. 2023. GenAI will transform workplace tasks across industries. Emerald Expert Briefingsoxan-db (2023).
- Nicholas M Davis, Yanna Popova, Ivan Sysoev, Chih-Pin Hsiao, Dingtian Zhang, and Brian Magerko. 2014. Building Artistic Computer Colleagues with an Enactive Model of Creativity.. In ICCC. 38–45.
- Daniel Kahneman. 2011. Thinking, fast and slow. macmillan.
- Jie Li, Hancheng Cao, Laura Lin, Youyang Hou, Ruihao Zhu, and Abdallah El Ali. 2024. User experience design professionals’ perceptions of generative artificial intelligence. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–18.
- Robert J Sternberg, Jacques Lautrey, and Todd I Lubart. 2003. Where are we in the Field of Intelligence, How did we get here, and Where are we Going?American Psychological Association.
Cited by
(2000) · Time to knit · doi:10.1145/3772318.3808960
Human–AI Collaboration and Creative Behavior among Chinese College Students
Zhou, X. (2026) · International Conference on Educational and Information Technology · doi:10.1109/iceit68991.2026.11521236 · Cited by 2
Metadata
- Authors
- Fu, Y., Zhou, T., Han, B., Wang, M., Chen, Y., Gomes Da Costa Lai, Z., Pang, R. Y., Reinecke, K., Wobbrock, J. O., & Hiniker, A.
- Affiliations
- University of Washington (US)
- Human Centered Design and Engineering, University of Washington, Seattle, Washington, USA
- ORCID
- Venue
- Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2026-04-13
- Pages
- 1-17
- OpenAlex
- W7154165194
- Semantic Scholar
- f42eff11592488d36ba2685ccb764c54d76edebc
- Cited by
- 2
- References
- 80
- Citations by year
- 2026: 2
- FWCI
- 54.12
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Keywords
- generative AI, novice designers, creative thinking, AI-assisted design, design education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.