The Role of Human Agency in Human-AI Co-Creativity
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index; 10 of the 15 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) are popular tools for creative ideation, but have been shown to homogenize outputs across users. We test if approaching an AI tool with high human (vs. low) human agency can mitigate this homogenization effect by encouraging people to use AI to augment their creativity, rather than offload it. Participants were experimentally assigned to one of three conditions (high-agency approach with AI access, low-agency approach with AI access, or a human-only control) and generated creative uses for everyday objects. Contrary to our expectations, ideas did not differ in individual-level quality (overall creativity, originality, and usefulness). However, a preregistered similarity-to-centroid analysis and an exploratory cluster analysis provided convergent evidence of AI-induced homogenization among the low-agency condition. Thus, while AI has enabled greater ideational fluency, our research suggests the degree of agency with which people approach their AI tool has downstream consequences on collective creativity.
Overview
CoChat Summary
TL;DR
This experiment tested whether approaching an AI creativity tool with high versus low human agency changes individual idea quality and group-level homogenization. Individual-level creativity ratings did not differ by condition, but low-agency AI users produced ideas that were significantly more similar to one another, while the high-agency approach buffered against this homogenization.
Key findings
- No significant differences in individual-level idea quality (overall creativity, originality, usefulness) across the AI-access conditions relative to control, *ps* > .60.
- Cosine similarity to the condition-object centroid differed by condition, *F*(2, 119.72) = 4.73, *p* < .05, = .07; high-agency participants' ideas were less similar to the centroid than low-agency participants', *t*(125) = -2.45, *p* < .05, while high-agency vs. control did not differ, *t*(122) = 1.87, *p* = .15.
- Exploratory HDBSCAN clustering (permutation tests, n = 5,000) showed the control condition had more unique clusters than low-agency (difference 3.33, *p* = .04) and a higher noise ratio (difference 0.22, *p* = .02), while low-agency had a higher coefficient of variation than control (difference 0.75, *p* = .005) — i.e., low-agency participants clustered onto a single dominant category.
- Across conditions, submitters produced a total of n = 2,250 ideas.
Methods
- Two samples: 150 submitters (community college students in the San Francisco Bay Area; *M* age = 25.1, *SD* = 9.2; 72% female; 3 excluded for failing an attention check) and 142 evaluators recruited from CloudResearch Connect (*M* age = 46.7, *SD* = 16.3; 49% female; 6 excluded for attention, 5 for logging issues).
- Submitters were randomly assigned to high-agency with AI access, low-agency with AI access, or a human-only control, and completed the Alternative Uses Task for three objects (bubble wrap, frisbee, brick), generating five uses each; the AI was a custom chatbot built on gpt-3.5 embedded in Qualtrics. Evaluators rated a random subset of 15 ideas each (5 per object) on overall creativity, originality, and usefulness.
- Analysis used mixed-effects models on evaluator ratings, cosine similarity of idea embeddings (all-MiniLM-L6-v2, 384 dimensions) to the condition-object centroid, and exploratory HDBSCAN clustering with permutation tests. Manipulation checks excluded trials without chat data (24% of low-agency trials, 38% of high-agency trials), removing 12 high-agency and 10 low-agency participants.
Limitations
- Stated: many treatment participants refused to use the AI tool (some found it boring, others objected on principle), which "somewhat compromised the random assignment," though the authors frame this as revealing real-world psychological reactance.
- Evident in the text: due to the randomization procedure, some ideas were evaluated multiple times while others were never evaluated and were excluded from the analysis; the submitter sample was limited to community college students in one region; and the paper is a short poster (pages 1510–1515), so the exploratory clustering analysis is not preregistered.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
7 Valid · 0 Not valid · 3 Not checked · 20 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“People who use AI tend to produce more similar outputs compared to their counterparts who do not—an effect that has been shown in a range of contexts involving open-ended output, such as product design [1, 18] and short-story writing [4].”
- Also stated in: § Abstract · plain
“Large language models (LLMs) are popular tools for creative ideation, but have been shown to homogenize outputs across users.”
What the sources say
- Supportedcites [1] [1] Barrett R Anderson, Jash Hemant Shah, and Max Kreminski. 2024. Homogenization Effects of Large Language Models on Human Creative Ideation. In Creativity and Cognition (Chicago IL USA, 2024-06-23). ACM, 413–425. Go to Citation Digital Library Google Scholar source
The Methods (p. 4) include product-improvement prompts and compare ChatGPT with a non-AI creativity support tool. The Results (p. 5) find that ChatGPT users’ ideas were more homogeneous at the group level. The short-story example has a separate citation in the citing sentence and is not attributed to this paper. (LLM, conf=0.91)
- Supportedcites [18] [18] Gideon Nave, Lennart Meincke, and Christian Terwiesch. 2024. ChatGPT Decreases Idea Diversity in Brainstorming. Go to Citation Crossref Google Scholar source
In the findings passages (page not identified in our copy), ChatGPT-aided idea sets are less diverse than non-AI sets across all five experiments, including a toy-design task. This supports the product-design portion attributed to this paper; the citing sentence assigns short-story writing to a different citation [4]. (LLM, conf=0.92)
- Supportedcites [4] [4] Anil R. Doshi and Oliver P. Hauser. 2024. Generative AI enhances individual creativity but reduces the collective diversity of novel content. Science Advances 10, 28 (2024), eadn5290. Crossref Google Scholar a [...] ] and short-story writing b [...] in the same condition for the same object source
The Results section (“Similarity of stories”; page not provided) reports that stories written with access to generative AI ideas were more similar to other stories in their condition than stories in the human-only condition. This source is cited for the short-story-writing example; the product-design example has separate citations. (LLM, conf=0.93)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Abstract · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our findings of homogeneity among people who approached the AI system with low human agency align with prior research documenting large-scale changes in the way humans have communicated post-ChatGPT, from the use of flowery language in scientific publications [11] to increased semantic similarity on online platforms [3].”
§ 4 Discussion > 4.2 Implications
What the sources say
- Supportedcites [11] [11] Dmitry Kobak, Rita González-Márquez, Emőke-Ágnes Horvát, and Jan Lause. 2025. Delving into LLM-assisted writing in biomedical publications through excess vocabulary. 11, 27 (2025), eadt3813. Go to Citation Crossref Google Scholar source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Supportedcites [3] [3] Isabel Corpus, Eric Gilbert, Allison Koenecke, and Mor Naaman. 2026. Introducing AI to an Online Petition Platform Changed Outputs but not Outcomes. arxiv:https://arXiv.org/abs/2511.13949 [cs.CY] Go to Citation Crossref Google Scholar source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Given that past work suggests that online survey respondents frequently use AI tools to generate answers [24], we explicitly instructed participants in the control condition to not use AI in this task.”
§ 2 Method > 2.2 Procedure
What the sources say
- Partly supportedcites [24] [24] Veniamin Veselovsky, Manoel Horta Ribeiro, and Robert West. 2023. Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks. arxiv:https://arXiv.org/abs/2306.07899 [cs] Go to Citation Crossref Google Scholar sourceExperimental — accuracy not yet measured
The Results report that an estimated 33–46% of MTurk crowd workers used LLMs to produce summaries of research abstracts. This supports frequent AI use for online text-production tasks, but the study did not measure whether online survey respondents use AI to generate survey answers; the Discussion explicitly limits its findings to text summarization. (LLM, conf=0.87)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For noise ratio, the observed difference was 0.22, again driven by a higher noise ratio in the control condition relative to the low-agency, conditionp =.02.”
- Also stated in: § 4 Discussion · hedged
“participants in the low-agency condition tended to glom onto a single, dominant cluster, manifesting as a lower noise ratio and higher coefficient of variation.”
§ 3 Results > 3.2 Group-Level Homogeneity
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § 4 Discussion · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Contrary to our expectations, ideas did not differ in individual-level quality (overall creativity, originality, and usefulness).”
- Also stated in: § 3.1 Individual-Level Quality · plain
“Contrary to our first hypothesis, there were no significant differences in overall idea creativity or originality across the AI-access conditions relative to control, ps >.60”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 3.1 Individual-Level Quality · plain
10 more claims
Create a free account to see all 30 claims and every source verdict.
- Probably not a substantial claim. 13
- It may state two separate claims as one. 3
- The quote only partly states this claim. 1
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(2, 119.72) = 4.73reported p < .05 · recomputed p = .011
“F(2, 119.72) = 4.73, p < .05”
- Consistentt(125) = -2.45reported p < .05 · recomputed p = .016
“t(125) = -2.45, p < .05”
- Consistentt(122) = 1.87reported p = .15 · recomputed p = .064
“t(122) = 1.87, p = .15”
The paper states a correction for multiple tests
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · cited 1×
“To assess homogeneity, we first used the sentence embedding model all-MiniLM-L6-v2 [20] to generate embeddings in a 384-dimension embedding space.”
hdbscan: Hierarchical density based clustering
McInnes, L., Healy, J., & Astels, S. (2017) · The Journal of Open Source Software · doi:10.21105/joss.00205 · Cited by 2,833 · cited 1×
“To address this concern, we conducted an exploratory clustering analysis (HDBSCAN [16]) to uncover categories of ideas, ideas that did not clearly fall into a single category of ideas, and evidence of participants glom-ming onto a single category—our key indicator of homogeneity at the group level.”
A national experiment reveals where a growth mindset improves achievement
Yeager, D. S., Hanselman, P., Walton, G. M., Murray, J. S., Crosnoe, R., Muller, C., Tipton, E., Schneider, B., Hulleman, C. S., Hinojosa, C. P., et al. (2019) · Nature · doi:10.1038/s41586-019-1466-y · Cited by 1,513
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
Accelerated Hierarchical Density Based Clustering
McInnes, L., & Healy, J. (2017) · 2017 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw.2017.12 · Cited by 434
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · arXiv · doi:10.48550/arxiv.1908.10084 · Cited by 343
Judgments of originality and appropriateness as predictors of creativity
Runco, M. A., & Charles, R. E. (1993) · Personality and Individual Differences · doi:10.1016/0191-8869(93)90337-3 · Cited by 309 · cited 1×
“They were provided with a rubric with our definitions of overall creativity and its two canonical subcomponents: originality and usefulnessb[22].”
Introducing Connect by CloudResearch: Advancing Online Participant Recruitment in the Digital AgePreprint
Hartman, R., Moss, A. J., Jaffe, S. N., Rosenzweig, C., Litman, L., & Robinson, J. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ksgyr · Cited by 243
Delving into LLM-assisted writing in biomedical publications through excess vocabulary
Kobak, D., González-Márquez, R., Horvát, E.-Á., & Lause, J. (2024) · arXiv · doi:10.48550/arxiv.2406.07016 · Cited by 214
Metadata
- Authors
- Wu, S. H., Yang, Y., Lee, A. Y., Liebscher, A., Rapuano, K., Niederhoffer, K., & Hancock, J. T.
- Affiliations
- Stanford University (US)
- Cornell University (US)
- University of Wisconsin–Madison (US)
- BetterUp, Austin, Texas, USA
- ORCID
- Venue
- Proceedings of the 2026 Conference on Creativity and Cognition
- Publisher
- ACM
- Published
- 2026-07-13
- Pages
- 1510-1515
- OpenAlex
- W7168129386
- Cited by
- 0
- References
- 26
- FWCI
- 0.00
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Creativity and Cognition (publishedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- human agency, human-AI co-creation, large language models, creative idea generation, ideational fluency, originality, team creativity, clustering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Role of Human Agency in Human-AI Co-Creativity. https://app.cochat.ai/papers/10.1145/3803784.3816857
- The paper
- Wu, S. H., Yang, Y., Lee, A. Y., Liebscher, A., Rapuano, K., Niederhoffer, K., & Hancock, J. T. (2026). The Role of Human Agency in Human-AI Co-Creativity. Proceedings of the 2026 Conference on Creativity and Cognition. https://doi.org/10.1145/3803784.3816857
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.