Humans as Creativity Gatekeepers: Are We Biased Against AI Creativity?
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
With artificial intelligence (AI) increasingly involved in the creation of organizational and commercial artifacts, human evaluators’ role as creativity gatekeepers of AI-produced artifacts will become critical for innovation processes. However, when humans evaluate creativity, their judgment is clouded by biases triggered by the characteristics of the creator. Drawing from folk psychology and algorithm aversion research, we examine whether the identity of the producer of a given artifact as artificial intelligence (AI) or human is a source of bias affecting people’s creativity evaluation of such artifact and what drives this effect. With four experimental studies ( N = 2039), of which two were pre-registered, using different experimental designs and evaluation targets, we found that people sometimes—but not always—ascribe lower creativity to a product when they are told that the producer is an AI rather than a human. In addition, we found that people consistently perceive generative AI to exert less effort than humans in the creation of a given artifact, which drives the lower creativity ratings ascribed to generative AI producers. We discuss the implication of these findings for organizational creativity and innovation in the context of human-AI interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By contrast, considerations of AI effort did not appear in participants’ responses, possibly because AI generation does not require a human sense of “effort” [51].”
From Which Contributions Deserve Credit? Perceptions of Attribution in Human-AI Co-Creation (2025) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior work shows that content labeled as machine-produced is often viewed more skeptically than identical human-attributed text.”
From Authorship Attribution and Trust in AI-Generated Scientific Texts: An Experimental Study (2026) · cites this paper as Magni et al., 2024
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Taken together with evidence on algorithm aversion and authorship norms (Magni et al., 2024;Draxler et al., 2024), our data suggest that framing AI involvement through human oversight is critical for preserving trust without affecting comprehension.”
From Authorship Attribution and Trust in AI-Generated Scientific Texts: An Experimental Study (2026) · cites this paper as Magni et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Similar algorithm-aversion appears for creative outputs (Magni et al., 2024).”
From Authorship Attribution and Trust in AI-Generated Scientific Texts: An Experimental Study (2026) · cites this paper as Magni et al., 2024
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Participants who come to the museum (or wherever the system is installed) can then pick from 99 selected questions to ask the life-size image projected in front of them which responds with the pre-recorded answers, as though they were engaging in a natural and live conversation with Mrs. Kajimoto.”
From AI and memory (2024) · cites this paper as [19]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reconsidering Baron and Kenny: myths and truths about mediation analysis
Zhao, X., Lynch, J. G., & Chen, Q. (2010) · Journal of Consumer Research · doi:10.1086/651257 · Cited by 12,583
The social psychology of creativity: A componential conceptualization.
Amabile, T. M. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.2.357 · Cited by 4,034
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 1×
“As described by the computers-are-social-actors framework (Nass & Moon, 2000; Reeves & Nass, 1996), people engage in ethopoeia —i.e., they apply folk theories to human–machine interactions, and they socially interact with artificial agents similarly as with other humans, as long as the artificial…”
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · cited 1×
“Furthermore, this bi-dimensional conceptualization of creativity is sometimes integrated with additional dimensions, such as authenticity and aesthetics (Kharkhurin, 2014; Runco, 2004; Runco & Jaeger, 2012).”
EMPLOYEE CREATIVITY: PERSONAL AND CONTEXTUAL FACTORS AT WORK.
Oldham, G. R., & Cummings, A. (1996) · Academy of Management Journal · doi:10.2307/256657 · Cited by 3,749 · cited 1×
“…is consistent with the dominant theoretical framework and empirical measures in the creativity literature and (2) it is consistent with how evaluation targets (e.g., consumer products, employee outputs) are commonly assessed (e.g., George & Zhou, 2001; Oldham & Cummings, 1996; Zhou et al., 2019).”
The role of artificial intelligence in achieving the Sustainable Development Goals
Vinuesa, R., Azizpour, H., Leite, I., Balaam, M., Dignum, V., Domisch, S., Felländer, A., Langhans, S. D., Tegmark, M., & Fuso Nerini, F. (2020) · Nature Communications · doi:10.1038/s41467-019-14108-y · Cited by 3,294
Anderson, N., Potočnik, K., & Zhou, J. (2014) · Journal of Management · doi:10.1177/0149206314527128 · Cited by 3,103 · cited 1×
“This is consequential for organizations because innovation is key for survival and thriving in the modern business world (Anderson et al., 2014), and it would be costly to miss out on potential innovations because of discounting of the building blocks of innovations due to the identity of the…”
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 4×
“Whether artificial agents assume a humanoid appearance is likely to impact people’s reactions to them and to their productions (Chamberlain et al., 2018; Glikson & Woolley, 2020; Waytz et al., 2014).”
InfluentialBoden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775
Mediation Analysis in Social Psychology: Current Practices and New Recommendations
Rucker, D. D., Preacher, K. J., Tormala, Z. L., & Petty, R. E. (2011) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2011.00355.x · Cited by 2,430 · cited 1×
“Hypothesis 2 was thus supported because mediation can exist even when the direct effect is non-significant (Rucker et al., 2011; Zhao et al., 2010).”
Research works printed but not linked: 6
- de Graaf, M. M. A., & Malle, B. F. (2017). How people explain action (and autonomous intelligent systems should too). AAAI Fall Symposium - Technical Report, FS-17–01-, 19–26.
- Karimi, P., Grace, K., Maher, M. L., & Davis, N. (2018). Evaluating creativity in computational co-creative systems. http://arxiv.org/abs/1807.09886 · arXiv
- Moffat, D. C., & Kelly, M. (2006). An investigation into people’s bias against computational creativity in music composition. Proceedings of the Third Joint Workshop on Computational Creativity.
- Moravčík, M., Schmid, M., Burch, N., Lisý, V., Morrill, D., Bard, N., Davis, T., Waugh, K., Johanson, M., & Bowling, M. (2017). DeepStack: Expert-level artificial intelligence in heads-up no-limit poker. Science, 513(6337), 1–32. https://doi.org/10.1126/science.aam6960.1 · doi:10.1126/science.aam6960.1
- Oliveira, H. G. (2012). PoeTryMe: A versatile platform for poetry generation. ECAI 2012 Workshop on Computational Creativity, Concept Invention, and General Intelligence.
- Paciotti, D., & Di Stefano, A. (2021). Generative design and industrial product. Connecting physical/digital dimensions of the project. AGATHÓN| International Journal of Architecture. Art and Design, 10, 158–167.
Cited by
Brüns, J. D., & Meißner, M. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2024.103790 · Cited by 278
Managing with Artificial Intelligence: An Integrative Framework
Hillebrand, L., Raisch, S., & Schad, J. (2025) · Academy of Management Annals · doi:10.5465/annals.2022.0072 · Cited by 255
The Paradox of Artificial Creativity: Challenges and Opportunities of Generative AI Artistry
Garcia, M. B. (2025) · Creativity Research Journal · doi:10.1080/10400419.2024.2354622 · Cited by 140
Wu, T., Liang, Y., & Wang, Y. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09963-6 · Cited by 180
Gong, Q., Fan, D., & Bartram, T. (2024) · The International Journal of Human Resource Management · doi:10.1080/09585192.2024.2440065 · Cited by 198
Metadata
- Authors
- Magni, F., Park, J., & Chao, M. M.
- Affiliations
- ETH Zurich (CH)
- Duksung Women's University (KR)
- Hong Kong University of Science and Technology (HK)
- Corresponding author
- Magni, Federico
- Park, Jiyoung
- Chao, Melody Manchi
- Venue
- Journal of Business and Psychology
- Published
- 2023-09-14
- Volume
- 39
- Issue
- 3
- Pages
- 643-656
- ISSN
- 0889-3268 (ISSN-L)
- 1573-353X
- OpenAlex
- W4386697415
- Cited by
- 201
- References
- 99
- Citations by year
- 2026: 81 · 2025: 85 · 2024: 25 · 2023: 10
- FWCI
- 48.56
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Journal of Business and Psychology (publishedVersion, cc-by)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
- ETH Zürich Research Collection
- Funders
- Ministry of Education (NRF-2017S1A6A3A01078538)
- Swiss Federal Institute of Technology Zurich
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Life Sciences › Neuroscience › Cognitive Neuroscience › Aesthetic Perception and Analysis
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- computational creativity, creativity assessment, algorithm aversion, generative AI, perceived effort, folk psychology, human-AI interaction, organizational creativity, innovation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Humans as Creativity Gatekeepers: Are We Biased Against AI Creativity? https://app.cochat.ai/papers/10.1007/s10869-023-09910-x
- The paper
- Magni, F., Park, J., & Chao, M. M. (2024). Humans as Creativity Gatekeepers: Are We Biased Against AI Creativity? Journal of Business and Psychology. https://doi.org/10.1007/s10869-023-09910-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.