“Who” Is the Best Creative Thinking Partner? An Experimental Investigation of Human–Human, Human–Internet, and Human– AI Co‐Creation
Abstract
Recent research suggests that working with generative artificial intelligence (AI), such as ChatGPT, can produce more creative outcomes than humans alone. However, does AI retain its creative edge when humans have access to alternative information sources, such as another human or the internet. We explored this question in a between‐group experiment with 202 German participants across four conditions (human–human dyads, human–Internet, and two human–AI groups with basic or specific instructions) and four creativity tasks (two alternate uses tasks, a consequences task, and a problem‐solving task). Results showed that the human–human condition obtained higher creativity scores in the divergent thinking tasks than the remaining groups. No significant between‐group differences were observed in the problem‐solving task. Moreover, interacting in human dyads made people more creatively confident, an effect not observed in the other groups. In addition, we compared human‐rated outcomes with AI‐based automated scoring (Ocsai). Interestingly, notable discrepancies emerged between the AI assessment and the human‐judged results, raising concerns about AI's susceptibility to “elaboration bias.” These findings highlight the benefits of human collaboration for creativity and call for further studies about the reliability and potential biases of AI in evaluating creative performance.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Human collaboration still holds unique value in terms of emotional support, creative motivation, and shared sense of accomplishment.
“Although AI has demonstrated significant advantages in many areas, human collaboration still holds unique value in terms of emotional support, creative motivation, and shared sense of accomplishment (Tang et al., 2024; McGuire et al., 2024).”
From From humans to AI: understanding why AI is perceived as the preferred co-creation partner (2025) · cites this paper as Tang et al., 2024
Participants collaborating with AI did not experience significant increases in creative confidence or creative motivation, in stark contrast to those collaborating with humans.
“Additionally, Tang et al. (2024) found that participants collaborating with AI did not experience significant increases in creative confidence or creative motivation, in stark contrast to those collaborating with humans.”
From From humans to AI: understanding why AI is perceived as the preferred co-creation partner (2025) · cites this paper as Tang et al., 2024
Tang et al. (2024) examined the impact of human-AI co-creation on creative quality, and Huang et al. (2024) explored trust and acceptance in human-AI collaboration.
“For instance, Tang et al. (2024) examined the impact of human–AI co-creation on creative quality, and Huang et al. (2024) explored trust and acceptance in human–AI collaboration.”
From From humans to AI: understanding why AI is perceived as the preferred co-creation partner (2025) · cites this paper as Tang et al., 2024
Cites
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · see citing works
Flow: The Psychology of Optimal Experience
Mirvis, P. H., & Csikszentmihalyi, M. (1991) · Academy of Management Review · doi:10.2307/258925 · Cited by 3,706 · see citing works
Handbook of Motivation at School
Wentzel, K. R., & Wigfield, A. (2009) · Routledge eBooks · doi:10.4324/9780203879498 · Cited by 2,482 · see citing works
Paas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150 · see citing works
Douglas, B. D., Ewell, P. J., & Brauer, M. (2023) · PLOS ONE · doi:10.1371/journal.pone.0279720 · Cited by 1,532 · see citing works
Finke, R. A., Ward, T. B., & Smith, S. M. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/7722.001.0001 · Cited by 1,438 · see citing works
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 1,409 · see citing works
Creative self-efficacy development and creative performance over time.
Tierney, P., & Farmer, S. M. (2010) · Journal of Applied Psychology · doi:10.1037/a0020952 · Cited by 1,090 · see citing works
Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912 · see citing works
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 887 · see citing works
Creativity: Beyond the Myth of Genius
Weisberg, R. W. (1993) · Medical Entomology and Zoology · Cited by 833 · see citing works
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794 · see citing works
When and How Artificial Intelligence Augments Employee Creativity
Jia, N., Luo, X., Zheng, F., & Liao, C. (2023) · Academy of Management Journal · doi:10.5465/amj.2022.0426 · Cited by 794 · see citing works
Metacognition and affect: What can metacognitive experiences tell us about the learning process?
Efklides, A. (2006) · Educational Research Review · doi:10.1016/j.edurev.2005.11.001 · Cited by 724 · see citing works
What Is Interesting? Exploring the Appraisal Structure of Interest.
Silvia, P. J. (2005) · Emotion · doi:10.1037/1528-3542.5.1.89 · Cited by 718 · see citing works
Groups, Teams, and Creativity: The Creative Potential of Idea‐generating Groups
Paulus, P. (2000) · Applied Psychology · doi:10.1111/1464-0597.00013 · Cited by 679 · see citing works
Kurzversion des Big Five Inventory (BFI-K):
Rammstedt, B., & John, O. (2005) · Diagnostica · doi:10.1026/0012-1924.51.4.195 · Cited by 648 · see citing works
Plucker, J. A., & Makel, M. C. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511763205.005 · Cited by 483 · see citing works
Generative artificial intelligence, human creativity, and art
Zhou, E., & Lee, D. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae052 · Cited by 459 · see citing works
ChatGPT improves creative problem-solving performance in university students: An experimental study
Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105031 · Cited by 396 · see citing works
Scoring divergent thinking tests: A review and systematic framework.
Reiter‐Palmon, R., Forthmann, B., & Barbot, B. (2019) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000227 · Cited by 394 · see citing works
How does generative artificial intelligence impact student creativity?
Habib, S., Vogel, T., Anli, X., & Thorne, E. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100072 · Cited by 364 · see citing works
The Crowdless Future? Generative AI and Creative Problem Solving
Boussioux, L., N. Lane, J., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2023) · doi:10.2139/ssrn.4533642 · Cited by 343 · see citing works
Rezwana, J., & Maher, M. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3519026 · Cited by 342 · see citing works
A large-scale comparison of human-written versus ChatGPT-generated essays
Herbold, S., Hautli-Janisz, A., Heuer, U., Kikteva, Z., & Trautsch, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-45644-9 · Cited by 338 · see citing works
Benedek, M., & Fink, A. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.11.002 · Cited by 306 · see citing works
Toward Untangling Creative Self-Beliefs
Beghetto, R. A., & Karwowski, M. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809790-8.00001-7 · Cited by 283 · see citing works
Self-citationRunco, M. A. (2003) · Hampton Press eBooks · Cited by 273 · see citing works
Artificial Intelligence & Creativity: A Manifesto for Collaboration
Vinchon, F., Lubart, T., Bartolotta, S., Gironnay, V., Botella, M., Bourgeois-Bougrine, S., Burkhardt, J., Bonnardel, N., Corazza, G. E., Glăveanu, V., et al. (2023) · The Journal of Creative Behavior · doi:10.1002/jocb.597 · Cited by 273 · see citing works
Self-citationHubert, K. F., Awa, K. N., & Zabelina, D. L. (2024) · Scientific Reports · doi:10.1038/s41598-024-53303-w · Cited by 261 · see citing works
Creative behavior as agentic action.
Karwowski, M., & Beghetto, R. A. (2018) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000190 · Cited by 257 · see citing works
Self-citationNusbaum, E. C., Silvia, P. J., & Beaty, R. E. (2014) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0036549 · Cited by 255 · see citing works
Relationships of personality to differential conceptions of creativity: A systematic review.
Puryear, J. S., Kettler, T., & Rinn, A. N. (2016) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000079 · Cited by 254 · see citing works
Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity
Haase, J., & Hanel, P. H. P. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100066 · Cited by 233 · see citing works
Benedek, M., Mühlmann, C., Jauk, E., & Neubauer, A. C. (2013) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0033644 · Cited by 223 · see citing works
Collaborative Creativity—Group Creativity and Team Innovation
Paulus, P. B., Dzindolet, M. T., & Kohn, N. W. (2011) · Elsevier eBooks · doi:10.1016/b978-0-12-374714-3.00014-8 · Cited by 202 · see citing works
Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101356 · Cited by 202 · see citing works
The Routledge International Handbook of Research on Teaching Thinking
(2015) · Routledge eBooks · doi:10.4324/9781315797021 · Cited by 201 · see citing works
How organizations can innovate with generative AI
Holmström, J., & Carroll, N. (2024) · Business Horizons · doi:10.1016/j.bushor.2024.02.010 · Cited by 196 · see citing works
Measuring creative self-efficacy and creative personal identity.
Karwowski, M., Lebuda, I., & Wiśniewska, E. (2018) · The International Journal of Creativity and Problem Solving · Cited by 176 · see citing works
Self-citationKarwowski, M., Lebuda, I., & Beghetto, R. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316979839.021 · Cited by 171 · see citing works
Self-citationSelf-efficacy and performance feedback: Impacts on cognitive load during creative thinking
Redifer, J. L., Bae, C. L. L., & Zhao, Q. (2020) · Learning and Instruction · doi:10.1016/j.learninstruc.2020.101395 · Cited by 167 · see citing works
Too Good to Be True: Bots and Bad Data From Mechanical Turk
Webb, M. A., & Tangney, J. P. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221120027 · Cited by 167 · see citing works
The originality of machines: AI takes the Torrance test
Guzik, E. E., Byrge, C., & Gilde, C. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100065 · Cited by 165 · see citing works
Creativity in the age of generative AI
Rafner, J., Beaty, R. E., Kaufman, J. C., Lubart, T., & Sherson, J. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01751-1 · Cited by 156 · see citing works
McGuire, J., De Cremer, D., & Van de Cruys, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-69423-2 · Cited by 150 · see citing works
How Generative AI Can Augment Human Creativity
Eapen, T. T., Finkenstadt, D. J., Folk, J., & Venkataswamy, L. (2024) · doi:10.2139/ssrn.4759930 · Cited by 148 · see citing works
The Paradox of Artificial Creativity: Challenges and Opportunities of Generative AI Artistry
Garcia, M. B. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2354622 · Cited by 147 · see citing works
Artificial intelligence as a tool for creativity
Ivcevic, Z., & Grandinetti, M. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2024.100079 · Cited by 146 · see citing works
Silvia, P. J. (2010) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2010.06.001 · Cited by 142 · see citing works
Forthmann, B., Szardenings, C., & Holling, H. (2018) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000196 · Cited by 138 · see citing works
Team Creativity and Innovation
Reiter‐Palmon, R., Wigert, B. G., & de Vreede, T. (2011) · Elsevier eBooks · doi:10.1016/b978-0-12-374714-3.00013-6 · Cited by 135 · see citing works
Sweller, J. (2018) · Perspectives on Medical Education · doi:10.1007/s40037-017-0395-4 · Cited by 130 · see citing works
AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Shaer, O., Cooper, A., Mokryn, O., Kun, A. L., & Ben Shoshan, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642414 · Cited by 130 · see citing works
Acar, S., Runco, M. A., & Park, H. (2019) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000256 · Cited by 129 · see citing works
Said‐Metwaly, S., Fernández‐Castilla, B., Kyndt, E., & Noortgate, W. V. D. (2019) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000244 · Cited by 124 · see citing works
Extending human creativity with AI
O’Toole, K., & Horvát, E.-Á. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2024.100080 · Cited by 112 · see citing works
Reiter‐Palmon, R., Illies, M. Y., Cross, L. K., Buboltz, C., & Nimps, T. (2009) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0013410 · Cited by 109 · see citing works
Johnson, D. R., Kaufman, J. C., Baker, B. S., Patterson, J. D., Barbot, B., Green, A. E., van Hell, J. G., Kennedy, E., Sullivan, G., Taylor, C. L., et al. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01986-2 · Cited by 99 · see citing works
Toward dynamizing the measurement of creative confidence beliefs.
Karwowski, M., Han, M.-H., & Beghetto, R. A. (2019) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000229 · Cited by 74 · see citing works
Self-citationIs artificial intelligence more creative than humans?
Cropley, D. H. (2023) · Learning Letters · doi:10.59453/ll.v2.13 · Cited by 68 · see citing works
Using Artificial Intelligence for enhancing Human Creativity
Elfa, M. A. A., & Dawood, M. E. T. (2023) · Journal of Art, Design, and Music · doi:10.55554/2785-9649.1017 · Cited by 62 · see citing works
AuDrA: An automated drawing assessment platform for evaluating creativity
Patterson, J. D., Barbot, B., Lloyd-Cox, J., & Beaty, R. E. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02258-3 · Cited by 58 · see citing works
Automatic Scoring of Metaphor Creativity with Large Language Models
DiStefano, P. V., Patterson, J. D., & Beaty, R. E. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2326343 · Cited by 53 · see citing works
Putting GPT-3's Creativity to the (Alternative Uses) Test
Stevenson, C., Smal, I., Baas, M., Grasman, R., & van der Maas, H. (2022) · arXiv · doi:10.48550/arxiv.2206.08932 · Cited by 51 · see citing works
Self-regulation for creative activity: The same or different across domains?
Zielińska, A., Forthmann, B., Lebuda, I., et al. (2023) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000540 · Cited by 47 · see citing works
Self-citationTeachers as creative agents: How self-beliefs and self-regulation drive teachers’ creative activity
Zielińska, A., Lebuda, I., Gop, A., & Karwowski, M. (2024) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2024.102267 · Cited by 44 · see citing works
Self-citationUsing a model of domain learning to understand the development of creativity
Dumas, D., Forthmann, B., & Alexander, P. A. (2024) · Educational Psychologist · doi:10.1080/00461520.2023.2291577 · Cited by 41 · see citing works
Acar, S., Dumas, D., Organisciak, P., et al. (2024) · Journal of Educational Psychology · doi:10.1037/edu0000844 · Cited by 39 · see citing works
Glăveanu, V. P., Gillespie, A., & Karwowski, M. (2018) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000171 · Cited by 34 · see citing works
Self-citationThe curious case of uncurious creation
Brainard, L. (2023) · Inquiry · doi:10.1080/0020174x.2023.2261503 · Cited by 28 · see citing works
Am I Still Creative? The Effect of Artificial Intelligence on Creative Self‐Beliefs
Faiella, A., Zielińska, A., Karwowski, M., & Corazza, G. E. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70011 · Cited by 23 · see citing works
Self-citationHow stable is the creative self-concept? A latent state-trait analysis.
Zandi, N., Karwowski, M., Forthmann, B., et al. (2022) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000521 · Cited by 20 · see citing works
Self-citationPartnering with AI for instrument development: Possibilities and pitfalls
Beghetto, R. A., Ross, W., Karwowski, M., & Glăveanu, V. P. (2024) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2024.101121 · Cited by 19 · see citing works
Self-citationPossibility Thinking Scale: An initial psychometric exploration
Glăveanu, V. P., Karwowski, M., Ross, W., & Beghetto, R. A. (2024) · Possibility Studies & Society · doi:10.1177/27538699241241827 · Cited by 17 · see citing works
Self-citationAutomated assessment of creativity in multilingual narratives.
Luchini, S. A., Moosa, I. M., Patterson, J. D., et al. (2025) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000725 · Cited by 16 · see citing works
Luchini, S. A., Maliakkal, N. T., DiStefano, P. V., Patterson, J. D., Beaty, R. E., & Reiter‐Palmon, R. (2023) · doi:10.31234/osf.io/g5qvf · Cited by 15 · see citing works
de Chantal, P., Zielińska, A., Lebuda, I., et al. (2023) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000613 · Cited by 13 · see citing works
Self-citationNijstad, B. A. (2014) · American Psychological Association eBooks · doi:10.1037/14342-002 · Cited by 10 · see citing works
Exploration of the creative processes in animals, robots, and AI: who holds the authorship?
Sueur, C., Lombard, J., Capra, O., Beltzung, B., & Pelé, M. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03125-y · Cited by 9 · see citing works
Forthmann, B., Karwowski, M., & Beaty, R. E. (2023) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000571 · Cited by 8 · see citing works
Self-citationDumas, D., Dong, Y., Kagan, S., & Campbell, W. K. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2371725 · Cited by 7 · see citing works
From helping hand to stumbling block: the ChatGPT paradox in competency experiment
Kim, D. G., & Moon, A. (2024) · Applied Economics Letters · doi:10.1080/13504851.2024.2337330 · Cited by 5 · see citing works
Automated Assessment of Creativity in Multilingual NarrativesPreprint
Luchini, S. A., Muhammad, M. I., Patterson, J. D., et al. (2024) · doi:10.31234/osf.io/f4a2g · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36 · see citing works
From humans to AI: understanding why AI is perceived as the preferred co-creation partner
Liu, Y., Yang, Y., & Xu, H. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1695532 · Cited by 10 · see citing works
- Authors
- Tang, M., Hofreiter, S., Werner, C. H., Zielińska, A., & Karwowski, M.
- Affiliations
- Hochschulinstitut Schaffhausen (CH)
- University of Applied Management (DE)
- University of Wrocław (PL)
- Corresponding author
- Hofreiter, Sebastian
- Venue
- The Journal of Creative Behavior
- Publisher
- Wiley
- Published
- 2024-12-10
- Volume
- 59
- Issue
- 3
- ISSN
- 0022-0175 (ISSN-L)
- 2162-6057
- OpenAlex
- W4405261195
- Semantic Scholar
- 3300d445c9b673fde9e565a31f444c78742caacc
- Cited by
- 32
- References
- 84
- Citations by year
- 2026: 21 · 2025: 11
- FWCI
- 13.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- The Journal of Creative Behavior (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Social Sciences › Psychology › Social Psychology › Team Dynamics and Performance
- Keywords
- human-AI co-creation, generative AI, ChatGPT, human-human collaboration, divergent thinking, creative problem solving, creative confidence, alternative uses task
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review