When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design Task
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Studies of Generative AI (GenAI)-assisted creative workflows have focused on individuals overcoming challenges of prompting to produce what they envisioned. When designers work in teams, how do collaboration and prompting influence each other, and how do users perceive generative AI and their collaborators during the co-prompting process? We engaged students with design or performance backgrounds, and little exposure to GenAI, to work in pairs with GenAI to create stage designs based on a creative theme. We found two patterns of collaborative prompting focused on generating story descriptions first, or visual imagery first. GenAI tools helped participants build consensus in the task, and allowed for discussion of the prompting strategies. Participants perceived GenAI as efficient tools rather than true collaborators, suggesting that human partners reduced the reliance on their use. This work highlights the importance of human-human collaboration when working with GenAI tools, suggesting systems that take advantage of shared human expertise in the prompting process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617 · cited 1×
“Through-out the coding process, researchers maintained detailed documentation of their coding decisions, including memos and reflective notes [11].”
Guest, G., MacQueen, K., & Namey, E. (2012) · doi:10.4135/9781483384436 · Cited by 7,924
Shin, D. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102551 · Cited by 1,548
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 1,274 · cited 6×
“The prompting process introduces challenges for non-expert users who often struggle with how to get started, how to choose the right instructions, or how to build up and modify the prompts [63].”
BackgroundResultInfluentialDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501825 · Cited by 639 · cited 2×
“While iteration is considered a common strategy in prompt engineering [35], the repeated prompting by non-expert users in a collaboration context can be frustrating due to the lack of trans-parency in GenAI’s mechanism.”
BackgroundDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635
Understanding and creating art with AI: Review and outlook
Cetinic, E., & She, J. (2022) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3475799 · Cited by 579
Establishing the rules for building trustworthy AI
Floridi, L. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0055-y · Cited by 394
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., & Suh, B. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174223 · Cited by 301 · cited 2×
“The tasks include comprehension and creative writing [7, 21, 42, 62], mixed-initiative storytelling [58], artistic visual creation [5, 8, 25, 47], audio production [37, 48, 56], video generation [20], etc.”
BackgroundNovice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
Louie, R., Coenen, A., Huang, C. Z., Terry, M., & Cai, C. J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376739 · Cited by 271 · cited 1×
“Thetasksincludecomprehension andcreativewriting[7,21,42,62],mixed-initiativestorytelling [58],artisticvisualcreation[5,8,25,47],audioproduction[37,48, 56],videogeneration[20],etc. Onestudyexploredinvolvingmore thanoneGenAIagentinusingChatGPTtogenerateastoryand visualizeitwithStableDiffusion[22].”
Mirowski, P., Mathewson, K. W., Pittman, J., & Evans, R. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581225 · Cited by 240 · cited 3×
“The tasks include comprehension and creative writing [7, 21, 42, 62], mixed-initiative storytelling [58], artistic visual creation [5, 8, 25, 47], audio production [37, 48, 56], video generation [20], etc.”
BackgroundMethodDeciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making
Rastogi, C., Zhang, Y., Wei, D., Varshney, K. R., Dhurandhar, A., & Tomsett, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512930 · Cited by 216 · cited 1×
“In addition to providing us with generative content for creative purpose, research shows that GenAI tools have the potential to facilitate decision-making [14, 49] and consensus-building [53] when they are involved in a collaboration scenario.”
BackgroundMetaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · cited 2×
“AI-generated content can facilitate the human creative process by providing in-spiration, ofering novel ideas, facilitating human expression, and performing laborious tasks [15, 18, 47].”
BackgroundMethodAI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition
Suh, M. (., Youngblom, E., Terry, M., & Cai, C. J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445219 · Cited by 138 · cited 1×
“They switched their focus to how to improve the content made by AI instead of having more creative engagement [57].”
It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through Sketch
Lin, Y., Guo, J., Chen, Y., Yao, C., & Ying, F. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376258 · Cited by 125 · cited 2×
“Generative AI (GenAI) has been employed in creative tasks wherein humans collaborate with AI in endeavors such as creative writing [15, 42], drawing [28, 34], performance [24], game design [18], art exhibition [30, 31], and music arrangement [36].”
BackgroundMethodWhere to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119 · cited 1×
“Another tool is designed to assist with the prompting process through automatic prompt editing [54].”
MethodBiermann, O. C., Ma, N. F., & Yoon, D. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533506 · Cited by 116 · cited 3×
“Also, previous work showed that writers are more willing to collaborate with GenAI when they lack confdence [1].”
BackgroundInfluentialCollaborative Diffusion: Boosting Designerly Co-Creation with Generative AI
Verheijden, M. P., & Funk, M. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585680 · Cited by 83 · cited 2×
“While visual representations are especially needed in creative design [64], designers fnd it challenging to utilize text-to-image GenAI to translate one’s original ideas into precise prompt words while ensuring comprehensiveness and accuracy, often resulting in images of diverse quality [61].”
BackgroundChang, T.-S., Li, Y., Huang, H.-W., & Whitfield, B. (2021) · 2021 2nd International Conference on Education Development and Studies · doi:10.1145/3459043.3459065 · Cited by 74 · cited 1×
“The tasks include comprehension and creative writing [7, 21, 42, 62], mixed-initiative storytelling [58], artistic visual creation [5, 8, 25, 47], audio production [37, 48, 56], video generation [20], etc.”
BackgroundWhen is a Tool a Tool? User Perceptions of System Agency in Human–AI Co-Creative Drawing
Lawton, T., Grace, K., & Ibarrola, F. J. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595977 · Cited by 72 · cited 3×
“Generative AI (GenAI) has been employed in creative tasks wherein humans collaborate with AI in endeavors such as creative writing [15, 42], drawing [28, 34], performance [24], game design [18], art exhibition [30, 31], and music arrangement [36].”
BackgroundMethodKwon, E., Rao, V., & Goucher-Lambert, K. (2023) · Design Studies · doi:10.1016/j.destud.2023.101202 · Cited by 58
Research works printed but not linked: 41
- 10.1145/3586183.3606725 · DOI · Paper page
- Snyder Carolyn. 2003. Paper prototyping: The fast and easy way to design and refine user interfaces. Morgan Kaufmann Burlington.
- 10.1145/3591196.3593515 · DOI · Paper page
- 10.1145/2856767.2856795 · DOI · Paper page
- 10.1145/3563703.3596652 · DOI
- 10.1145/3531146.3533202 · DOI · Paper page
- 10.1287/isre.2021.1079 · DOI · Paper page
- 10.1016/j.destud.2013.01.004 · DOI
- 10.1145/3290605.3300854 · DOI · Paper page
- 10.1016/j.jengtecman.2007.01.008 · DOI · Paper page
- Wenyi Hong Ming Ding Wendi Zheng Xinghan Liu and Jie Tang. 2022. CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers. arxiv:2205.15868 [cs.CV] · arXiv
- Daphne Ippolito Ann Yuan Andy Coenen and Sehmon Burnam. 2022. Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers. arxiv:2211.05030 [cs.HC] · arXiv
- Ze Jin and Zorina Song. 2023. Generating coherent comic with rich story using ChatGPT and Stable Diffusion. arxiv:2305.11067 [cs.CV] · arXiv
- Emma Jones, Sofia Torres, and Miguel Arévalo. 2020. Exploring the experiences of marginalized youth: A qualitative study. Journal of Youth Studies 23, 5 (2020), 678–695.
- 10.1145/3544548.3580885 · DOI
- Pegah Karimi Mary Lou Maher Nicholas Davis and Kazjon Grace. 2019. Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System. arxiv:1906.10188 [cs.HC] · arXiv
- Yu-Ren Lai, Hsi-Jen Chen, and Chia-Han Yang. 2023. Exploring the Impact of Generative Artificial Intelligence on the Design Process: Opportunities, Challenges, and Insights. Artificial Intelligence, Social Computing and Wearable Technologies 113 (2023), 49–59.
- 10.1145/3483529.3483537 · DOI
- 10.1145/3591196.3593341 · DOI
- 10.1145/3563703.3596805 · DOI
- 10.1145/3581783.3613791 · doi:10.1145/3581783.3613791
- 10.1145/3610182 · DOI
- 10.1145/3313831.3376739 · DOI · Paper page
- 10.1080/08959280903400150 · DOI
- 10.1177/15553434211017354 · DOI · Paper page
- Matthew B Miles, A Michael Huberman, and Johnny Saldana. 2014. Qualitative data analysis: A methods sourcebook. SAGE, California, CA, USA.
- 10.1016/j.tsc.2019.100626 · DOI · Paper page
- 10.1016/j.destud.2022.101120 · DOI
- Bernard A Nijstad and Wolfgang Stroebe. 2006. How the group affects the mind: A cognitive model of idea generation in groups. Personality and social psychology review 10, 3 (2006), 186–213.
- 10.1145/3343031.3350610 · doi:10.1145/3343031.3350610
- Johnny Saldana. 2015. The coding manual for qualitative researchers. SAGE, California, CA, USA.
- 10.1108/TPM-01-2013-0003 · DOI
- 10.1145/3526113.3545671 · DOI
- Marc Stickdorn and Jakob Schneider. 2011. This is service design thinking: Basics-tools-cases. BIS Publishers, New York, NY, USA.
- 10.1145/3411764.3445219 · DOI · Paper page
- Yuqian Sun, Xuran Ni, Haozhen Feng, RAY LC, Chang Hee Lee, and Ali Asadipour. 2022. Bringing Stories to Life in 1001 Nights: A Co-creative Text Adventure Game Using a Story Generation Model. In Interactive Storytelling, Mirjam Vosmeer and Lissa Holloway-Attaway (Eds.). Springer International Publishing, Cham, 651–672.
- 10.1016/j.tsc.2020.100696 · DOI · Paper page
- Piet Van den Bossche, Wim Gijselaers, Mien Segers, Geert Woltjer, and Paul Kirschner. 2011. Team learning: building shared mental models. Instructional science 39 (2011), 283–301.
- Daijin Yang, Yanpeng Zhou, Zhiyuan Zhang, Toby Jia-Jun Li, and RAY LC. 2022. AI as an Active Writer: Interaction strategies with generated text in human-AI collaborative fiction writing. In Joint Proceedings of the IUI 2022 Workshops, Vol. 10. CEUR-WS Team, CEUR, Helsinki, Finland, 56–65.
- 10.1145/3591196.3596820 · DOI
- 10.1016/j.destud.2021.100990 · DOI · Paper page
Cited by
AIdeation: Designing a Human-AI Collaborative Ideation System for Concept Designers
Wang, W.-F., Lu, C.-T., Ponsa i Campanyà, N., Chen, B.-Y., & Chen, M. Y. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714148 · Cited by 50
Sketchar: Supporting Character Design and Illustration Prototyping Using Generative AI
Ling, L., Chen, X., Wen, R., Li, T. J.-J., & LC, R. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677102 · Cited by 52
“Deckers’ approach reframes prompt engineering as interactive text-based retrieval on an "infinite index" [18], while Ramesh proposes a similar transformer-based approach for this task [61].”
Self-citationGovernance of Generative AI in Creative Work: Consent, Credit, Compensation, and Beyond
Kyi, L., Mahuli, A., Silberman, M. S., Binns, R., Zhao, J., & Biega, A. J. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713799 · Cited by 28
CreAItive Collaboration? Users' Misjudgment of AI-Creativity Affects Their Collaborative Performance
Bangerl, M. M., Disch, L., David, T., & Pammer-Schindler, V. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713886 · Cited by 13
“…context of diferent creative domains, including creative [36, 53, 109, 117], argumentative [67], and inclusive writing [64], fashion [23], stage [49], and tattoo [86] design, as well as drawing [22, 77], dancing [112], qualitative coding [35], and programming [31, 57–59, Diferent frameworks are…”
How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters
Tang, Y., Zhou, J., Li, H., Xie, X., Ma, X., & Qu, H. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790300 · Cited by 5
“Existing research generally reflects this tendency for human proactive changes but remains fragmented.”
Metadata
- Authors
- Han, Y., Qiu, Z., Cheng, J., & LC, R.
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-14
- OpenAlex
- W4396832642
- Cited by
- 104
- References
- 22
- FWCI
- 138.29
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.