Text-to-Image AI as a Catalyst for Semantic Convergence in Creative Collaborations
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Design ideation requires both creative and divergent thinking as well as collaboration and exchange to bring forth new insights and design possibilities. In this paper, we investigate such a collaboration with the use of emerging generative AI tools, and we explore how they may help in achieving agreement and semantic convergence between designers. We conducted workshops using Text-to-Image AI with design students and found that in addition to known advantages of brainstorming, the text prompts required by the AI system engaged students in verbal articulations that aided their design process. In collaborative contexts, the generated images shifted the centre of attention for team members to reach convergence through sharing their interpretations. We conclude that text-to-image AI can be beneficial for students’ design processes as a catalyst for brainstorming rather than a tool for generating design imagery and presentations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tool-mediated passive and semi-proactive agency dominate here.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [102]
In the citing paper
“Control is frequently exerted through guided input (e.g., prompt engineering [102, 171]) and iterative refinement cycles [124].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [102]
In the citing paper
“This aligns with theories distinguishing agency from control [100, 131], detailing the practical interface mechanisms (e.g., 'Guided Input' [102], 'Intervention' [70]) that shape the user's experience of agency [100].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [102]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A Thousand Plateaus: Capitalism and Schizophrenia
Gilman, S. L., Deleuze, G., Guattari, F., & Massumi, B. (1989) · Journal of Interdisciplinary History · doi:10.2307/203963 · Cited by 22,692
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555 · cited 1×
“We also witnessed a process of grounding [15] where all participants linger on a common image for interpretations and agreements, while also acknowledging each others’ understanding.”
BackgroundAmbiguity as a resource for design
Gaver, W. W., Beaver, J., & Benford, S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642653 · Cited by 1,474 · cited 1×
“Such detail of the image could provide inspiration and material for the designer to work on [7], but at the same time provides ambiguity [25] that invites interpretations.”
BackgroundProceedings of the 2021 CHI Conference on Human Factors in Computing Systems
(2021) · doi:10.1145/3411764 · Cited by 1,240
What should we expect from research through design?
Gaver, W. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208538 · Cited by 1,123 · cited 1×
“In Research through Design [23, 38], the creative process is focused on discovery through making [24, 29] rather than optimal solutions for rationalised problems, while in design for engineering the main focus is on problem-solving, and product development engages with the user, function,…”
BackgroundLearning by Collaborating: Convergent Conceptual Change
Roschelle, J. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0203_1 · Cited by 1,015 · cited 1×
“Through this process, ideas are generated, which creates an ‘ideas cloud’ (yellow: ideas cloud). been proven that synchronising the conceptual and semantic understanding among collaborators [51] is crucial for a productive design process.”
BackgroundApplied Imagination: Principles and Procedures of Creative Thinking
Osborn, A. F. (1953) · Medical Entomology and Zoology · Cited by 860
Design Research Through Practice: From the Lab, Field, and Showroom
Koskinen, I., Zimmerman, J., Binder, T., Redstrom, J., & Wensveen, S. (2013) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2013.2274109 · Cited by 694 · cited 1×
“In Research through Design [23, 38], the creative process is focused on discovery through making [24, 29] rather than optimal solutions for rationalised problems, while in design for engineering the main focus is on problem-solving, and product development engages with the user, function,…”
BackgroundDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501825 · Cited by 639 · cited 2×
“While the possibilities of using text-to-image AI for idea generation is well researched [12, 37, 39, 40], less attention has been paid to how this might change the nature of team collaborations in design.”
BackgroundMethodDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635 · cited 2×
“While the possibilities of using text-to-image AI for idea generation is well researched [12, 37, 39, 40], less attention has been paid to how this might change the nature of team collaborations in design.”
BackgroundMethodProceedings of the SIGCHI Conference on Human Factors in Computing Systems
Konstan, J. A., Ed, H., & Höök, K. (2012) · Cited by 394
Amplifying the Mind's Eye: Sketching and Visual Cognition
Fish, J., & Scrivener, S. (1990) · Leonardo · doi:10.2307/1578475 · Cited by 302 · cited 1×
“Diferent methods to convey non-textual complex information exists, such as brainstorming [3, 45], sketching[20, 21, 44], diagrams [11, 19, 43], and design cards [1].”
MethodDesign ideation: the conceptual sketch in the digital age
Jonson, B. (2005) · Design Studies · doi:10.1016/j.destud.2005.03.001 · Cited by 298 · cited 1×
“When text-to-image AI is integrated into the discussion, the dynamic changes, which is not unexpected but also not predicted as previous research has revealed that new digital tools will also infuence the choices of existing tools for ideation [35].”
BackgroundAnti-Solutionist Strategies: Seriously Silly Design Fiction
Blythe, M., Andersen, K., Clarke, R., & Wright, P. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858482 · Cited by 220
Self-citationThe structure of concurrent cognitive actions: a case study on novice and expert designers
Kavakli, M., & Gero, J. S. (2002) · Design Studies · doi:10.1016/s0142-694x(01)00021-7 · Cited by 208 · cited 1×
“…are capable of ‘forming abstract conceptualisation’ and ‘accessing larger chunks of information’ [17], whereas novice designers tend to narrow their options and focus on non-actionable, or more mundane directions for prototyping, or even sometimes fail to come to any result [5, 14, 17, 36].”
BackgroundA review of brainstorming techniques in higher education
Al-Samarraie, H., & Hurmuzan, S. (2018) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2017.12.002 · Cited by 206 · cited 1×
“Diferent methods to convey non-textual complex information exists, such as brainstorming [3, 45], sketching[20, 21, 44], diagrams [11, 19, 43], and design cards [1].”
MethodProceedings of the 2020 ACM Designing Interactive Systems Conference
(2020) · doi:10.1145/3357236 · Cited by 187
Self-citationThings We Could Design: For More Than Human-Centered Worlds
Wakkary, R. (2021) · TU/e Research Portal · Cited by 186
Design Ideation with AI - Sketching, Thinking and Talking with Generative Machine Learning Models
Tholander, J., & Jonsson, M. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596014 · Cited by 148
Proceedings of the 2023 ACM Designing Interactive Systems Conference
(2023) · doi:10.1145/3563657 · Cited by 147
Advancing an understanding of design cognition and design metacognition: Progress and prospects
Ball, L. J., & Christensen, B. T. (2019) · Design Studies · doi:10.1016/j.destud.2019.10.003 · Cited by 140 · cited 1×
“The participants were asked to ‘think aloud’ throughout [6] and iterations and multiple prompts running in parallel were allowed.”
BackgroundMachine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
Benjamin, J. J., Berger, A., Merrill, N., & Pierce, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445481 · Cited by 130 · cited 1×
“Such detail of the image could provide inspiration and material for the designer to work on [7], but at the same time provides ambiguity [25] that invites interpretations.”
BackgroundIt Is Your Turn: Collaborative Ideation With a Co-Creative Robot through Sketch
Lin, Y., Guo, J., Chen, Y., Yao, C., & Ying, F. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376258 · Cited by 125 · cited 1×
“While the possibilities of using text-to-image AI for idea generation is well researched [12, 37, 39, 40], less attention has been paid to how this might change the nature of team collaborations in design.”
BackgroundDesigning with AI: An Exploration of Co-Ideation with Image Generators
Chiou, L.-Y., Hung, P.-K., Liang, R.-H., & Wang, C.-T. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596001 · Cited by 113 · cited 3×
“While the possibilities of using text-to-image AI for idea generation is well researched [12, 37, 39, 40], less attention has been paid to how this might change the nature of team collaborations in design.”
BackgroundMay AI?: Design Ideation with Cooperative Contextual Bandits
Koch, J., Lucero, A., Hegemann, L., & Oulasvirta, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300863 · Cited by 112
Thinking with diagrams in architectural design
Do, E. Y.-L., & Gross, M. D. (2001) · Artificial Intelligence Review · doi:10.1023/a:1006661524497 · Cited by 109 · cited 1×
“Diferent methods to convey non-textual complex information exists, such as brainstorming [3, 45], sketching[20, 21, 44], diagrams [11, 19, 43], and design cards [1].”
MethodEmergence as a Feature of Practice-based Design Research
Gaver, W., Krogh, P. G., Boucher, A., & Chatting, D. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533524 · Cited by 107 · cited 1×
“In Research through Design [23, 38], the creative process is focused on discovery through making [24, 29] rather than optimal solutions for rationalised problems, while in design for engineering the main focus is on problem-solving, and product development engages with the user, function,…”
BackgroundCo-evolution and emergence in design
Poon, J., & Maher, M. L. (1997) · Artificial Intelligence in Engineering · doi:10.1016/s0954-1810(96)00047-7 · Cited by 101 · cited 1×
“1) to go through an often free-fowing, organic process [46] of research, ideation, evaluation, decision-making, prototyping, and production [26–28 , A large part of this collaborative design process consists of designers explaining what is on their mind to their fellow designers, in efect engaging…”
BackgroundBiases in Generative Art: A Causal Look from the Lens of Art History
Srinivasan, R., & Uchino, K. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445869 · Cited by 67 · cited 2×
“Second, the social interpretation of text-image relations through big data which in other words refects social norms and biases that are innate to text-to-image AI as previous research has revealed [53].”
BackgroundResultTalking design: negotiating the verbal–visual translation
Tomes, A. E., Oates, C. J., & Armstrong, P. (1998) · Design Studies · doi:10.1016/s0142-694x(97)00027-6 · Cited by 66 · cited 1×
“Furthermore, previous research has discovered that verbal-visual translation plays a strong role in ideation [55], whereas in our research the verbal-visual translation also happens as the text-to-image AI requires participants to enter texts in order to generate images.”
BackgroundDigital crafts-machine-ship: creative collaborations with machines
Andersen, K., Wakkary, R., Devendorf, L., & McLean, A. (2019) · Interactions · doi:10.1145/3373644 · Cited by 59
Self-citationDesign Card Sets: Systematic Literature Survey and Card Sorting Study
Aarts, T., Gabrielaitis, L. K., de Jong, L. C., Noortman, R., van Zoelen, E. M., Kotea, S., Cazacu, S., Lock, L. L., & Markopoulos, P. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395516 · Cited by 44 · cited 1×
“Diferent methods to convey non-textual complex information exists, such as brainstorming [3, 45], sketching[20, 21, 44], diagrams [11, 19, 43], and design cards [1].”
MethodCognitive Science Approaches To Understanding Diagrammatic Representations
Cheng, P., Lowe, R., & Scaife, M. (2001) · Springer eBooks · doi:10.1007/978-94-017-3524-7_5 · Cited by 38
da Rocha, B. G., van der Kolk, J. M. L., & Andersen, K. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445236 · Cited by 32
Self-citationda Rocha, B. G., & Andersen, K. (2020) · ACM Designing Interactive Systems Conference (DIS) · doi:10.1145/3393914.3395881 · Cited by 27 · cited 1×
“In Research through Design [23, 38], the creative process is focused on discovery through making [24, 29] rather than optimal solutions for rationalised problems, while in design for engineering the main focus is on problem-solving, and product development engages with the user, function,…”
BackgroundSelf-citationCamba, J. D., Kimbrough, M., & Kwon, E. (2018) · J of Design Research · doi:10.1504/jdr.2018.092810 · Cited by 26
Cognitive tools shape thought: diagrams in design
Nickerson, J. V., Corter, J. E., Tversky, B., Rho, Y. J., Zahner, D., & Yu, L. (2013) · Cognitive Processing · doi:10.1007/s10339-013-0547-3 · Cited by 25 · cited 1×
“Diferent methods to convey non-textual complex information exists, such as brainstorming [3, 45], sketching[20, 21, 44], diagrams [11, 19, 43], and design cards [1].”
MethodCreation and characterization of design spaces
Gero, J. S., & Milovanovic, J. (2022) · Proceedings of DRS · doi:10.21606/drs.2022.265 · Cited by 24 · cited 1×
“1) to go through an often free-fowing, organic process [46] of research, ideation, evaluation, decision-making, prototyping, and production [26–28 , A large part of this collaborative design process consists of designers explaining what is on their mind to their fellow designers, in efect engaging…”
BackgroundSketching Sketching: Outlines of a Collaborative Design Method
Craft, B., & Cairns, P. A. (2009) · Electronic workshops in computing · doi:10.14236/ewic/hci2009.8 · Cited by 20
Drawing and ideation process in design education: A systematic literature review
Novica, D. R., Wianto, E., & Campos, S. A. (2023) · Cogent Arts and Humanities · doi:10.1080/23311983.2023.2219487 · Cited by 20
Sketching as a tool for knowledge management: an interdisciplinary literature review on its benefits
Eppler, M. J., & Pfister, R. (2011) · International Conference on Knowledge Management and Knowledge Technologies · doi:10.1145/2024288.2024301 · Cited by 9 · cited 1×
“Diferent methods to convey non-textual complex information exists, such as brainstorming [3, 45], sketching[20, 21, 44], diagrams [11, 19, 43], and design cards [1].”
Method
Research works printed but not linked: 14
- AEC Magazine AEC Magazine. 2022. Midjourney Architecture: Hassan Ragab. Retrieved Jan 10, 2023 from https://aecmag.com/ai/midjourney-architecture-hassan-ragab-conceptual-ai-rtist/
- Cynthia J Atman, Justin R Chimka, Karen M Bursic, and Heather L Nachtmann. 1999. A comparison of freshman and senior engineering design processes. Design studies 20, 2 (1999), 131–152.
- Mao-Lin Chiu. 2002. An organizational view of design communication in design collaboration. Design studies 23, 2 (2002), 187–210.
- HHCM Christiaans and Kees H Dorst. 1992. Cognitive models in industrial design engineering: a protocol study. Design theory and methodology 42, 1 (1992), 131–140.
- Nigel Cross. 2004. Expertise in design: an overview. Design studies 25, 5 (2004), 427–441.
- John S Gero and Udo Kannengiesser. 2004. The situated function–behaviour–structure framework. Design studies 25, 4 (2004), 373–391.
- Milene Gonçalves, Carlos Cardoso, and Petra Badke-Schaub. 2014. What inspires designers? Preferences on inspirational approaches during idea generation. Design studies 35, 1 (2014), 29–53.
- Hamid Hassanzadeh. 2022. How midjourney and dall·e 2 help designers to create unique concepts?Retrieved Jan 10, 2023 from https://parametric-architecture.com/how-midjourney-and-dalle-2-help-designers-to-create-unique-concepts/
- Serra Utkum Ikiz. 2022. 10 designers and their impressive Midjourney Works you should know. Retrieved Jan 10, 2023 from https://parametric-architecture.com/10-designers-and-their-impressive-midjourney-works-you-should-know/
- Midjourney. 2022. Midjourney. Midjourney Inc. Retrieved Jan 10, 2023 from https://midjourney.com
- Newfacet. 2022. NEWFACET: FUSING AI AND FASHION. Retrieved Jan 10, 2023 from https://www.designboom.com/design/newfacet-imagines-abstract-fashion-campaign-ai-program-stable-diffusion-12-29-2022/
- Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 1, 2 (2022), 3. · arXiv
- Jeba Rezwana and Mary Lou Maher. 2021. COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems. In Proceedings of the Twelfth International Conference on Computational Creativity, México City, México (Virtual), September 14-18, 2021, Andrés Gómez de Silva Garza, Tony Veale, Wendy Aguilar, and Rafael Pérez y Pérez (Eds.). Association for Computational Creativity (ACC), 444–448. https://computationalcreativity.net/iccc21/wp-content/uploads/2021/09/Wkshp2.pdf
- Simeon J Simoff and Mary Lou Maher. 2000. Analysing participation in collaborative design environments. Design studies 21, 2 (2000), 119–144.
Cited by
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
“Examples include specifying distinct human-AI cooperative roles [102], implementing predetermined control levels through interface design [148], or structuring interaction based on distinct task phases [164].”
InfluentialWu, X., Tran, T. T. M., Zhou, Q., Sun, J., Wu, H., & Wang, X. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-13914-4 · Cited by 12
“Most students distinguish between process co-creation (supported by GenAI) and outcome authorship (retained by the student) (Lim et al., 2023; Lin et al., 2024; Sáez-Velasco et al., 2024; Sun et al., 2024).”
Wang, P., Khinvasara, Y., Creijghton, G. J., Scholing, T., Wang, Y., Zhou, Z., Childs, P., & Yin, Y. (2025) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060425100127 · Cited by 31
Santiago, J. M., Sendner, M., Ralser, D., & Meschtscherjakov, A. (2025) · Applied Sciences · doi:10.3390/app15105506 · Cited by 12
Designer experiences and perspectives on the role of generative AI in industrial design
Süner-Pla-Cerdà, S., Şen, G., Kumbasar, E., Şahin, B., & Ünlü, C. E. (2025) · AI & Society · doi:10.1007/s00146-025-02504-6 · Cited by 16
Metadata
- Authors
- Lin, P.-Y., Andersen, K., Schmidt, R., Schoenmakers, S., Hofmeyer, H., Pauwels, P., & Ijsselsteijn, W.
- Affiliations
- Eindhoven University of Technology (NL)
- ORCID
- Venue
- Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2024-07
- Pages
- 2753-2767
- OpenAlex
- W4400142381
- Semantic Scholar
- 92b86d69b0a538f7ec1f27f0228f480a43ecc25b
- Cited by
- 9
- References
- 45
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 2
- FWCI
- 11.54
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Designing Interactive Systems Conference (publishedVersion, cc-by-nc-sa)
- TU/e Research Portal (submittedVersion, cc-by-nc-sa)
- Funders
- Eindhoven Artificial Intelligence Systems Institute
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- text-to-image AI, generative AI, design ideation, co-design, semantic convergence, brainstorming, design students, text prompts, design education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.