Beyond Text-to-Image: Multimodal Prompts to Explore Generative AI
Open accessAbstract
Text-to-image AI systems have proven to have extraordinary generative capacities that have facilitated widespread adoption. However, these systems are primarily text-based, which is a fundamental inversion of what many artists are traditionally used to: having full control over the composition of their work. Prior work has shown that there is great utility in using text prompts and that AI augmented workflows can increase momentum on creative tasks for end users. However, multimodal interactions beyond text need to be further defined, so end users can have rich points of interaction that allow them to truly co-pilot AI-generated content creation. To this end, the goal of my research is to equip creators with workflows that 1) translate abstract design goals into prompts of visual language, 2) structure exploration of design outcomes, and 3) integrate creator contributions into generations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent work on design considerations for generative AI has been limited to specific application domains or technologies.
“Although recent work has begun to probe at design considerations for generative AI, this work has been limited to specific application domains or technologies. For example, guidelines of various maturity levels exist for GAN-based interfaces [57, 195], image creation [102, 104, 173], prompt engineering [102, 104], virtual reality [169], collaborative storytelling [146], and workflows with co-crea”
From Design Principles for Generative AI Applications (2024) · cites this paper as [102]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 15,880 · see citing works
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · see citing works
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,695 · see citing works
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714 · see citing works
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · see citing works
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471 · see citing works
Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 1× · see citing works
“A user can use prompts to fexibly adapt what task they want a large pretrained model to handle [3, 26].”
BackgroundDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635 · see citing works
Self-citationAn Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion
Gal, R., Alaluf, Y., Atzmon, Y., Patashnik, O., Bermano, A. H., Chechik, G., & Cohen-Or, D. (2022) · arXiv · doi:10.48550/arxiv.2208.01618 · Cited by 611 · see citing works
Wu, T., Terry, M. A., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517582 · Cited by 536 · see citing works
DreamFusion: Text-to-3D using 2D DiffusionPreprint
Poole, B., Jain, A., Barron, J. T., & Mildenhall, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.14988 · Cited by 475 · see citing works
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors
Gafni, O., Polyak, A., Ashual, O., Sheynin, S., Parikh, D., & Taigman, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_6 · Cited by 345 · see citing works
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors
Gafni, O., Polyak, A., Ashual, O., Sheynin, S., Parikh, D., & Taigman, Y. (2022) · arXiv · doi:10.48550/arxiv.2203.13131 · Cited by 332 · see citing works
VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance
Crowson, K., Biderman, S., Kornis, D., Stander, D., Hallahan, E., Castricato, L., & Raff, E. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19836-6_6 · Cited by 316 · see citing works
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.07213 · Cited by 306 · cited 1× · see citing works
“Auditing work has unearthed social and gender biases [6], and strategies such as redteaming [5] have been implemented to discover and patch loopholes that can produce nefarious outputs.”
BackgroundDALL-EVAL: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models
Cho, J., Zala, A., & Bansal, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00283 · Cited by 199 · see citing works
PromptChainer: Chaining Large Language Model Prompts through Visual Programming
Wu, T., Jiang, E., Donsbach, A., Gray, J., Molina, A., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519729 · Cited by 198 · see citing works
3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows
Liu, V., Vermeulen, J., Fitzmaurice, G. W., & Matejka, J. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596098 · Cited by 179 · see citing works
Self-citationPoint-E: A System for Generating 3D Point Clouds from Complex PromptsPreprint
Nichol, A., Jun, H., Dhariwal, P., Mishkin, P., & Chen, M. I.-C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.08751 · Cited by 160 · see citing works
FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion Design
Jeon, Y., Jin, S., Shih, P. C., & Han, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445093 · Cited by 145 · see citing works
Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119 · see citing works
Opal: Multimodal Image Generation for News Illustration
Liu, V., Qiao, H., & Chilton, L. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545621 · Cited by 104 · see citing works
Self-citationPhenaki: Variable Length Video Generation From Open Domain Textual Description
Villegas, R., Babaeizadeh, M., Kindermans, P.-J., Moraldo, H., Zhang, H., Saffar, M. T., Castro, S., Kunze, J., & Erhan, D. (2022) · arXiv · doi:10.48550/arxiv.2210.02399 · Cited by 92 · cited 2× · see citing works
“Generative models are capable of text-based generation for text [4], images [9, 27], videos [29], and 3D shapes [21].”
BackgroundInitial Images: Using Image Prompts to Improve Subject Representation in Multimodal AI Generated Art
Qiao, H., Liu, V., & Chilton, L. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532792 · Cited by 46 · see citing works
Self-citationVQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language GuidancePreprint
Crowson, K., Biderman, S., Kornis, D., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.08583 · Cited by 30 · see citing works
DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation ModelsPreprint
Cho, J., Zala, A., & Bansal, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.04053 · Cited by 24 · see citing works
Explainable Computational Creativity
Llano, M. T., d’Inverno, M., Yee-King, M. J., et al. (2022) · Goldsmiths (University of London) · doi:10.48550/arxiv.2205.05682 · Cited by 20 · see citing works
Opal: Multimodal Image Generation for News IllustrationPreprint
Liu, V., Qiao, H., & Chilton, L. B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.09007 · Cited by 5 · see citing works
Self-citation3DALL-E: Integrating Text-to-Image AI in 3D Design WorkflowsPreprint
Liu, V., Vermeulen, J., Fitzmaurice, G. W., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.11603 · Cited by 5 · see citing works
Self-citationSparks: Inspiration for Science Writing using Language ModelsPreprint
Gero, K. I., Liu, V., & Chilton, L. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07640 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- 10.48550/arxiv.2203.06566 · DOI
Cited by
Sorted by citations
Design Principles for Generative AI Applications
Weisz, J. D., He, J., Muller, M., Hoefer, G., Miles, R., & Geyer, W. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642466 · Cited by 232 · see citing works
“A growing body of work within the human-centered AI research community has proposed best practices for human-AI interaction in the form of design guidelines (e.g., [7, 11, 104, 186, 192]), formal studies (e.g., [24, 102]), toolkits (e.g., [110]), and reviews (e.g., [59, 72, 180, 188]).”
BackgroundPrompt Engineering in Education: A Systematic Review of Approaches and Educational Applications
Qian, Y. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251365189 · Cited by 91 · see citing works
“Multimodal prompt learning signi fi cantly expands traditional prompt engineering by incorporating diverse input forms such as text, images, and structured data (Liu, 2023; Liu & Chilton, 2022).”
Reza, M., Laundry, N. M., Musabirov, I., Dushniku, P., Yu, Z. Y. “., Mittal, K., Grossman, T., Liut, M., Kuzminykh, A., & Williams, J. J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641899 · Cited by 52 · see citing works
“For example, an application for editing AI-generated images could implement an AI Modifier which accepts textual instructions and generates corresponding image variations, which are then organized within Variation Fields, contributing to HCI research on text-to-image AI editors [6, 54, 55, 70, 93].”
Liu, M., Zhang, L. J., & Zhang, D. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108569 · Cited by 43 · see citing works
Jin, Y., Yoon, J., Self, J. A., & Lee, K. (2024) · Archives of Design Research · doi:10.15187/adr.2024.07.37.3.25 · Cited by 41 · see citing works
“The need for clear design concepts and frameworks remains critical to prevent over-reliance on AI and ensure human-centered design outcomes, as suggested by Liu (2023). www.aodr.org 37 Figure 7 The creative process of participants using AI-generated design tools.”
Li, W., Zhang, W., Wu, W., & Xu, J. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2396199 · Cited by 39 · see citing works
“Doing so may better resolve problems within the product design domain to gain more feasible solutions for the application of AIGC models in product design tasks(Liu 2023).”
A Preliminary Exploration of YouTubers' Use of Generative-AI in Content Creation
Lyu, Y., Zhang, H., Niu, S., & Cai, J. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651057 · Cited by 37 · see citing works
Riche, N. H., Offenwanger, A., Gmeiner, F., Brown, D., Romat, H., Pahud, M., Marquardt, N., Inkpen, K. M., & Hinckley, K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714259 · Cited by 28 · see citing works
GenAICHI 2024: Generative AI and HCI at CHI 2024
Muller, M. J., Kantosalo, A., Maher, M. L., Martin, C. P., & Walsh, G. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3636294 · Cited by 27 · see citing works
“Since these workshops, multiple lines of progress in generative AI technologies and applications have brought about exciting new opportunities with LLMs and Foundation Models (FMs) [10, 16, 26, 46, 67, 93], while also presenting new technical and ethical challenges [30, 37, 59, 105].”
Hwang, A. H., Siy, J. O., Shelby, R. M., & Lentz, A. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661555 · Cited by 26 · see citing works
“These include but are not limited to the uses of genAI in information synthesis [6, 22], automation of work [85, 97, 114], and creative production [15, 18, 63, 80, 82, 105, 106].”
BackgroundLanguage Models as Black-Box Optimizers for Vision-Language Models
Liu, S., Yu, S., Lin, Z., Pathak, D., & Ramanan, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01206 · Cited by 25 · see citing works
“Optimizing T2I using a multimodal LLM. DALL-E 3 can generate high-fidelity images following diverse user queries, but crafting effective prompts is tricky even for designers experienced with AI content generation tools [36].”
MethodGenAICHI 2025: Generative AI and HCI at CHI 2025
Muller, M. J., Chilton, L. B., Maher, M. L., Martin, C. P., Choi, M., Walsh, G., & Kantosalo, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3707213 · Cited by 18 · see citing works
“Since these workshops, multiple lines of progress in generative AI technologies and applications have brought about exciting new opportunities with LLMs and Foundation Models (FMs) [13, 25, 36, 63, 88, 121], while also presenting new technical and ethical challenges [39, 50, 80, 136].”
Design of Generative Multimodal AI Agents to Enable Persons with Learning Disability
Rajagopal, A. R., Nirmala, V., Jebadurai, I. J., Vedamanickam, A. M., & Kumar, P. U. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3610661.3617514 · Cited by 16 · see citing works
“advances in Multimodal Large Language models [7] or Multimodal Generative AI [6-15] have opened the doors to contribute to the conceptualization of innovative assistive technology to enable persons with Neurodevelopmental disorders.”
BackgroundBias by Default.: Neocolonial Visual Vocabularies in AI Image Generating Design Practices.
de Almeida, F., & Rafael, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3644053 · Cited by 15 · see citing works
“The applications of AI Image Generators on a large commercial scale across various sectors such as entertainment, education, and advertising drive developments and research in usability, prompt engineering, and functionalities [22] [37] [38] [39].”
Marquardt, N., Roseway, A., Romat, H., Panda, P., Pahud, M., Ramos, G., Drucker, S. M., Wilson, A. D., Hinckley, K., & Riche, N. H. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747631 · Cited by 14 · see citing works
“These advancements show how AI can mediate between sketches and prompts as co-existing design materials [49], hinting at inherently multi-modal experiences [24, 57].”
The Role of Generative AI in Shaping Millennials and Gen Z’s Orientation Toward Luxury Products
AbouElgheit, E. (2024) · Journal of Marketing Development and Competitiveness · doi:10.33423/jmdc.v18i2.7012 · Cited by 10 · see citing works
“The positive impact of perceived expertise, transparency, and entertainment on purchase intentions is consistent with Liu (2023) and Deng et al. (2022), who highlighted the efficiency of AI in content generation and engagement with influencer-endorsed content.”
BackgroundSketch2Terrain: AI-Driven Real-Time Terrain Sketch Mapping in Augmented Reality
Xiao, T., Chen, Y., Zhong, S., et al. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713467 · Cited by 7 · see citing works
“With the recent rapid advancement in deep learning, generative AI started to show its capacity in 3D modeling domain [49].”
Understanding User Perceptions and the Role of AI Image Generators in Image Creation Workflows
Han, S.-J., & Fussell, S. R. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713227 · Cited by 5 · see citing works
“Previous research has attempted to address this issue by examining prompting and interaction [39, 52], uncovering the underlying mechanisms of AI systems [49], improving prompting interfaces [17, 24, 77, 81], and expanding input conditions [42, 48, 78].”
Generative AI for multimodal content: a survey with empirical and experimental evaluations
Taha, K. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11525-6 · Cited by 4 · see citing works
Generative AI in Virtual Reality Communities: A Preliminary Analysis of the VRChat Discord Community
Zhang, H., Zha, S., Cai, J., Wohn, D. Y., & Carroll, J. M. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720120 · Cited by 3 · see citing works
“Its creative capabilities have drawn substantial attention from content creators in various fields [34, 44], art [6, 25, 48], education [13, 33, 45, 96], research [4, 49, 86, 94], and entertainment [39, 50, 78].”
Conceptual Implementation of a Digital Cultural Heritage Application using Generative AI
Schauer, S., & Simbeck, K. (2024) · doi:10.1145/3719236.3719242 · Cited by 2 · see citing works
“Generative AI efficiently produces multimodal content, including text, audio, images and animations [27], thereby enhancing human productivity and simplifying workflows [22, 28].”
Queiroz, F. (2025) · INMATERIAL Diseño Arte y Sociedad · doi:10.46516/inmaterial.v10.240 · Cited by 2 · see citing works
Xu, H., Kharrufa, A., Solaiman, E., & Vlachokyriakos, V. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791087
“GenAI has rapidly gained popularity in personal productivity and information processing tasks, with widespread application and discussed in content generation [27, 52, 55, 61], code programming [13, 23, 44, 67, 86], and task assistance [9, 18, 51, 85].”
Stepping Stones for Self-Learning
Hai-Jew, S. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-0074-9.ch005
Hai-Jew, S. (2024) · Advances in media, entertainment and the arts (AMEA) book series · doi:10.4018/979-8-3693-1950-5.ch009
Vaish, A., & Qamruddin, P. J. (2024) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.5.0524.1110
PMAT: An Approach of Multimodal Prompting for Robot Assembly Task
Yu, D., Fan, X., Chen, H., Li, Y., Zheng, D., & Li, H. (2024) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber63482.2024.10749643
AdvisorAI: Transforming Graphic Advertising with Generative AI-Enhanced Design Strategies
Wu, P., Xiao-mei, L., He, Z., & Fan, L. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-78531-3_32
Create3DHistory: Creating and Customizing Historical Timelines with AI-Generated Content
Xie, Y., Wang, Y., Li, Y., Chen, R., Hu, P., & Ji, C. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033575
Ye, Y., Rau, P. P., & Liang Ma, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-12798-3_12
AI-Driven Hyper-Personalization in Omnichannel Marketing Automation: A Conceptual Framework
de Oliveira, D. A., Costa, A. P. O., Coelho, D., Pereira, I., & Júnior, J. G. D. C. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-16284-7_15
Kim, J., Yu, M., Zhi, J., Milani, S., Cheng, J., Fan, X., Shen, H., & Forlizzi, J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788080
“Recent advances in GenAI have reshaped creative practices, demonstrating applicability across multiple stages of the creative process—from idea generation [3, 16, 30, 57] to image and video production [61, 77, 86].”
Xu, X., Tang, J., Xu, X., Huang, X., Liu, C., Sun, G., Chen, J., Hao, P., Zhang, J., & Wu, F. (2026) · Visual Informatics · doi:10.1016/j.visinf.2026.100328
Chen, W., Tang, C., & Guo, W. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2676758
Engineering design through dialogue: a method for analysing speech-based human-AI conversation
Gunn, K., Brisco, R., Holliman, A., Yang, E., & Macfie, R. (2026) · Proceedings of the Design Society · doi:10.1017/pds.2026.10589
“While recent research in generative AI has typically focused on the development and use of text-based and image-based AI systems (Liu, 2023; Tembine et al., 2025), recent advances in speech-capable interfaces have expanded the modalities through which designers can interact with AI (Rayan et al.,…”
Leveraging Multimodal Generative AI to Enhance Engagement and Systematic Learning in ICT Education
Rahaman, M. S., Morshed, A., & Kwan, P. (2026) · Australasian Computer Science Week Multiconference (ACSW) · doi:10.1145/3793811.3793817
“Recent advances in multimodal Generative AI offer new opportunities to address these limitations [6, 9].”
Designing AI-Based Slide Evaluation Support Systems
Meier, A., & Cordts, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29586-6_26
CreatureCreator: Co-Creating 3D Models with AI for Video Games via Sculpting and Drawing
Hesselbarth, L., Wenig, N., Ringe, R., Wald, I. Y., Hurrelbrink, L., Wagener, N., & Malaka, R. (2026) · Creativity and Cognition · doi:10.1145/3803784.3807572
“In AI-generation processes, us-ing additional input modalities can be less frustrating than plain conversational interaction [38, 45], and adding clay sculpting can support ideation and expression of ideas [21].”
- Authors
- Liu, V.
- Affiliations
- Columbia University (US)
- Corresponding author
- Liu, Vivian
- ORCID
- Liu, Vivian
- Venue
- Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-6
- OpenAlex
- W4366594418
- Semantic Scholar
- 42aea1fd3406e2b48e939770c77e6ab5f93afcb4
- Cited by
- 38
- References
- 23
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 15 · 2023: 2
- FWCI
- 11.11
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) (publishedVersion)
- Funders
- National Science Foundation (GRF DGE - 1644869)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Keywords
- text-to-image generation, multimodal prompts, generative AI, human-AI co-creation, creative workflows, prompt engineering, visual language, design exploration, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
