Creative sketching partner: an analysis of human-AI co-creativity
Open accessThe DOI matches its Crossref record.
Abstract
The creative sketching partner (CSP) is a proof of concept intelligent interface to inspire designers while sketching in response to a specified design task. With this interactive system we are studying the effect of an AI model of visual and conceptual similarity for selecting the Al's sketch response as an inspiration to the current state of the user's sketch. Specifically, we are interested in the user's behavior and response to an AI partner when engaged in a design task. By developing deep learning models of the sketches from a large-scale dataset, the user can control the amount of visual and conceptual similarity of the AI response when requesting inspiration from the CSP. We conducted a study with 50 design students to examine the participants' interaction behavior and their self reports. The participants' behavior maps into clusters that are co-related with three types of design creativity: combinatorial, exploratory, and transformational. Our findings demonstrate that the tool can facilitate ideation and overcome design fixation. In addition, analysis suggests that inspiration related to conceptual similarity is more associated with transformational creativity and inspiration related to visual similarity occurs more frequently during the detailed stages of design and is more prevalent with combinatorial creativity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Rezwana, J., & Maher, M. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3519026 · Cited by 342
Self-citationRedefining Creativity in the Era of AI? Perspectives of Computer Scientists and New Media Artists
Wingström, R., Hautala, J., & Lundman, R. (2024) · Creativity Research Journal · doi:10.1080/10400419.2022.2107850 · Cited by 201
“When creativity is defined, it is often done via Boden’s (2009) criteria of novelty, surprise, and value (Canaan, Menzel, Togelius, & Nealen, 2018; Gioti, 2020) or via combination, exploration, or transformation (Karimi et al., 2020).”
BackgroundMethodInfluentialThe Effects of Generative AI on Design Fixation and Divergent Thinking
Wadinambiarachchi, S., Kelly, R. M., Pareek, S., Zhou, Q., & Velloso, E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642919 · Cited by 320
Large-scale Text-to-Image Generation Models for Visual Artists’ Creative Works
Ko, H.-K., Park, G., Jeon, H., Jo, J., Kim, J., & Seo, J. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584078 · Cited by 189
AI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition
Suh, M. (., Youngblom, E., Terry, M., & Cai, C. J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445219 · Cited by 138
“Human-AI co-creation has recently been investigated in domains such as drawing [18, 20, 42, 43, 59], music composition [54], creative writing [26, 37], design ideation [46, 51, 69], visual metaphors [11], video game content generation [28, 47], improvisation [38], public displays [52], and dance [53].”
BackgroundPerfection Not Required? Human-AI Partnerships in Code Translation
Weisz, J. D., Muller, M., Houde, S., Richards, J., Ross, S. I., Martinez, F., Agarwal, M., & Talamadupula, K. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450656 · Cited by 129
CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI
Choi, D., Hong, S., Park, J., Chung, J. J. Y., & Kim, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642794 · Cited by 124
The effect of AI-based inspiration on human design ideation
Kim, J., & Maher, M. L. (2023) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2023.2167124 · Cited by 114
Self-citationZhang, C., Yao, C., Wu, J., Lin, W., Liu, L., Yan, G., & Ying, F. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501914 · Cited by 114
Rezwana, J., & Maher, M. L. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532789 · Cited by 85
Self-citationUser Perspectives on Ethical Challenges in Human-AI Co-Creativity: A Design Fiction Study
Rezwana, J., & Maher, M. L. (2023) · Creativity and Cognition · doi:10.1145/3591196.3593364 · Cited by 60
Self-citationKim, T. S., Lee, Y., Chang, M., & Kim, J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606833 · Cited by 56
ContextCam: Bridging Context Awareness with Creative Human-AI Image Co-Creation
Fan, X., Wu, Z., Yu, C., Rao, F., Shi, W., & Tu, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642129 · Cited by 51
Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction
Ashktorab, Z., Dugan, C., Johnson, J., Pan, Q., Zhang, W., Kumaravel, S., & Campbell, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445256 · Cited by 50
“In human-AI collaborative settings (conversational agents [9], pedagogical systems [23], or co-creation tools [31, 32]), AI systems can be trained to react to human input rather than lead the collaboration and interaction.”
BackgroundRethinking designer agency: A case study of co-creation between designers and AI
Guo, X., Xiao, Y., Wang, J., & Ji, T. (2023) · IASDR 2023: Life-Changing Design · doi:10.21606/iasdr.2023.478 · Cited by 47
“2 designer's idea into a design concept (Karimi et al., 2020; Sun et al., 2013).”
BackgroundTsao, J., Liang, C. X., Nogues, C., & Wong, A. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02667-2 · Cited by 25
IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation
Shen, H., Shen, L., Wu, W., & Zhang, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713375 · Cited by 24
“For example, Karimi et al. [57] developed a creative sketching partner that recognized hand-drawn sketches and presented AI-generated variants with varying visual and conceptual similarity.”
DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
Tao, S., Liang, I., Peng, C., Wang, Z., Palani, S., & Dow, S. P. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714211 · Cited by 21
Evolving Coagency between Artists and AI in the Spatial Cocreative Process of Artmaking
Nordström, P., Lundman, R., & Hautala, J. (2023) · Annals of the American Association of Geographers · doi:10.1080/24694452.2023.2210647 · Cited by 17
Designing for Playfulness in Human-AI Authoring Tools
Liapis, A., Guckelsberger, C., Zhu, J., Harteveld, C., Kriglstein, S., Denisova, A., Gow, J., & Preuss, M. (2023) · Proceedings of the 18th International Conference on the Foundations of Digital Games · doi:10.1145/3582437.3587192 · Cited by 14
“a user changing their work based on an AI’s suggestion [8, 20, 24], the medium also impacts how playful a task is perceived: for instance, full-body interaction inspired by improvisational theatre [34] or dance [17] can foster playfulness merely due to the physical activity itself.”
Background
Metadata
- Authors
- Karimi, P., Rezwana, J., Siddiqui, S., Maher, M. L., & Dehbozorgi, N.
- Venue
- Proceedings of the 25th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2020-03-17
- Pages
- 221-230
- OpenAlex
- W3009706354
- Cited by
- 122
- References
- 0
- FWCI
- 22.67
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.