Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent
Open accessAbstract
This paper reports on the design and evaluation of a co-creative drawing partner called the Drawing Apprentice, which was designed to improvise and collaborate on abstract sketches with users in real time. The system qualifies as a new genre of creative technologies termed "casual creators" that are meant to creatively engage users and provide enjoyable creative experiences rather than necessarily helping users make a higher quality creative product. We introduce the conceptual framework of participatory sense-making and describe how it can help model and understand open-ended collaboration. We report the results of a user study comparing human-human collaboration to human-computer collaboration using the Drawing Apprentice system. Based on insights from the user study, we present a set of design recommendations for co-creative agents.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Design for Co-Creation provides greater specificity to generative AI's unique capabilities for human-AI co-creation, which has been examined extensively within HCI communities.
“Design for Co-Creation provides greater specificity to generative AI's unique capabilities for human-AI co-creation, which has been examined extensively within HCI communities (e.g., [34, 53, 77, 121, 129]).”
From Design Principles for Generative AI Applications (2024) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · see citing works
Boden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775 · see citing works
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,765 · see citing works
Participatory sense-making: An enactive approach to social cognition
De Jaegher, H., & Di Paolo, E. (2007) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-007-9076-9 · Cited by 1,640 · see citing works
Enactive intersubjectivity: Participatory sense-making and mutual incorporation
Fuchs, T. A. E., & Jaegher, H. D. (2009) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-009-9136-4 · Cited by 833 · see citing works
Infants with autism: an investigation of empathy, pretend play, joint attention, and imitation
Charman, T., Swettenham, J., Baron-Cohen, S., Cox, A., Baird, G., & Drew, A. (1997) · Developmental Psychology · doi:10.1037/0012-1649.33.5.781 · Cited by 813 · see citing works
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765 · see citing works
Proceedings of the International Computer Music Conference
Bilbao, S., & van Walstijn, M. (2005) · Cited by 723 · see citing works
(2010) · The MIT Press eBooks · doi:10.7551/mitpress/9780262014601.001.0001 · Cited by 589 · see citing works
Distributed creativity: How collective creations emerge from collaboration.
Sawyer, R. K., & DeZutter, S. L. (2009) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0013282 · Cited by 524 · see citing works
GenJam: A Genetic Algorithm for Generating Jazz Solos
Biles, J. A. (1994) · Cited by 451 · see citing works
A preliminary framework for description, analysis and comparison of creative systems
Wiggins, G. A. (2006) · Knowledge-Based Systems · doi:10.1016/j.knosys.2006.04.009 · Cited by 419 · see citing works
Computational Creativity: The Final Frontier?
Colton, S., & Wiggins, G. A. (2012) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-61499-098-7-21 · Cited by 408 · see citing works
Lubart, T. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.04.002 · Cited by 365 · see citing works
Expressive Processing: Digital Fictions, Computer Games, and Software Studies
(2010) · Choice Reviews Online · doi:10.5860/choice.47-4465 · Cited by 297 · see citing works
Promoting motivation with virtual agents and avatars: role of visual presence and appearance
Baylor, A. L. (2009) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2009.0148 · Cited by 275 · see citing works
Creativity Support Tools: Report From a U.S. National Science Foundation Sponsored Workshop
Shneiderman, B., Fischer, G., Czerwinski, M. P., Resnick, M., Myers, B. A., Candy, L., Edmonds, E. A., Eisenberg, M., Giaccardi, E., Hewett, T., et al. (2006) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc2002_1 · Cited by 274 · see citing works
Promoting Joint Attention in Toddlers with Autism: A Parent-Mediated Developmental Model
Schertz, H. H., & Odom, S. L. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0290-z · Cited by 242 · see citing works
Design of animated pedagogical agents—A look at their look
Gulz, A., & Haake, M. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.08.006 · Cited by 169 · see citing works
Searching for computational creativity
Wiggins, G. A. (2006) · New Generation Computing · doi:10.1007/bf03037332 · Cited by 154 · see citing works
Lee, Y. J., Zitnick, C. L., & Cohen, M. F. (2011) · ACM SIGGRAPH Conference Papers (SIGGRAPH) · doi:10.1145/1964921.1964922 · Cited by 152 · see citing works
Lee, Y. J., Zitnick, C. L., & Cohen, M. F. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964922 · Cited by 149 · see citing works
Dixon, D., Prasad, M., & Hammond, T. (2010) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1753326.1753459 · Cited by 106 · see citing works
Flagg, M., & Rehg, J. M. (2006) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1166253.1166290 · Cited by 91 · see citing works
An Enactive Model of Creativity for Computational Collaboration and Co-creation
Davis, N. M., Hsiao, C.-P., Popova, Y. B., & Magerko, B. S. (2015) · Springer series on cultural computing · doi:10.1007/978-1-4471-6681-8_7 · Cited by 87 · see citing works
Self-citationHoffman, G., & Weinberg, G. (2010) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1753846.1753925 · Cited by 84 · see citing works
We can work it out: an enactive look at cooperation
Fantasia, V., Jaegher, H. D., & Fasulo, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00874 · Cited by 67 · see citing works
Drawing Apprentice: An Enactive Co-Creative Agent for Artistic Collaboration
Davis, N., Hsiao, C.-P., Singh, K. Y., Li, L., Moningi, S., & Magerko, B. (2015) · Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition · doi:10.1145/2757226.2764555 · Cited by 67 · see citing works
Self-citationTowards a Unified Design Theory for Creativity Support Systems
Voigt, M., Niehaves, B., & Becker, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29863-9_13 · Cited by 37 · see citing works
A Knowledge-Based Framework for the Collaborative Improvisation of Scene Introductions
O’Neill, B., Piplica, A., Fuller, D., & Magerko, B. S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25289-1_10 · Cited by 35 · see citing works
Self-citationDigital Improvisational Theatre: Party Quirks
Magerko, B. S., DeLeon, C., & Dohogne, P. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23974-8_5 · Cited by 20 · see citing works
Self-citationViewpoints AI: Procedurally Representing and Reasoning about Gestures
Jacob, M., Zook, A., & Magerko, B. (2014) · doi:10.26503/dl.v2013i1.666 · Cited by 19 · see citing works
Self-citationEmploying Fuzzy Concept for Digital Improvisational Theatre
Magerko, B., Dohogne, P., & Deleon, C. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v7i1.12432 · Cited by 15 · see citing works
Self-citationAn Enactive Characterization of Pretend Play
Davis, N. M., Comerford, M., Jacob, M., Hsiao, C.-P., & Magerko, B. S. (2015) · Creativity and Cognition · doi:10.1145/2757226.2757254 · Cited by 14 · see citing works
Self-citationComputing harmony with PerLogicArt
Davis, N. M., Yi–Luen, E., Gupta, P., & Gupta, S. (2011) · Creativity and Cognition · doi:10.1145/2069618.2069650 · Cited by 13 · see citing works
Self-citationClosing the Cognitive Gap between Humans and Interactive Narrative Agents Using Shared Mental Models
Hodhod, R., & Magerko, B. S. (2016) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2856767.2856774 · Cited by 13 · see citing works
Self-citationComputer support for creativity
Edmonds, E. A., & Candy, L. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.04.001 · Cited by 12 · see citing works
Full-Body Gesture Interaction with Improvisational Narrative Agents
Piplica, A., DeLeon, C., & Magerko, B. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33197-8_63 · Cited by 9 · see citing works
Self-citationA Formal Architecture of Shared Mental Models for Computational Improvisational Agents
Hodhod, R., Piplica, A., & Magerko, B. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33197-8_45 · Cited by 9 · see citing works
Self-citationHodhod, R., Magerko, B., & Gawish, M. (2012) · International Journal of Information Retrieval Research · doi:10.4018/ijirr.2012070104 · Cited by 5 · see citing works
Self-citationPharaoh: Conceptual Blending of Cognitive Scripts for Computationally Creative Agents
Hodhod, R., & Magerko, B. (2014) · CSU ePress (Columbus State University) · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 8
- Compton, K. and Mateas, M. Casual Creators. Proceedings of the Sixth International Conference on Computational Creativity June, 228. 2015.
- Dixon, D., Prasad, M. and Hammond, T. iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. Proceedings of the 28th international conference on Human factors in computing systems, (2010), 897-906.
- Hodhod, R., Magerko, B. and Gawish, M. Pharaoh: Context-Based Structural Retrieval of Cognitive Scripts. International Journal of Information Retrieval Research (IJIRR), 2, 3 (2012), 58-71.
- Hoffman, G. and Weinberg, G. Shimon: an interactive improvisational robotic marimba player. CHI'10 Extended Abstracts on Human Factors in Computing Systems, (2010), 3097-3102.
- De Jaegher, H. and Di Paolo, E. Participatory sense- making. Phenomenology and the cognitive sciences, 6, 4 (2007), 485-507.
- Lee, Y. J., Zitnick, C. L. and Cohen, M. F. ShadowDraw: real-time user guidance for freehand drawing. ACM Transactions on Graphics (TOG), 27. 2011.
- Schneiderman, B. Accelerating Discovery and Innovation. Communications of the ACM 50, 12. 2007.
- Stewart, J. R., Gapenne, O. and Di Paolo, E. Enaction: Toward a new paradigm for cognitive science. MIT Press. 2010.
Cited by
Sorted by citations
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · see citing works
Rezwana, J., & Maher, M. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3519026 · Cited by 342 · see citing works
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., & Suh, B. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174223 · Cited by 301 · see citing works
Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
Louie, R., Coenen, A., Huang, C. Z., Terry, M., & Cai, C. J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376739 · Cited by 271 · see citing works
Design Principles for Generative AI Applications
Weisz, J. D., He, J., Muller, M., Hoefer, G., Miles, R., & Geyer, W. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642466 · Cited by 232 · see citing works
AI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition
Suh, M. (., Youngblom, E., Terry, M., & Cai, C. J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445219 · Cited by 138 · see citing works
It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through Sketch
Lin, Y., Guo, J., Chen, Y., Yao, C., & Ying, F. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376258 · Cited by 125 · see citing works
Biermann, O. C., Ma, N. F., & Yoon, D. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533506 · Cited by 116 · see citing works
Evaluating Creativity Support Tools in HCI Research
Remy, C., MacDonald Vermeulen, L., Frich, J., Biskjaer, M. M., & Dalsgaard, P. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395474 · Cited by 96 · see citing works
GenAICHI: Generative AI and HCI
Muller, M., Chilton, L. B., Kantosalo, A., Martin, C. P., & Walsh, G. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503719 · Cited by 101 · see citing works
DeepThInk: Designing and probing human-AI co-creation in digital art therapy
Du, X., An, P., Leung, J., Li, A., Chapman, L. E., & Zhao, J. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103139 · Cited by 95 · see citing works
Wan, Q., Hu, S., Zhang, Y., Wang, P., Wen, B., & Lu, Z. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637361 · Cited by 88 · see citing works
Rezwana, J., & Maher, M. L. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532789 · Cited by 85 · see citing works
Osone, H., Lu, J.-L., & Ochiai, Y. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3450391 · Cited by 74 · see citing works
Kim, T. S., Lee, Y., Chang, M., & Kim, J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606833 · Cited by 56 · see citing works
GANCollage: A GAN-Driven Digital Mood Board to Facilitate Ideation in Creativity Support
Wan, Q., & Lu, Z. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596072 · Cited by 46 · see citing works
Kamath, P., Morreale, F., Bagaskara, P. L., Wei, Y., & Nanayakkara, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642040 · Cited by 37 · see citing works
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36 · see citing works
Trajkova, M., Long, D., Deshpande, M., Knowlton, A., & Magerko, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642677 · Cited by 24 · see citing works
Self-citationQuantifying co-creative writing experiences
Kantosalo, A., & Riihiaho, S. (2019) · Digital Creativity · doi:10.1080/14626268.2019.1575243 · Cited by 19 · see citing works
Designing for Playfulness in Human-AI Authoring Tools
Liapis, A., Guckelsberger, C., Zhu, J., Harteveld, C., Kriglstein, S., Denisova, A., Gow, J., & Preuss, M. (2023) · Proceedings of the 18th International Conference on the Foundations of Digital Games · doi:10.1145/3582437.3587192 · Cited by 14 · see citing works
- Authors
- Davis, N., Hsiao, C.-P., Yashraj Singh, K., Li, L., & Magerko, B.
- Affiliations
- Georgia Institute of Technology (US)
- Georgia Institute of Technology, Atlanta, GA, USA
- Venue
- Proceedings of the 21st International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2016-03-07
- Pages
- 196-207
- OpenAlex
- W2333722819
- Cited by
- 138
- References
- 41
- Citations by year
- 2026: 22 · 2025: 21 · 2024: 19 · 2023: 19 · 2022: 14 · 2021: 13 · 2020: 8 · 2019: 9 · 2018: 6 · 2017: 6 · 2016: 1
- FWCI
- 4.99
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Funders
- National Science Foundation (1320520)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Keywords
- abstract drawing, participatory sense-making, human-computer collaboration, human-human collaboration, creative technologies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
