CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Recent work demonstrated how we can design and use coding strips, a form of comic strips with corresponding code, to enhance teaching and learning in programming. However, creating coding strips is a creative, time-consuming process. Creators have to generate stories from code (code↦story) and design comics from stories (story↦comic). We contribute CodeToon, a comic authoring tool that facilitates this code-driven storytelling process with two mechanisms: (1) story ideation from code using metaphor and (2) automatic comic generation from the story. We conducted a two-part user study that evaluates the tool and the comics generated by participants to test whether CodeToon facilitates the authoring process and helps generate quality comics. Our results show that CodeToon helps users create accurate, informative, and useful coding strips in a significantly shorter time. Overall, this work contributes methods and design guidelines for code-driven storytelling and opens up opportunities for using art to support computer science education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 2×
“After the task phase, we administered three surveys: (1) poststudy survey with creativity support index (CSI) [10], (2) paired factor comparison (PFC) [10], and (3) system usability survey (SUS) [7].”
MethodInfluentialResnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
Quantifying the Creativity Support of Digital Tools through the Creativity Support Index
Cherry, E., & Latulipe, C. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2617588 · Cited by 498 · cited 3×
“After the task phase, we administered three surveys: (1) poststudy survey with creativity support index (CSI) [10], (2) paired factor comparison (PFC) [10], and (3) system usability survey (SUS) [7].”
Method
Research works printed but not linked: 36
- Shaaron Ainsworth . 2006. DeFT: A conceptual framework for considering learning with multiple representations. Learning and instruction 16, 3 ( 2006 ), 183–198. https://doi.org/10.1016/j.learninstruc.2006.03.001 10.1016/j.learninstruc.2006.03.001 Shaaron Ainsworth. 2006. DeFT: A conceptual framework for considering learning with multiple representations. Learning and instruction 16, 3 (2006), 183–198. https://doi.org/10.1016/j.learninstruc.2006.03.001 · DOI · Paper page
- Tiago Alves , Adrian McMichael , Ana Simões , Marco Vala , Ana Paiva , and Ruth Aylett . 2007 . Comics2D: Describing and creating comics from story-based applications with autonomous characters . Proceedings of CASA (2007). Tiago Alves, Adrian McMichael, Ana Simões, Marco Vala, Ana Paiva, and Ruth Aylett. 2007. Comics2D: Describing and creating comics from story-based applications with autonomous characters. Proceedings of CASA (2007).
- 10.1109/MCG.2017.33 · DOI
- 10.1145/3173574.3173612 · DOI
- Aaron Bangor Philip T Kortum and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human-Computer Interaction 24 6(2008) 574-594. https://doi.org/10.1080/10447310802205776 · DOI · Paper page
- 10.1037/a0013247 · DOI · Paper page
- 10.1145/2366145.2366160 · DOI
- 10.5555/1769938.1769957 · doi:10.5555/1769938.1769957
- Neil Cohn . 2015. How to analyze visual narratives: A tutorial in Visual Narrative Grammar. (2015) . http://visuallanguagelab.com/P/VNG_Tutorial.pdf Accessed: 2021-06-01. Neil Cohn. 2015. How to analyze visual narratives: A tutorial in Visual Narrative Grammar. (2015). http://visuallanguagelab.com/P/VNG_Tutorial.pdf Accessed: 2021-06-01.
- Emily R Fyfe and Mitchell J Nathan . 2018. Making “concreteness fading ” more concrete as a theory of instruction for promoting transfer. Educational Review ( 2018 ), 1–20. https://doi.org/10.1080/00131911.2018.1424116 10.1080/00131911.2018.1424116 Emily R Fyfe and Mitchell J Nathan. 2018. Making “concreteness fading” more concrete as a theory of instruction for promoting transfer. Educational Review (2018), 1–20. https://doi.org/10.1080/00131911.2018.1424116 · DOI
- Mirta Galesic and Michael Bosnjak . 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2 ( 2009 ), 349–360. https://doi.org/10.1093/poq/nfp031 10.1093/poq Mirta Galesic and Michael Bosnjak. 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2 (2009), 349–360. https://doi.org/10.1093/poq/nfp031 · DOI · Paper page
- Dedre Gentner . 1983 . Structure-mapping: A theoretical framework for analogy. Cognitive science 7, 2 (1983), 155–170. https://doi.org/10.1207/s15516709cog0702_3 10.1207/s15516709cog0702_3 Dedre Gentner. 1983. Structure-mapping: A theoretical framework for analogy. Cognitive science 7, 2 (1983), 155–170. https://doi.org/10.1207/s15516709cog0702_3 · doi:10.1207/s15516709cog0702_3 · Paper page
- Dedre Gentner . 1988. Metaphor as structure mapping: The relational shift. Child development ( 1988 ), 47–59. https://doi.org/10.2307/1130388 10.2307/1130388 Dedre Gentner. 1988. Metaphor as structure mapping: The relational shift. Child development (1988), 47–59. https://doi.org/10.2307/1130388 · doi:10.2307/1130388 · Paper page
- Philip J Guo . 2013. Online python tutor: embeddable web-based program visualization for cs education . In Proceeding of the 44th ACM technical symposium on Computer science education. 579–584. https://doi.org/10.1145/2445196.2445368 10.1145/2445196.2445368 Philip J Guo. 2013. Online python tutor: embeddable web-based program visualization for cs education. In Proceeding of the 44th ACM technical symposium on Computer science education. 579–584. https://doi.org/10.1145/2445196.2445368 · DOI · Paper page
- 10.1145/194313.214781 · DOI
- 10.1145/1873951.1874033 · DOI
- 10.1145/3411764.3445434 · DOI · Paper page
- 10.1145/1240624.1240844 · DOI · Paper page
- 10.1145/3290605.3300335 · DOI
- 10.1017/cts.2018.18 · DOI · Paper page
- 10.1145/237170.237260 · DOI · Paper page
- Tricia J Ngoon , Joy O Kim , and Scott Klemmer . 2021 . Shöwn: Adaptive Conceptual Guidance Aids Example Use in Creative Tasks. In Designing Interactive Systems Conference 2021. 1834 –1845. https://doi.org/10.1145/3461778.3462072 10.1145/3461778.3462072 Tricia J Ngoon, Joy O Kim, and Scott Klemmer. 2021. Shöwn: Adaptive Conceptual Guidance Aids Example Use in Creative Tasks. In Designing Interactive Systems Conference 2021. 1834–1845. https://doi.org/10.1145/3461778.3462072 · DOI
- 10.1145/3291279.3339445 · doi:10.1145/3291279.3339445
- 10.1109/VL/HCC50065.2020.9127251 · doi:10.1109/vl/hcc50065.2020.9127251
- Sangho Suh. 2022. Coding Strip: A Tool for Supporting Interplay within Abstraction Ladder for Computational Thinking. Ph.D. Dissertation. University of Waterloo. http://hdl.handle.net/10012/18318 Sangho Suh. 2022. Coding Strip: A Tool for Supporting Interplay within Abstraction Ladder for Computational Thinking. Ph.D. Dissertation. University of Waterloo. http://hdl.handle.net/10012/18318
- 10.1145/3490100.3516473 · DOI · Paper page
- Sangho Suh Sydney Lamorea Edith Law and Leah Zhang-Kennedy. 2022. PrivacyToon: Concept-driven Storytelling with Creativity Support for Privacy Concepts. (2022). https://doi.org/10.1145/3532106.3533557 10.1145/3532106.3533557 · DOI
- Sangho Suh Sydney Lamorea Edith Law and Leah Zhang-Kennedy. 2022. PrivacyToon: Concept-driven Storytelling with Creativity Support for Privacy Concepts. (2022). https://doi.org/10.1145/3532106.3533557 · DOI
- 10.1145/3408877.3432465 · DOI
- 10.1145/3392063.3394413 · DOI
- 10.1109/VL/HCC50065.2020.9127262 · DOI
- 10.1145/3300115.3309513 · doi:10.1145/3300115.3309513
- Bret Victor . 2011. Up and Down the Ladder of Abstraction . http://worrydream.com/LadderOfAbstraction/ Accessed: 2021-11-16. Bret Victor. 2011. Up and Down the Ladder of Abstraction. http://worrydream.com/LadderOfAbstraction/ Accessed: 2021-11-16.
- 10.1109/TVCG.2020.3030433 · DOI · Paper page
- 10.1109/TVCG.2021.3114849 · DOI
- Xin Yang , Zongliang Ma , Letian Yu , Ying Cao , Baocai Yin , Xiaopeng Wei , Qiang Zhang , and Rynson WH Lau . 2021 . Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation . ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17 , 2 (2021), 1 – 19 . https://doi.org/10.1145/3440053 10.1145/3440053 Xin Yang, Zongliang Ma, Letian Yu, Ying Cao, Baocai Yin, Xiaopeng Wei, Qiang Zhang, and Rynson WH Lau. 2021. Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17, 2 (2021), 1–19. https://doi.org/10.1145/3440053 · doi:10.1145/3440053
Cited by
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606756 · Cited by 151
Self-citationSensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models
Suh, S., Min, B., Palani, S., & Xia, H. (2023) · arXiv · doi:10.48550/arxiv.2305.11483 · Cited by 151
Self-citationSuh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148
Self-citationZhang, Z., Gao, J., Dhaliwal, R. S., & Li, T. J.-J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606800 · Cited by 108
How Does Automation Shape the Process of Narrative Visualization: A Survey of Tools
Chen, Q., Cao, S., Wang, J., & Cao, N. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3261320 · Cited by 71
“The Contextifier [33] provides an algorithm for selecting annotations that automatically creates a stock timeline graph and matches the appropriate annotation to the line graph by referring to the content in the news article.”
Method
Metadata
- Authors
- Suh, S., Zhao, J., & Law, E.
- Venue
- Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2022-10-28
- Pages
- 1-16
- OpenAlex
- W4293792253
- Cited by
- 40
- References
- 3
- FWCI
- 11.41
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling. https://app.cochat.ai/papers/10.1145/3526113.3545617
- The paper
- Suh, S., Zhao, J., & Law, E. (2022). CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling. Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3526113.3545617
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.