CoChat

CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling

Open access
Suh, Sangho, Zhao, Jian, Law, Edith · 2022 · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
Cited by 40

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

Recent work demonstrated how we can design and use coding strips, a form of comic strips with corresponding code, to enhance teaching and learning in programming. However, creating coding strips is a creative, time-consuming process. Creators have to generate stories from code (code↦story) and design comics from stories (story↦comic). We contribute CodeToon, a comic authoring tool that facilitates this code-driven storytelling process with two mechanisms: (1) story ideation from code using metaphor and (2) automatic comic generation from the story. We conducted a two-part user study that evaluates the tool and the comics generated by participants to test whether CodeToon facilitates the authoring process and helps generate quality comics. Our results show that CodeToon helps users create accurate, informative, and useful coding strips in a significantly shorter time. Overall, this work contributes methods and design guidelines for code-driven storytelling and opens up opportunities for using art to support computer science education.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3526113.3545617

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 36

  1. Shaaron Ainsworth . 2006. DeFT: A conceptual framework for considering learning with multiple representations. Learning and instruction 16, 3 ( 2006 ), 183–198. https://doi.org/10.1016/j.learninstruc.2006.03.001 10.1016/j.learninstruc.2006.03.001 Shaaron Ainsworth. 2006. DeFT: A conceptual framework for considering learning with multiple representations. Learning and instruction 16, 3 (2006), 183–198. https://doi.org/10.1016/j.learninstruc.2006.03.001 · DOI · Paper page
  2. Tiago Alves , Adrian McMichael , Ana Simões , Marco Vala , Ana Paiva , and Ruth Aylett . 2007 . Comics2D: Describing and creating comics from story-based applications with autonomous characters . Proceedings of CASA (2007). Tiago Alves, Adrian McMichael, Ana Simões, Marco Vala, Ana Paiva, and Ruth Aylett. 2007. Comics2D: Describing and creating comics from story-based applications with autonomous characters. Proceedings of CASA (2007).
  3. 10.1109/MCG.2017.33 · DOI
  4. 10.1145/3173574.3173612 · DOI
  5. Aaron Bangor Philip T Kortum and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human-Computer Interaction 24 6(2008) 574-594. https://doi.org/10.1080/10447310802205776 · DOI · Paper page
  6. 10.1037/a0013247 · DOI · Paper page
  7. 10.1145/2366145.2366160 · DOI
  8. 10.5555/1769938.1769957 · doi:10.5555/1769938.1769957
  9. Neil Cohn . 2015. How to analyze visual narratives: A tutorial in Visual Narrative Grammar. (2015) . http://visuallanguagelab.com/P/VNG_Tutorial.pdf Accessed: 2021-06-01. Neil Cohn. 2015. How to analyze visual narratives: A tutorial in Visual Narrative Grammar. (2015). http://visuallanguagelab.com/P/VNG_Tutorial.pdf Accessed: 2021-06-01.
  10. Emily R Fyfe and Mitchell J Nathan . 2018. Making “concreteness fading ” more concrete as a theory of instruction for promoting transfer. Educational Review ( 2018 ), 1–20. https://doi.org/10.1080/00131911.2018.1424116 10.1080/00131911.2018.1424116 Emily R Fyfe and Mitchell J Nathan. 2018. Making “concreteness fading” more concrete as a theory of instruction for promoting transfer. Educational Review (2018), 1–20. https://doi.org/10.1080/00131911.2018.1424116 · DOI
  11. Mirta Galesic and Michael Bosnjak . 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2 ( 2009 ), 349–360. https://doi.org/10.1093/poq/nfp031 10.1093/poq Mirta Galesic and Michael Bosnjak. 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2 (2009), 349–360. https://doi.org/10.1093/poq/nfp031 · DOI · Paper page
  12. Dedre Gentner . 1983 . Structure-mapping: A theoretical framework for analogy. Cognitive science 7, 2 (1983), 155–170. https://doi.org/10.1207/s15516709cog0702_3 10.1207/s15516709cog0702_3 Dedre Gentner. 1983. Structure-mapping: A theoretical framework for analogy. Cognitive science 7, 2 (1983), 155–170. https://doi.org/10.1207/s15516709cog0702_3 · doi:10.1207/s15516709cog0702_3 · Paper page
  13. Dedre Gentner . 1988. Metaphor as structure mapping: The relational shift. Child development ( 1988 ), 47–59. https://doi.org/10.2307/1130388 10.2307/1130388 Dedre Gentner. 1988. Metaphor as structure mapping: The relational shift. Child development (1988), 47–59. https://doi.org/10.2307/1130388 · doi:10.2307/1130388 · Paper page
  14. Philip J Guo . 2013. Online python tutor: embeddable web-based program visualization for cs education . In Proceeding of the 44th ACM technical symposium on Computer science education. 579–584. https://doi.org/10.1145/2445196.2445368 10.1145/2445196.2445368 Philip J Guo. 2013. Online python tutor: embeddable web-based program visualization for cs education. In Proceeding of the 44th ACM technical symposium on Computer science education. 579–584. https://doi.org/10.1145/2445196.2445368 · DOI · Paper page
  15. 10.1145/194313.214781 · DOI
  16. 10.1145/1873951.1874033 · DOI
  17. 10.1145/3411764.3445434 · DOI · Paper page
  18. 10.1145/1240624.1240844 · DOI · Paper page
  19. 10.1145/3290605.3300335 · DOI
  20. 10.1017/cts.2018.18 · DOI · Paper page
  21. 10.1145/237170.237260 · DOI · Paper page
  22. Tricia J Ngoon , Joy O Kim , and Scott Klemmer . 2021 . Shöwn: Adaptive Conceptual Guidance Aids Example Use in Creative Tasks. In Designing Interactive Systems Conference 2021. 1834 –1845. https://doi.org/10.1145/3461778.3462072 10.1145/3461778.3462072 Tricia J Ngoon, Joy O Kim, and Scott Klemmer. 2021. Shöwn: Adaptive Conceptual Guidance Aids Example Use in Creative Tasks. In Designing Interactive Systems Conference 2021. 1834–1845. https://doi.org/10.1145/3461778.3462072 · DOI
  23. 10.1145/3291279.3339445 · doi:10.1145/3291279.3339445
  24. 10.1109/VL/HCC50065.2020.9127251 · doi:10.1109/vl/hcc50065.2020.9127251
  25. Sangho Suh. 2022. Coding Strip: A Tool for Supporting Interplay within Abstraction Ladder for Computational Thinking. Ph.D. Dissertation. University of Waterloo. http://hdl.handle.net/10012/18318 Sangho Suh. 2022. Coding Strip: A Tool for Supporting Interplay within Abstraction Ladder for Computational Thinking. Ph.D. Dissertation. University of Waterloo. http://hdl.handle.net/10012/18318
  26. 10.1145/3490100.3516473 · DOI · Paper page
  27. Sangho Suh Sydney Lamorea Edith Law and Leah Zhang-Kennedy. 2022. PrivacyToon: Concept-driven Storytelling with Creativity Support for Privacy Concepts. (2022). https://doi.org/10.1145/3532106.3533557 10.1145/3532106.3533557 · DOI
  28. Sangho Suh Sydney Lamorea Edith Law and Leah Zhang-Kennedy. 2022. PrivacyToon: Concept-driven Storytelling with Creativity Support for Privacy Concepts. (2022). https://doi.org/10.1145/3532106.3533557 · DOI
  29. 10.1145/3408877.3432465 · DOI
  30. 10.1145/3392063.3394413 · DOI
  31. 10.1109/VL/HCC50065.2020.9127262 · DOI
  32. 10.1145/3300115.3309513 · doi:10.1145/3300115.3309513
  33. Bret Victor . 2011. Up and Down the Ladder of Abstraction . http://worrydream.com/LadderOfAbstraction/ Accessed: 2021-11-16. Bret Victor. 2011. Up and Down the Ladder of Abstraction. http://worrydream.com/LadderOfAbstraction/ Accessed: 2021-11-16.
  34. 10.1109/TVCG.2020.3030433 · DOI · Paper page
  35. 10.1109/TVCG.2021.3114849 · DOI
  36. Xin Yang , Zongliang Ma , Letian Yu , Ying Cao , Baocai Yin , Xiaopeng Wei , Qiang Zhang , and Rynson WH Lau . 2021 . Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation . ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17 , 2 (2021), 1 – 19 . https://doi.org/10.1145/3440053 10.1145/3440053 Xin Yang, Zongliang Ma, Letian Yu, Ying Cao, Baocai Yin, Xiaopeng Wei, Qiang Zhang, and Rynson WH Lau. 2021. Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17, 2 (2021), 1–19. https://doi.org/10.1145/3440053 · doi:10.1145/3440053

Cited by

See all 40

Metadata

Authors
Suh, S., Zhao, J., & Law, E.
Venue
Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
Publisher
ACM
Published
2022-10-28
Pages
1-16
OpenAlex
W4293792253
Cited by
40
References
3
FWCI
11.41
Type
conference paper
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling. https://app.cochat.ai/papers/10.1145/3526113.3545617
The paper
Suh, S., Zhao, J., & Law, E. (2022). CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling. Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3526113.3545617

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.