EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Storyboarding is an important ideation technique that uses sequential art to depict important scenarios of user experience. Existing data-driven support for storyboarding focuses on constructing user stories, but fail to address its benefit as a graphic narrative device. Instead, we propose to develop a data-driven design support tool that increases the expressiveness of user stories by facilitating sketching storyboards. To explore this, we focus on supporting the sketching of emotional expressions of characters in storyboards. In this paper, we present EmoG, an interactive system that generates sketches of characters with emotional expressions based on input strokes from the user. We evaluated EmoG with 21 participants in a controlled user study. The results showed that our tool has significantly better performance in usefulness, ease of use, and quality of results than the baseline system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · cited 1×
“These data driven creativity support tools focus on different parts of the creative process such as design ideation or the realization of the creative outcome [8].”
BackgroundOh, C., Song, J., Choi, J., Kim, S., Lee, S., & Suh, B. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174223 · Cited by 301 · cited 2×
“DualDraw [26] assists in human-AI co-creative drawing by duplicating, mimicking, and supplementing users’ sketches.”
Background(2006) · doi:10.1145/1142405.1142443 · Cited by 52
Research works printed but not linked: 39
- 2018. MakeGirlsMoe. (2018). https://make.girls.moe
- 10.4324/9780240820880 · doi:10.4324/9780240820880
- Nan Cao, Xin Yan, Yang Shi, and Chaoran Chen. 2019. AI-Sketcher: A Deep Generative Model for Producing High-Quality Sketches. The Thirty-Third AAAI Conference on Artificial Intelligence (2019), 2547--2554.
- 10.1109/ICSE.2019.00070 · DOI
- Hui Ding, Kumar Sricharan, and Rama Chellappa. 2018. ExprGan: Facial Expression Editing with Controllable Expression Intensity. In Thirty-Second AAAI Conference on Artificial Intelligence. 6781--6788.
- 10.1145/2185520.2185540 · DOI · Paper page
- Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems. Curran Associates, Inc., 2672--2680.
- Geonmo Gu, Seong Tae Kim, Kihyun Kim, Wissam J Baddar, and Yong Man Ro. 2017. Differential generative adversarial networks: Synthesizing non-linear facial variations with limited number of training data. arXiv preprint arXiv:1711.10267 (2017). · arXiv
- David Ha and Douglas Eck. 2017. A Neural Representation of Sketch Drawings. CoRR abs/1704.03477 (2017). http://arxiv.org/abs/1704.03477 · arXiv
- Mieke Haesen, Jan Meskens, Kris Luyten, and Karin Coninx. 2009. Supporting Multidisciplinary Teams and Early Design Stages Using Storyboards. In International Conference on Human-Computer Interaction. Springer, 616--623.
- 10.1145/2858036.2858079 · DOI
- 10.1145/3290605.3300334 · DOI
- 10.1609/aimag.v30i4.2274 · DOI · Paper page
- Jonas Jongejan, Henry Rowley, Takashi Kawashima, Jongmin Kim, and Nick Fox-Gieg. 2019. Quick, Draw! (2019). https://quickdraw.withgoogle.com
- 10.1145/3290605.3300863 · DOI · Paper page
- Stelios Krinidis, Ioan Buciu, and Ioannis Pitas. 2003. Facial expression analysis and synthesis: A survey. In 10th International Conference on Human-Computer Interaction (HCI 2003). Citeseer, 22--27.
- Ranjitha Kumar and Kristen Vaccaro. 2017. An Experimentation Engine for Data-driven Fashion Systems. In 2017 AAAI Spring Symposium Series. 389--394.
- 10.1145/1357054.1357259 · DOI · Paper page
- Andrew Loomis. Drawing the Head and Hands (illustrated, reprint ed.). Viking Press, 1956.
- Xiaojuan Ma, Jodi Forlizzi, and Steven Dow. 2012. Guidelines for depicting emotions in storyboard scenarios. In 8th International Design And Emotion Conference.
- 10.1109/TVCG.2016.2554113 · DOI
- Scott McCloud. 1993. Understanding comics: The invisible art. Northampton, Mass (1993).
- Scott McCloud. 2006. Making Comics: Storytelling Secrets of Comics, Manga and Graphic Novels. William Morrow and Company.
- Hans Pancherz, Verena Knapp, Christina Erbe, and Anja Melina Heiss. 2010. Divine Proportions in Attractive and Nonattractive Faces. World Journal of Orthodontics 11, 1 (2010), 27--36.
- 10.1007/978-3-030-01249-6_50 · DOI · Paper page
- Mary Beth Rosson and John M Carroll. 2009. Scenario-based Design. In International Conference on Human-Computer Interaction. CRC Press, 161--180.
- 10.1145/2998181.2998208 · DOI · Paper page
- Stephen Silver. 2017. The Silver Way: Techniques, Tips, and Tutorials for Effective Character Design. Design Studio Press.
- 10.1145/3197517.3201370 · DOI
- Frank Spillers. 2004. Emotion as a cognitive artifact and the design implications for products that are perceived as pleasurable. Experience Dynamics (2004).
- 10.1109/ITAIC.2019.8785893 · doi:10.1109/itaic.2019.8785893
- 10.1145/1142405.1142410 · DOI · Paper page
- Corrie Van der Lelie. 2006. The Value of Storyboards in the Product Design Process. Personal and Ubiquitous Computing 10, 2--3 (2006), 159--162.
- 10.1145/3206025.3206068 · DOI
- 10.1109/TPAMI.2008.222 · DOI · Paper page
- Tom White. 2016. Sampling Generative Networks. CoRR abs/1609.04468 (2016). http://arxiv.org/abs/1609.04468 · arXiv
- Raymond Yeh, Ziwei Liu, Dan B Goldman, and Aseem Agarwala. 2016. Semantic Facial Expression Editing Using Autoencoded Flow. CoRR abs/1611.09961 (2016). http://arxiv.org/abs/1611.09961 · arXiv
- Lvmin Zhang, Chengze Li, Tien-Tsin Wong, Yi Ji, and Chunping Liu. 2018. Two-stage Sketch Colorization. In SIGGRAPH Asia 2018 Technical Papers. ACM, 261:1--261:14.
- 10.1016/j.jvcir.2014.02.010 · DOI
Cited by
AI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition
Suh, M. (., Youngblom, E., Terry, M., & Cai, C. J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445219 · Cited by 138
“For example, prior studies demonstrated how an AI can collaborate with a person by generating inspirational sketches to assist with ideation [51, 59], writing text to continue a half-written story [12], or creating characters for storyboarding [69].”
BackgroundWhen and How to Use AI in the Design Process? Implications for Human-AI Design Collaboration
Lee, S.-Y., Law, M., & Hoffman, G. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2353451 · Cited by 97
Kim, T. S., Lee, Y., Chang, M., & Kim, J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606833 · Cited by 56
GANCollage: A GAN-Driven Digital Mood Board to Facilitate Ideation in Creativity Support
Wan, Q., & Lu, Z. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596072 · Cited by 46
Jiao, J., & Cao, X. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1450717 · Cited by 37
Metadata
- Authors
- Shi, Y., Cao, N., Ma, X., Chen, S., & Liu, P.
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-12
- OpenAlex
- W3032790983
- Cited by
- 48
- References
- 3
- FWCI
- 8.96
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Shanghai Summit Discipline in Design (DA19103)
- National Natural Science Foundation of China (61802283, 61602306)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding. https://app.cochat.ai/papers/10.1145/3313831.3376520
- The paper
- Shi, Y., Cao, N., Ma, X., Chen, S., & Liu, P. (2020). EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376520
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.