CoChat

EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding

Shi, Yang, Cao, Nan, Ma, Xiaojuan, Chen, Siji, Liu, Pei · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Cited by 48

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

Storyboarding is an important ideation technique that uses sequential art to depict important scenarios of user experience. Existing data-driven support for storyboarding focuses on constructing user stories, but fail to address its benefit as a graphic narrative device. Instead, we propose to develop a data-driven design support tool that increases the expressiveness of user stories by facilitating sketching storyboards. To explore this, we focus on supporting the sketching of emotional expressions of characters in storyboards. In this paper, we present EmoG, an interactive system that generates sketches of characters with emotional expressions based on input strokes from the user. We evaluated EmoG with 21 participants in a controlled user study. The results showed that our tool has significantly better performance in usefulness, ease of use, and quality of results than the baseline system.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3313831.3376520

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 39

  1. 2018. MakeGirlsMoe. (2018). https://make.girls.moe
  2. 10.4324/9780240820880 · doi:10.4324/9780240820880
  3. Nan Cao, Xin Yan, Yang Shi, and Chaoran Chen. 2019. AI-Sketcher: A Deep Generative Model for Producing High-Quality Sketches. The Thirty-Third AAAI Conference on Artificial Intelligence (2019), 2547--2554.
  4. 10.1109/ICSE.2019.00070 · DOI
  5. Hui Ding, Kumar Sricharan, and Rama Chellappa. 2018. ExprGan: Facial Expression Editing with Controllable Expression Intensity. In Thirty-Second AAAI Conference on Artificial Intelligence. 6781--6788.
  6. 10.1145/2185520.2185540 · DOI · Paper page
  7. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems. Curran Associates, Inc., 2672--2680.
  8. Geonmo Gu, Seong Tae Kim, Kihyun Kim, Wissam J Baddar, and Yong Man Ro. 2017. Differential generative adversarial networks: Synthesizing non-linear facial variations with limited number of training data. arXiv preprint arXiv:1711.10267 (2017). · arXiv
  9. David Ha and Douglas Eck. 2017. A Neural Representation of Sketch Drawings. CoRR abs/1704.03477 (2017). http://arxiv.org/abs/1704.03477 · arXiv
  10. Mieke Haesen, Jan Meskens, Kris Luyten, and Karin Coninx. 2009. Supporting Multidisciplinary Teams and Early Design Stages Using Storyboards. In International Conference on Human-Computer Interaction. Springer, 616--623.
  11. 10.1145/2858036.2858079 · DOI
  12. 10.1145/3290605.3300334 · DOI
  13. 10.1609/aimag.v30i4.2274 · DOI · Paper page
  14. Jonas Jongejan, Henry Rowley, Takashi Kawashima, Jongmin Kim, and Nick Fox-Gieg. 2019. Quick, Draw! (2019). https://quickdraw.withgoogle.com
  15. 10.1145/3290605.3300863 · DOI · Paper page
  16. Stelios Krinidis, Ioan Buciu, and Ioannis Pitas. 2003. Facial expression analysis and synthesis: A survey. In 10th International Conference on Human-Computer Interaction (HCI 2003). Citeseer, 22--27.
  17. Ranjitha Kumar and Kristen Vaccaro. 2017. An Experimentation Engine for Data-driven Fashion Systems. In 2017 AAAI Spring Symposium Series. 389--394.
  18. 10.1145/1357054.1357259 · DOI · Paper page
  19. Andrew Loomis. Drawing the Head and Hands (illustrated, reprint ed.). Viking Press, 1956.
  20. Xiaojuan Ma, Jodi Forlizzi, and Steven Dow. 2012. Guidelines for depicting emotions in storyboard scenarios. In 8th International Design And Emotion Conference.
  21. 10.1109/TVCG.2016.2554113 · DOI
  22. Scott McCloud. 1993. Understanding comics: The invisible art. Northampton, Mass (1993).
  23. Scott McCloud. 2006. Making Comics: Storytelling Secrets of Comics, Manga and Graphic Novels. William Morrow and Company.
  24. Hans Pancherz, Verena Knapp, Christina Erbe, and Anja Melina Heiss. 2010. Divine Proportions in Attractive and Nonattractive Faces. World Journal of Orthodontics 11, 1 (2010), 27--36.
  25. 10.1007/978-3-030-01249-6_50 · DOI · Paper page
  26. Mary Beth Rosson and John M Carroll. 2009. Scenario-based Design. In International Conference on Human-Computer Interaction. CRC Press, 161--180.
  27. 10.1145/2998181.2998208 · DOI · Paper page
  28. Stephen Silver. 2017. The Silver Way: Techniques, Tips, and Tutorials for Effective Character Design. Design Studio Press.
  29. 10.1145/3197517.3201370 · DOI
  30. Frank Spillers. 2004. Emotion as a cognitive artifact and the design implications for products that are perceived as pleasurable. Experience Dynamics (2004).
  31. 10.1109/ITAIC.2019.8785893 · doi:10.1109/itaic.2019.8785893
  32. 10.1145/1142405.1142410 · DOI · Paper page
  33. Corrie Van der Lelie. 2006. The Value of Storyboards in the Product Design Process. Personal and Ubiquitous Computing 10, 2--3 (2006), 159--162.
  34. 10.1145/3206025.3206068 · DOI
  35. 10.1109/TPAMI.2008.222 · DOI · Paper page
  36. Tom White. 2016. Sampling Generative Networks. CoRR abs/1609.04468 (2016). http://arxiv.org/abs/1609.04468 · arXiv
  37. Raymond Yeh, Ziwei Liu, Dan B Goldman, and Aseem Agarwala. 2016. Semantic Facial Expression Editing Using Autoencoded Flow. CoRR abs/1611.09961 (2016). http://arxiv.org/abs/1611.09961 · arXiv
  38. Lvmin Zhang, Chengze Li, Tien-Tsin Wong, Yi Ji, and Chunping Liu. 2018. Two-stage Sketch Colorization. In SIGGRAPH Asia 2018 Technical Papers. ACM, 261:1--261:14.
  39. 10.1016/j.jvcir.2014.02.010 · DOI

Cited by

See all 48

Metadata

Authors
Shi, Y., Cao, N., Ma, X., Chen, S., & Liu, P.
Venue
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2020-04-21
Pages
1-12
OpenAlex
W3032790983
Cited by
48
References
3
FWCI
8.96
Type
conference paper
Language
en
Open access
closed
Funders
  • Shanghai Summit Discipline in Design (DA19103)
  • National Natural Science Foundation of China (61802283, 61602306)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding. https://app.cochat.ai/papers/10.1145/3313831.3376520
The paper
Shi, Y., Cao, N., Ma, X., Chen, S., & Liu, P. (2020). EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376520

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.