MixT: automatic generation of step-by-step mixed media tutorials
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
As software interfaces become more complicated, users rely on tutorials to learn, creating an increasing demand for effective tutorials. Existing tutorials, however, are limited in their presentation: Static step-by-step tutorials are easy to scan but hard to create and don't always give all of the necessary information for how to accomplish a step. In contrast, video tutorials provide very detailed information and are easy to create, but they are hard to scan as the video-player timeline does not give an overview of the entire task. We present MixT, which automatically generates mixed media tutorials that combine the strengths of these tutorial types. MixT tutorials include step-by-step text descriptions and images that are easy to scan and short videos for each step that provide additional context and detail as needed. We ground our design in a formative study that shows that mixed-media tutorials outperform both static and video tutorials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sikuli: using GUI screenshots for search and automation
Yeh, T., Chang, T.-H., & Miller, R. C. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622213 · Cited by 346 · cited 1×
“Methods that analyze user action traces [8,3,10] often capture application-level semantics about specific tools and their purpose, while techniques that analyze screen recordings [18,20,4] use computer vision to identify GUI interactions such as clicking on an icon or button.”
CommunityCommands: command recommendations for software applications
Matejka, J., Li, W., Grossman, T., & Fitzmaurice, G. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622214 · Cited by 125
Self-citationIP-QAT: in-product questions, answers, & tips
Matejka, J., Grossman, T., & Fitzmaurice, G. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047218 · Cited by 43
Berthouzoz, F., Li, W., Dontcheva, M., & Agrawala, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2019627.2019639 · Cited by 37 · cited 1×
“Grabler et al. presents a system that automatically creates tutorials from recorded demonstrations of application usage [3] and later learns the parameters for image editing operations and generates macros that takes into account the context of the current image [1].”
Self-citationShowMeHow: translating user interface instructions between applications
Ramesh, V., Hsu, C., Agrawala, M., & Hartmann, B. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047212 · Cited by 27
Self-citation
Cited by
Community enhanced tutorials: improving tutorials with multiple demonstrations
Lafreniere, B., Grossman, T., & Fitzmaurice, G. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466235 · Cited by 74
SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and Plot Summaries
Pavel, A., Goldman, D. B., Hartmann, B., & Agrawala, M. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807502 · Cited by 67
Self-citationYu, J. E., Parde, N., & Chattopadhyay, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581447 · Cited by 22
TaggedComments: promoting and integrating user comments in online application tutorials
Bunt, A., Dubois, P., Lafreniere, B., Terry, M. A., & Cormack, D. T. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557118 · Cited by 19
“'s system automatically generates text- and image-based tutorials through a combination of image-recognition techniques and author demonstration [8], whereas MixT adds short video demonstrations to tutorial instructions [2].”
BackgroundInvestigating the feasibility of extracting tool demonstrations from in-situ video content
Lafreniere, B., Grossman, T., Matejka, J., & Fitzmaurice, G. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557142 · Cited by 16
“While many learning techniques have been proposed, recent work has found animated demonstrations to be quite useful in the context of graphical user interfaces [6, 15, 22].”
BackgroundMethodInfluential
Metadata
- Authors
- Chi, P.-Y., Ahn, S., Ren, A., Hartmann, B., Dontcheva, M., & Li, W.
- Venue
- CHI '12 Extended Abstracts on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 1499-1504
- OpenAlex
- W2100808978
- Cited by
- 66
- References
- 5
- FWCI
- 8.55
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: MixT: automatic generation of step-by-step mixed media tutorials. https://app.cochat.ai/papers/10.1145/2212776.2223662
- The paper
- Chi, P.-Y., Ahn, S., Ren, A., Hartmann, B., Dontcheva, M., & Li, W. (2012). MixT: automatic generation of step-by-step mixed media tutorials. CHI '12 Extended Abstracts on Human Factors in Computing Systems. https://doi.org/10.1145/2212776.2223662
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.