Delta: a tool for representing and comparing workflows
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Tutorials and sample workflows for complicated, feature-rich software packages are widely available online. As a result users must differentiate between workflows to choose the most suitable one for their task. We present Delta, an interactive workflow visualization and comparison tool that helps users identify the tradeoffs between workflows. We conducted an initial study to identify the set of attributes users attend to when comparing workflows, finding that they consider result quality, their knowledge of commands, and the efficiency of the workflow. We then designed Delta to surface these attributes at three granularities: a high-level, clustered view; an intermediate-level list view that contains workflow summaries; and a low-level detail view that allows users to compare two individual workflows. Finally, we conducted an evaluation of Delta on a small corpus of 30 workflows and found that the intermediate list view provided the best information density. We conclude with thoughts on how such a workflow comparison system could be scaled up to larger corpora in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearst, M. A. (2009) · doi:10.1017/cbo9781139644082 · Cited by 797
What are you looking for?: an eye-tracking study of information usage in web search
Cutrell, E., & Guan, Z. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240690 · Cited by 460 · cited 1×
“These results corroborate prior work on information seeking behavior via search engines [6, 9, 13].”
ResultDesigning with interactive example galleries
Lee, B., Srivastava, S., Kumar, R., Brafman, R., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753667 · Cited by 195 · cited 2×
“, [20]), or by how many commands have been used by the user.”
Background
Cited by
Supporting Novice to Expert Transitions in User Interfaces
Cockburn, A., Gutwin, C., Scarr, J., & Malacria, S. (2015) · ACM Computing Surveys · doi:10.1145/2659796 · Cited by 193
MixT: automatic generation of step-by-step mixed media tutorials
Chi, P.-Y., Ahn, S., Ren, A., Dontcheva, M., Li, W., & Hartmann, B. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380130 · Cited by 113
Self-citationCommunity enhanced tutorials: improving tutorials with multiple demonstrations
Lafreniere, B., Grossman, T., & Fitzmaurice, G. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466235 · Cited by 74
“The Delta system [19] allows users to explore and compare multiple workflows for accomplishing a task of interest.”
BackgroundSelf-citationTaggedComments: promoting and integrating user comments in online application tutorials
Bunt, A., Dubois, P., Lafreniere, B., Terry, M. A., & Cormack, D. T. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557118 · Cited by 19
“This kind of summary mechanism captures community response to the tutorial and could complement command-oriented approaches (e.g., [14]) for helping users to select between tutorials.”
BackgroundMethod“I Would Just Ask Someone”: Learning Feature-Rich Design Software in the Modern Workplace
Kiani, K., Chilana, P. K., Bunt, A., Grossman, T., & Fitzmaurice, G. (2020) · 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc50065.2020.9127288 · Cited by 19
“, [4–13]), usually the focus has been on individual learning scenarios, with little to no focus on software help-seeking that occurs in the workplace.”
BackgroundSelf-citation
Metadata
- Authors
- Kong, N., Grossman, T., Hartmann, B., Agrawala, M., & Fitzmaurice, G.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 1027-1036
- OpenAlex
- W2156517224
- Cited by
- 52
- References
- 3
- FWCI
- 4.79
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.