CommunityCommands: command recommendations for software applications
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
We explore the use of modern recommender system technology to address the problem of learning software applications. Before describing our new command recommender system, we first define relevant design considerations. We then discuss a 3 month user study we conducted with professional users to evaluate our algorithms which generated customized recommendations for each user. Analysis shows that our item-based collaborative filtering algorithm generates 2.1 times as many good suggestions as existing techniques. In addition we present a prototype user interface to ambiently present command recommendations to users, which has received promising initial user feedback.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“log studies have shown surprisingly limited command vocabularies among experienced users [Matejka et al. 2009]”
From Supporting Novice to Expert Transitions in User Interfaces (2015) · cites this paper as Matejka et al. 2009
In the citing paper
“Analyses of functionally rich interfaces have shown that even experienced users typically use only a small subset of available functions [Draper 1984;Matejka et al. 2009].”
From Supporting Novice to Expert Transitions in User Interfaces (2015) · cites this paper as Matejka et al. 2009
In the citing paper
“and recent analyses of AutoCAD have shown that command vocabularies are typically approximately 30-40 among the almost 1,000 available [Matejka et al. 2009;Li et al. 2011]”
From Supporting Novice to Expert Transitions in User Interfaces (2015) · cites this paper as Matejka et al. 2009
Citations
Cites
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,389
Adomavicius, G., & Tuzhilin, A. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.99 · Cited by 10,310
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,587
Amazon.com recommendations: item-to-item collaborative filtering
Linden, G., Smith, B., & York, J. (2003) · IEEE Internet Computing · doi:10.1109/mic.2003.1167344 · Cited by 5,403
GroupLens: an open architecture for collaborative filtering of netnews
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., & Riedl, J. (1994) · Proceedings of the 1994 ACM conference on Computer supported cooperative work - CSCW '94 · doi:10.1145/192844.192905 · Cited by 5,058
A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVAL
SPARCK JONES, K. (1972) · Journal of Documentation · doi:10.1108/eb026526 · Cited by 4,505
Social information filtering: algorithms for automating “word of mouth”
Shardanand, U., & Maes, P. (1995) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95 · doi:10.1145/223904.223931 · Cited by 2,823
Designing the user interface strategies for effective human-computer interaction
Shneiderman, B. (1987) · ACM SIGBIO Newsletter · doi:10.1145/25065.950626 · Cited by 2,798
Direct Manipulation: A Step Beyond Programming Languages
Shneiderman (1983) · Computer · doi:10.1109/mc.1983.1654471 · Cited by 1,939 · cited 1×
“An inherent challenge with such systems is a user’s awareness [14, 39] of the functionality which is relevant to their specific goals and needs.”
BackgroundAnalysis of recommendation algorithms for e-commerce
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2000) · Proceedings of the 2nd ACM conference on Electronic commerce · doi:10.1145/352871.352887 · Cited by 1,827
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
Recommending and evaluating choices in a virtual community of use
Hill, W., Stead, L., Rosenstein, M., & Furnas, G. (1995) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95 · doi:10.1145/223904.223929 · Cited by 1,129
User Modeling in Human–Computer Interaction
Fischer, G. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011145532042 · Cited by 732
Claypool, M., Le, P., Wased, M., & Brown, D. (2001) · Proceedings of the 6th international conference on Intelligent user interfaces · doi:10.1145/359784.359836 · Cited by 666
MovieLens unplugged: experiences with an occasionally connected recommender system
Miller, B. N., Albert, I., Lam, S. K., Konstan, J. A., & Riedl, J. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604094 · Cited by 508
A statistical interpretation of term specificity and its application in retrieval
Spärck Jones, K. (2004) · Journal of Documentation · doi:10.1108/00220410410560573 · Cited by 500
Usability Meanings and Interpretations in ISO Standards
Abran, A., Khelifi, A., Suryn, W., & Seffah, A. (2003) · Software Quality Journal · doi:10.1023/a:1025869312943 · Cited by 451
Predicting human interruptibility with sensors
Fogarty, J., Hudson, S. E., Atkeson, C. G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J. C., & Yang, J. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1057237.1057243 · Cited by 344
(2001) · Cited by 341
A survey of software learnability: metrics, methodologies and guidelines
Grossman, T., Fitzmaurice, G., & Attar, R. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518803 · Cited by 322
Self-citation(2000) · Cited by 192
Predicting Sequences of User Actions
Davison, B. D., & Hirsh, H. (1998) · Cited by 181
A personalized English learning recommender system for ESL students
Hsu, M.-H. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.10.004 · Cited by 158
A suggestive interface for 3D drawing
Igarashi, Y., & Hughes, J. F. (2001) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/502348.502379 · Cited by 157
A personal learning apprentice
Dent, L., Boticario, J. G., McDermott, J. P., Mitchell, T. M., & Zabowski, D. (1992) · Cited by 156
Social Navigation Support in a Course Recommendation System
Farzan, R., & Brusilovsky, P. L. (2006) · Lecture notes in computer science · doi:10.1007/11768012_11 · Cited by 150
Adaptive systems: A solution to usability problems
Benyon, D. (1993) · User Modeling and User-Adapted Interaction · doi:10.1007/bf01099425 · Cited by 139
Predictability and accuracy in adaptive user interfaces
Gajos, K. Z., Everitt, K., Tan, D. S., Czerwinski, M., & Weld, D. S. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357252 · Cited by 138
Dynamic versus static menus: an exploratory comparison
Mitchell, J., & Shneiderman, B. (1989) · ACM SIGCHI Bulletin · doi:10.1145/67243.67247 · Cited by 120
An adaptive user interface based on personalized learning
Liu, J., Wong, C. K., & Hui, K. K. (2003) · IEEE Intelligent Systems · doi:10.1109/mis.2003.1193657 · Cited by 114
A hybrid learning system for recognizing user tasks from desktop activities and email messages
Shen, J., Li, L., Dietterich, T. G., & Herlocker, J. L. (2006) · Proceedings of the 11th international conference on Intelligent user interfaces · doi:10.1145/1111449.1111473 · Cited by 109
Introduction: design and evaluation of notification user interfaces
McCrickard, D. S., Czerwinski, M. P., & Bartram, L. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00025-9 · Cited by 99
Don't look stupid: avoiding pitfalls when recommending research papers
McNee, S. M., Kapoor, N., & Konstan, J. A. (2006) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1180875.1180903 · Cited by 95
Studying the evolution and enhancement of software features
Hsi, & Potts (2000) · Proceedings International Conference on Software Maintenance ICSM-94 · doi:10.1109/icsm.2000.883033 · Cited by 90
(2000) · Cited by 89
Linton, F. N., & Schaefer, H.-P. (2000) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1026521931194 · Cited by 88
Usability trade-offs for adaptive user interfaces: ease of use and learnability
Paymans, T. F., Lindenberg, J., & Neerincx, M. (2004) · Proceedings of the 9th international conference on Intelligent user interfaces · doi:10.1145/964442.964512 · Cited by 70
A suggestive interface for 3D drawing
Igarashi, Y., & Hughes, J. F. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1185657.1185771 · Cited by 68
A machine-learning apprentice for the completion of repetitive forms
Hermens, L. A., & Schlimmer, J. C. (1994) · IEEE Expert · doi:10.1109/64.295135 · Cited by 55
A field evaluation of an adaptable two-interface design for feature-rich software
McGrenere, J., Baecker, R. M., & Booth, K. S. (2007) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1229855.1229858 · Cited by 52
Apple guide: a case study in user-aided design of online help
Knabe, K. (1995) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/223355.223677 · Cited by 46
Owen, D. A. (1986) · CRC Press eBooks · doi:10.1201/b15703-17 · Cited by 40
On frequency-based menu-splitting algorithms
Witten, I. H., Cleary, J. G., & Greenberg, S. (1984) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(84)80063-2 · Cited by 36
An Empirical Study of the Effect of Agent Competence on User Performance and Perception
Xiao, J., Stasko, J., & Catrambone, R. (2004) · doi:10.1109/aamas.2004.61 · Cited by 32
Research works printed but not linked: 1
- 10.5555/1018409.1018745 · doi:10.5555/1018409.1018745
Cited by
Research-paper recommender systems: a literature survey
Beel, J., Gipp, B., Langer, S., & Breitinger, C. (2016) · International Journal on Digital Libraries · doi:10.1007/s00799-015-0156-0 · Cited by 823
What would other programmers do: suggesting solutions to error messages
Hartmann, B., MacDougall, D., Brandt, J., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753478 · Cited by 280
Brade, S., Wang, B., Sousa, M., Oore, S., & Grossman, T. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606725 · Cited by 198
Self-citationSupporting Novice to Expert Transitions in User Interfaces
Cockburn, A., Gutwin, C., Scarr, J., & Malacria, S. (2015) · ACM Computing Surveys · doi:10.1145/2659796 · Cited by 193
Beel, J., & Langer, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24592-8_12 · Cited by 153
Metadata
- Authors
- Matejka, J., Li, W., Grossman, T., & Fitzmaurice, G.
- Affiliations
- Autodesk Research, Toronto, ON, Canada
- Venue
- Proceedings of the 22nd annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2009-10-04
- Pages
- 193-202
- OpenAlex
- W2116436752
- Cited by
- 125
- References
- 45
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 3 · 2023: 2 · 2022: 5 · 2021: 4 · 2020: 8 · 2019: 10 · 2018: 6 · 2017: 13 · 2016: 11 · 2015: 14 · 2014: 9 · 2013: 9 · 2012: 8
- FWCI
- 5.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- item-based collaborative filtering, personalized recommendation, user study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.