The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?
Open accessAbstract
Usability comprises the aspects effectiveness, efficiency, and satisfaction. The correlations between these aspects are not well understood for complex tasks. We present data from an experiment where 87 subjects solved 20 information retrieval tasks concerning programming problems. The correlation between efficiency, as indicated by task completion time, and effectiveness, as indicated by quality of solution, was negligible. Generally, the correlations among the usability aspects depend in a complex way on the application domain, the user's experience, and the use context. Going through three years of CHI Proceedings, we find that 11 out of 19 experimental studies involving complex tasks account for only one or two aspects of usability. When these studies make claims concerning overall usability, they rely on risky assumptions about correlations between usability aspects. Unless domain specific studies suggest otherwise, effectiveness, efficiency, and satisfaction should be considered independent aspect of usability and all be included in usability testing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lecture Notes in Computer Science 1205
(1999) · Industrial Robot: An International Journal · doi:10.1108/ir.1999.04926fae.001 · Cited by 38,662
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
(1993) · Cited by 9,879
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Henry, N. W., Cohen, J., & Cohen, P. (1977) · Contemporary Sociology · doi:10.2307/2064799 · Cited by 7,089
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-21512-1 · Cited by 5,504
Rasmussen, J. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313160 · Cited by 3,434
The keystroke-level model for user performance time with interactive systems
Card, S. K., Moran, T. P., & Newell, A. (1980) · Communications of the ACM · doi:10.1145/358886.358895 · Cited by 1,174
SUMI: the Software Usability Measurement Inventory
Kirakowski, J., & Corbett, M. (1993) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.1993.tb00076.x · Cited by 625
Measuring usability: preference vs. performance
Nielsen, J., & Levy, J. (1994) · Communications of the ACM · doi:10.1145/175276.175282 · Cited by 458
Measuring usability as quality of use
Bevan, N. (1995) · Software Quality Journal · doi:10.1007/bf00402715 · Cited by 452
Effects of awareness support on groupware usability
Gutwin, C., & Greenberg, S. (1998) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '98 · doi:10.1145/274644.274713 · Cited by 216
van Welie, M., van der Veer, G. C., & Eliëns, A. (1999) · Cited by 124
Evaluation measures for interactive information retrieval
Su, L. T. (1992) · Information Processing & Management · doi:10.1016/0306-4573(92)90007-m · Cited by 122
What can I say?: evaluating a spoken language interface to Email
Walker, M., Fromer, J. C., Fabbrizio, G. D., Mestel, C., & Hindle, D. (1998) · International Conference on Human Factors in Computing Systems · doi:10.1145/274644.274722 · Cited by 96
Browsing and querying in online documentation
Hertzum, M., & Frøkjær, E. (1996) · ACM Transactions on Computer-Human Interaction · doi:10.1145/230562.230570 · Cited by 83
Self-citationBailey, R. W. (1993) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129303700406 · Cited by 75
Intuition in software development
Naur, P. (1985) · Lecture notes in computer science · doi:10.1007/3-540-15199-0_5 · Cited by 40
(2003)
Cited by
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Eye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
Current practice in measuring usability: Challenges to usability studies and research
Hornbæk, K. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.06.002 · Cited by 1,123
Self-citationChallenges, Methodologies, and Issues in the Usability Testing of Mobile Applications
Zhang, D., & Adipat, B. (2005) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1803_3 · Cited by 613
Vlachogianni, P., & Tselios, N. (2022) · Journal of Research on Technology in Education · doi:10.1080/15391523.2020.1867938 · Cited by 386
Metadata
- Authors
- Frøkjær, E., Hertzum, M., & Hornbæk, K.
- Venue
- Proceedings of the SIGCHI conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2000-04
- Pages
- 345-352
- OpenAlex
- W2087271627
- Cited by
- 650
- References
- 18
- FWCI
- 5.38
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.