Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The Cognitive Walkthrough for the Web (CWW) is a partially automated usability evaluation method for identifying and repairing website navigation problems. Building on five earlier experiments [3,4], we first conducted two new experiments to create a sufficiently large dataset for multiple regression analysis. Then we devised automatable problem-identification rules and used multiple regression analysis on that large dataset to develop a new CWW formula for accurately predicting problem severity. We then conducted a third experiment to test the prediction formula and refined CWW against an independent dataset, resulting in full cross-validation of the formula. We conclude that CWW has high psychological validity, because CWW gives us (a) accurate measures of problem severity, (b) high success rates for repairs of identified problems (c) high hit rates and low false alarms for identifying problems, and (d) high rates of correct rejections and low rates of misses for identifying non-problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 16×
“While analyzing the distinctive characteristics of the particular user group, CWW evaluators choose the LSA semantic space whose corpus of documents best represents the background knowledge of the particular user group – the space built from documents that these users are likely to have read.”
BackgroundInfluentialNielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
Larson, K., & Czerwinski, M. (1998) · CHI 98 Conference Proceedings · doi:10.1145/274644.274649 · Cited by 276 · cited 1×
“CoLiDeS is part of a broad consensus among theorists and website usability experts [5,6,7,8,13, 20 ,21,23,24,25] that problem solving processes determine users’ information-seeking or search behaviors when exploring a new website or carrying out a novel task on a familiar website.”
Background
Cited by
Usability evaluation methods for the web: A systematic mapping study
Fernandez, A., Insfran, E., & Abrahão, S. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2011.02.007 · Cited by 497
Tuch, A. N., Roth, S. P., Hornbæk, K., Opwis, K., & Bargas-Avila, J. A. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2012.03.024 · Cited by 286
SNIF-ACT: A Cognitive Model of User Navigation on the World Wide Web
Fu, W.-T., & Pirolli, P. (2007) · Human–Computer Interaction · doi:10.1080/07370020701638806 · Cited by 276
Analysis of navigability of web applications for improving blind usability
Takagi, H., Saito, S., Fukuda, K., & Asakawa, C. (2007) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1279700.1279703 · Cited by 116
Li, Q., & Luximon, Y. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2050540 · Cited by 30
Metadata
- Authors
- Blackmon, M. H., Kitajima, M., & Polson, P. G.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2005-04-02
- Pages
- 31-40
- OpenAlex
- W2103981575
- Cited by
- 100
- References
- 4
- FWCI
- 7.29
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.