Evaluating web site accessibility: validating the WAI guidelines through usability testing with disabled users
The DOI matches its Crossref record.
Abstract
The purpose of the reported study has been to validate empirically the usefulness of using the WAI accessibility guidelines WCAG 1.0 as a heuristic for website accessibility. Through controlled usability tests of two websites with disabled users (N=7) and a control group (N=6) we found that only 27% of the identified website accessibility problems could have been identified through the use of WCAG. We conclude from this that in its current version, the application of WCAG alone is not sufficient to guarantee website accessibility. WCAG has a large potential for improvement, and our data point to some problem areas that we suggest should be included. We recommend that future versions of accessibility guidelines should be based on empirical data and validated empirically.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Guidelines are only half of the story: accessibility problems encountered by blind users on the web
Power, C., Freire, A., Petrie, H., & Swallow, D. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207736 · Cited by 327
Validating WCAG versions 1.0 and 2.0 through usability testing with disabled users
Rømen, D., & Svanæs, D. (2012) · Universal Access in the Information Society · doi:10.1007/s10209-011-0259-3 · Cited by 123
“In [18] the initial analysis of the data from the current study concerning WCAG 1.”
BackgroundSelf-citationGlobal Web Accessibility Analysis of National Government Portals and Ministry Web Sites
Goodwin, M., Susar, D., Nietzio, A., Snaprud, M., & Jensen, C. S. (2011) · Journal of Information Technology & Politics · doi:10.1080/19331681.2010.508011 · Cited by 74
“What may be perceived as a barrier for one person may not be a barrier for another, even if they have similar disabilities (Rømen & Svanæs, 2008).”
BackgroundEvaluating Web Accessibility of Educational Websites
Abu Shawar, B. (2015) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v10i4.4518 · Cited by 56
Methodological Standards in Accessibility Research on Motor Impairments: A Survey
Sarsenbayeva, Z., van Berkel, N., Velloso, E., Goncalves, J., & Kostakos, V. (2023) · ACM Computing Surveys · doi:10.1145/3543509 · Cited by 17
Metadata
- Authors
- Rømen, D., & Svanæs, D.
- Venue
- Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
- Publisher
- ACM
- Published
- 2008-10-20
- Pages
- 535-538
- OpenAlex
- W2056794921
- Cited by
- 36
- References
- 0
- FWCI
- 3.82
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating web site accessibility: validating the WAI guidelines through usability testing with disabled users. https://app.cochat.ai/papers/10.1145/1463160.1463238
- The paper
- Rømen, D., & Svanæs, D. (2008). Evaluating web site accessibility: validating the WAI guidelines through usability testing with disabled users. Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. https://doi.org/10.1145/1463160.1463238
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.