CoChat

The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.

Comparing Web Accessibility Evaluation Tools and Evaluating the Accessibility of Webpages: Proposed Frameworks

Open access
Alsaeedi, Abdullah · 2020 · Information

Abstract

With the growth of e-services in the past two decades, the concept of web accessibility has been given attention to ensure that every individual can benefit from these services without any barriers. Web accessibility is considered one of the main factors that should be taken into consideration while developing webpages. Web Content Accessibility Guidelines 2.0 (WCAG 2.0) have been developed to guide web developers to ensure that web contents are accessible for all users, especially disabled users. Many automatic tools have been developed to check the compliance of websites with accessibility guidelines such as WCAG 2.0 and to help web developers and content creators with designing webpages without barriers for disabled people. Despite the popularity of accessibility evaluation tools in practice, there is no systematic way to compare the performance of web accessibility evaluators. This paper first presents two novel frameworks. The first one is proposed to compare the performance of web accessibility evaluation tools in detecting web accessibility issues based on WCAG 2.0. The second framework is utilized to evaluate webpages in meeting these guidelines. Six homepages of Saudi universities were chosen as case studies to substantiate the concept of the proposed frameworks. Furthermore, two popular web accessibility evaluators, Wave and SiteImprove, are selected to compare their performance. The outcomes of studies conducted using the first proposed framework showed that SiteImprove outperformed WAVE. According to the outcomes of the studies conducted, we can conclude that web administrators would benefit from the first framework in selecting an appropriate tool based on its performance to evaluate their websites based on accessibility criteria and guidelines. Moreover, the findings of the studies conducted using the second proposed framework showed that the homepage of Taibah University is more accessible than the homepages of other Saudi universities. Based on the findings of this study, the second framework can be used by web administrators and developers to measure the accessibility of their websites. This paper also discusses the most common accessibility issues reported by WAVE and SiteImprove.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/info11010040

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 3 . Figure 3. Coverage error ratio computed for six universities' homepages.
Figure 3 . Figure 3. Coverage error ratio computed for six universities' homepages.CC-BY · From the PDF
Figure 4 . Figure 4. Web accessibility accuracy computed for six universities homepages.
Figure 4 . Figure 4. Web accessibility accuracy computed for six universities homepages.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 3

  1. Lundqvist, S., and Ström, J. (2018, September 25). Web Accessibility in E-Learning: Identifying And Solving Accessibility Issues for Wcag 2.0 Conformance in an E-Learning Application. Student Thesis. Available online: http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-148913.
  2. Khan, 2010, Effectiveness of accessibility and usability of government websites in Saudi Arabia, Can. J. Pure Appl. Sci., 4, 1127
  3. Cluster, W. (2008, January 9–11). Unified Web Evaluation Methodology (UWEM 10), 2006. Proceedings of the 11th International Conference (ICCHP 2008), Linz, Austria.

Cited by

See all 101

Metadata

Authors
Alsaeedi, A.
Affiliations
Taibah University (SA)
Corresponding author
Alsaeedi, Abdullah
Venue
Information
Publisher
MDPI AG
Published
2020-01-12
Volume
11
Issue
1
Pages
40
ISSN
2078-2489 (ISSN-L)
OpenAlex
W2999363798
Cited by
101
References
38
Citations by year
2026: 16 · 2025: 24 · 2024: 11 · 2023: 22 · 2022: 15 · 2021: 11 · 2020: 2
FWCI
22.48
Type
journal article
Language
en
Open access
Locations
  • Information (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Information Systems › Mobile and Web Applications
Keywords
web accessibility, accessibility evaluation tools, WCAG 2.0, tool performance comparison, waves, disabled users, accessibility compliance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.