Web Accessibility Evaluation Methods: A Systematic Review
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
In this paper, we present the results of a systematic review involving the techniques or methods of web accessibility currently used, the domains that have been covered and the disabilities that were focused. The search strategy identified 343 studies, where only 20 were finally selected for the review. We found that automatic tools are the most frequent techniques used to evaluate web accessibility. In addition, most studies performed in the educational domain and the majority of studies do not focus on a special disability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In an SLR carried out in 2019 [19], on web accessibility evaluation methods, it was determined that the main methods used are: “1) automatic tools, 2) evaluation by experts and 3) user tests are the most widely used techniques according to the literature.””
From Accessibility of university websites worldwide: a systematic literature review (2023) · cites this paper as [19]
Citations
Cites
Exploring the relationship between web accessibility and user experience
Aizpurua, A., Harper, S., & Vigo, M. (2016) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2016.03.008 · Cited by 222
The role of accessibility in a universal web
Henry, S. L., Abou-Zahra, S., & Brewer, J. (2014) · Proceedings of the 11th Web for All Conference · doi:10.1145/2596695.2596719 · Cited by 134
Vila, T. D., González, M. E. A., & Darcy, S. (2017) · Disability and Rehabilitation · doi:10.1080/09638288.2017.1362709 · Cited by 125
Evaluation of the web accessibility of higher-education websites
Acosta-Vargas, P., Lujan-Mora, S., & Salvador-Ullauri, L. (2016) · 2016 15th International Conference on Information Technology Based Higher Education and Training (ITHET) · doi:10.1109/ithet.2016.7760703 · Cited by 52
Framework for Accessibility Evaluation of Hospital Websites
Acosta-Vargas, P., Acosta, T., & Luján‐Mora, S. (2018) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg.2018.8372368 · Cited by 52
Determinants of the Web accessibility of European banks
Martínez, A. B., Suárez, J. D. A., & García, J. (2013) · Information Processing & Management · doi:10.1016/j.ipm.2013.08.001 · Cited by 47
Toward a Combined Method for Evaluation of Web Accessibility
Acosta-Vargas, P., Luján‐Mora, S., Acosta, T., & Salvador-Ullauri, L. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-73450-7_57 · Cited by 47
Quality evaluation of government websites
Acosta-Vargas, P., Luján‐Mora, S., & Salvador-Ullauri, L. (2017) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg.2017.7962507 · Cited by 46
Salient beliefs influencing the intention to consider Web Accessibility
Vollenwyder, B., Iten, G. H., Brühlmann, F., Opwis, K., & Mekler, E. D. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.11.016 · Cited by 46
Beyond Web Content Accessibility Guidelines: Expert Accessibility Reviews
Calvo, R., Seyedarabi, F., & Savva, A. (2016) · Proceedings of the 7th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion · doi:10.1145/3019943.3019955 · Cited by 45
Documenting the accessibility of 100 US bank and finance websites
Wentz, B., Pham, D., Feaser, E., Smith, D., Smith, J., & Wilson, A. (2019) · Universal Access in the Information Society · doi:10.1007/s10209-018-0616-6 · Cited by 39
Advancements in web accessibility evaluation methods: how far are we?
Baazeem, I. S., & Al-Khalifa, H. S. (2015) · Proceedings of the 17th International Conference on Information Integration and Web-based Applications & Services · doi:10.1145/2837185.2843850 · Cited by 36
Evaluation of the Quality and Accessibility of Available Websites on Kidney Transplantation.
Valizadeh-Haghi, S., & Rahmatizadeh, S. (2018) · Urology journal./Urology jornal. · doi:10.22037/uj.v0i0.4252 · Cited by 24
GroupvsIndividual Web Accessibility Evaluations: Effects with Novice Evaluators
Brajnik, G., Vigo, M., Yeşilada, Y., & Harper, S. (2016) · Interacting with Computers · doi:10.1093/iwc/iww006 · Cited by 23
Crowdsourcing-Based Web Accessibility Evaluation with Golden Maximum Likelihood Inference
Song, S., Bu, J., Artmeier, A., Shi, K., Wang, Y., Yu, Z., & Wang, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274432 · Cited by 18
The accessibility of administrative processes
Coughlan, T., & Lister, K. (2018) · International Web for All Conference (W4A) · doi:10.1145/3192714.3192820 · Cited by 17
Katerattanakul, P., Hong, S.-G., Lee, H.-M., & Kam, H. (2017) · Universal Access in the Information Society · doi:10.1007/s10209-017-0532-1 · Cited by 16
Accessibility and Usability of Websites Intended for People with Disabilities: A Preliminary Study
Zitkus, E., Brigatto, A. C., Ferrari, A. L. M., Bonfim, G. H. C., Filho, I. F. P. D. C., Thaís dos, R. E. I. S., Mêdola, F. O., & Paschoarelli, L. C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40355-7_66 · Cited by 15
Using WCAG 2.0 and Heuristic Evaluation to Evaluate Accessibility in Educational Web Based Pages
Debevc, M., Kožuh, I., Hauptman, S., Klembas, A., Bele, J. L., & Holzinger, A. (2015) · Communications in computer and information science · doi:10.1007/978-3-319-22629-3_16 · Cited by 14
Towards Web Accessibility in Telerehabilitation Platforms
Acosta-Vargas, P., Rybarczyk, Y. P., Pérez-Medina, J.-L., González, M., Jiménes, K., Leconte, L., & Esparza, W. D. (2018) · IEEE Ecuador Technical Chapters Meeting (ETCM) · doi:10.1109/etcm.2018.8580272 · Cited by 14
Methodologies for the Design of ATM Interfaces: A Systematic Review
Aguirre, J., Moquillaza, A., & Paz, F. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-02053-8_39 · Cited by 13
Self-citationMethodology for Heuristic Evaluation of Web Accessibility Oriented to Types of Disabilities
Moreno, A. L. O., Morales, V. T., & Duque, N. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40250-5_9 · Cited by 12
Accesibilidad web en las Universidades del Ecuador. Análisis preliminar
Navarrete, R., & Luján‐Mora, S. (2014) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.33333/rp.v33i1.94 · Cited by 10
Desarrollo de sitios Web: la ley, el orden y los estándares
Valdés, F. F. (2007) · Serie bibliotecología y gestión de información · Cited by 6
Agangiba, M. A., & Kabanda, S. K. (2017) · Interdisciplinary Journal of Information Knowledge and Management · doi:10.28945/3853 · Cited by 6
Towards Web Accessibility in Telerehabilitation Platforms
Acosta-Vargas, P. (2018) · Data Archiving and Networked Services (DANS) · doi:10.17632/6622vyzbj5.2 · Cited by 6
Peruvian Public Universities and the Accessibility of Their Websites
Alfaro, F. D. B., & Zapata, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91806-8_46 · Cited by 5
An Approach to Make Software Testing for Users with Down Syndrome a little more Pleasant
Mendoza-González, A., Luna-García, H., Mendoza-González, R., Rusu, C., Gamboa-Rosales, H., Galván-Tejada, J. I., Arceo-Olague, J. G., Celaya-Padilla, J. M., & Solís-Robles, R. (2018) · International Conference on Human Computer Interaction (Interacción) · doi:10.1145/3233824.3233854 · Cited by 5
Method for Accessibility Assessment of Heading in Online Editors
Acosta, T., Luján‐Mora, S., & Acosta-Vargas, P. (2017) · International Conference on Education Technology and Computer · doi:10.1145/3175536.3175577 · Cited by 4
Multilevel Accessibility Evaluation of Institutional Websites in Tunisia
Gharbi, I., Bouraoui, A., & Saoud, N. B. B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94277-3_8 · Cited by 4
Research works printed but not linked: 1
- Nazar, H., Sarfraz, M.S., Shoaib, U.: Web accessibility evaluation of banking website in Pakistan. Int. J. Comput. Sci. Inf. Secur. 15(1), 642–650 (2017)
Cited by
Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review
Campoverde-Molina, M., Lujan-Mora, S., & Garcia, L. V. (2020) · IEEE Access · doi:10.1109/access.2020.2994288 · Cited by 94
“Therefore, web accessibility can be defined as a universal access to the Web [17].”
BackgroundAccessibility of university websites worldwide: a systematic literature review
Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-021-00825-z · Cited by 84
“In an SLR carried out in 2019 [19], on web accessibility evaluation methods, it was determined that the main methods used are: “1) automatic tools, 2) evaluation by experts and 3) user tests are the most widely used techniques according to the literature.””
MethodProcess Model for Continuous Testing of Web Accessibility
Campoverde‐Molina, M., Luján‐Mora, S., & Valverde, L. (2021) · IEEE Access · doi:10.1109/access.2021.3116100 · Cited by 32
Towards accessible website design through artificial intelligence: A systematic literature review
Vera-Amaro, G., & Rojano-Cáceres, J. R. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107821 · Cited by 25
Mohammadi, M. K., Esichaikul, V., & Mohammadi, A. (2022) · Universal Access in the Information Society · doi:10.1007/s10209-022-00896-6 · Cited by 21
Metadata
- Authors
- Nuñez, A., Moquillaza, A., & Paz, F.
- Affiliations
- Universidad San Ignacio de Loyola (PE)
- Pontificia Universidad Católica del Perú (PE)
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2019
- Pages
- 226-237
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W2959797393
- Cited by
- 50
- References
- 30
- Citations by year
- 2026: 5 · 2025: 15 · 2024: 5 · 2023: 8 · 2022: 4 · 2021: 9 · 2020: 4
- FWCI
- 8.17
- Type
- conference paper
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- Americanae (AECID Library) (submittedVersion, cc-by-nc-nd)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc-nd)
- Funders
- Pontificia Universidad Católica del Perú
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- web accessibility, disability, educational websites, accessibility evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.