Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Web accessibility means that people with some type of disability can make use of the Web in the same conditions as the rest of the people. When we talk about web accessibility, we refer to a web design and development that allows these people to perceive, understand, navigate and interact with the Web. Web accessibility also benefits other people, including elderly people whose abilities have declined as a result of age. The Web is an essential resource in human activity: education, employment, government, commerce, health, entertainment and many others benefit of the power of the Web. The aim of this systematic literature review is to analyze the empirical methods of evaluating accessibility to educational websites, disabilities and their errors described in a total of 25 selected studies. The results show that in 20 of the 25 papers, web accessibility was evaluated with automatic tools, in 2 papers it was evaluated with real users and in the other 3 papers with automatic tools, real users and experts. There is also evidence that all the educational websites analyzed in the papers need to correct errors. In conclusion, educational websites do not meet any version of the Web Content Accessibility Guidelines (WCAG) and their conformance levels. According to the results, the empirical evaluation methods used for web accessibility could be improved by adopting automatic evaluation tools for website construction and manual mechanisms with web accessibility experts. The challenge for educational institutions is to carry out web accessibility projects to comply with WCAG and other web accessibility standards and current laws of educational inclusion.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, an analysis of 25 selected studies of educational websites’ accessibility showed that none of the sites were flawless [40].”
From Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages (2024) · cites this paper as [40]
In the citing paper
“Both tools have been used for testing HEIs’ websites in previous studies. Correspondingly, both tools were mentioned among 25 selected studies on testing the accessibility of educational websites, and WAVE was one of the most popular tools [40].”
From Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages (2024) · cites this paper as [40]
In the citing paper
“Based on previous studies, the wide extent of insufficient colour contrast between the text and background (including text on images, buttons, and icons) was rather foreseeable [40, 46].”
From Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages (2024) · cites this paper as [40]
In the citing paper
“These were among the most common errors in previous studies (see [14, 36, 40]).”
From Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages (2024) · cites this paper as [40]
Citations
Cites
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
(2004) · Cited by 5,198
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Gusenbauer, M., & Haddaway, N. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1378 · Cited by 2,379 · cited 1×
“In a research in 2019, on the evaluation of the recovery qualities of Google Scholar, PubMed and 26 academic search systems, in their findings demonstrated that Google Scholar is inappropriate as a primary resource [33].”
BackgroundGarousi, V., Felderer, M., & Mäntylä, M. V. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.09.006 · Cited by 831
Using mapping studies as the basis for further research – A participant-observer case study
Kitchenham, B. A., Budgen, D., & Pearl Brereton, O. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.011 · Cited by 621
Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Zapata, B. C., Fernández-Alemán, J. L., Idri, A., & Toval, A. (2015) · Journal of Medical Systems · doi:10.1007/s10916-014-0182-2 · Cited by 585 · cited 1×
“A selection process is defined and carried out to study much of the most relevant literature in the evaluation of educational websites. a: RESEARCH QUESTIONS Ten research questions were defined in order to accomplish the goal of this SLR [31].”
MethodRethinking the accessibility of online higher education: A historical review
Lee, K. (2017) · The Internet and Higher Education · doi:10.1016/j.iheduc.2017.01.001 · Cited by 302 · cited 1×
“Based on the suggestions of some papers [20]–[23] [25] conducted a historical review of the accessibility of online higher education.”
BackgroundMin Max Normalization Based Data Perturbation Method for Privacy Protection
JAIN, Y. K., & BHANDARE, S. K. (2013) · International Journal of Computer and Communication Technology · doi:10.47893/ijcct.2013.1201 · Cited by 297 · cited 1×
“For this purpose [34], the minimum-maximum normalization was used, which preserves the relationship between the original data values.”
MethodWeb content accessibility guidelines: from 1.0 to 2.0
Termens, M., Ribera, M., Porras, M., Boldú, M., Sulé, A., & Paris, P. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526912 · Cited by 218
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
Ismail, A., & Kuppusamy, K. S. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.03.011 · Cited by 136 · cited 1×
“Papers [38]–[40], [43], [44], [46], [52] were evaluated with conformance level A; papers [45], [47], [48], [50], [53]–[55] with conformance level AA; papers [57], [58] with conformance levels A and AA; papers [36], [42], [56] with conformance levels A, AA and AA.”
BackgroundIntroduction to Web Accessibility
Strategies, D. E. (2019) · Cited by 133
A Systematic Analysis of Accessibility in Computing Education Research
Baker, C. M., El-Glaly, Y. N., & Shinohara, K. (2020) · Proceedings of the 51st ACM Technical Symposium on Computer Science Education · doi:10.1145/3328778.3366843 · Cited by 93 · cited 1×
“4) In 2020 C. M. Baker, Y. N. El-Glaly, and K. Shinohara [27], conducted research on SLR to identify common themes and methods covered in the computer education literature, with a particular focus on how the research seeks to improve ways to integrate accessibility into the computer education…”
BackgroundAcosta-Vargas, P., Acosta, T., & Lujan-Mora, S. (2018) · IEEE Access · doi:10.1109/access.2018.2848978 · Cited by 92 · cited 2×
“It should be noted that the papers [52], [59] published by Ecuador refer to Universities websites in Latin America.”
BackgroundInformation Dashboards and Tailoring Capabilities - A Systematic Literature Review
Vázquez‐Ingelmo, A., García‐Peñalvo, F. J., & Therón, R. (2019) · IEEE Access · doi:10.1109/access.2019.2933472 · Cited by 88 · cited 1×
“The exclusion of Google Scholar from this review is justified by the need to consider only databases that index content of proven quality [67].”
BackgroundAbuaddous, H. Y., Zalisham, M., & Basir, N. (2016) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2016.071023 · Cited by 87 · cited 1×
“However, little or no experience with accessibility by website developers and a lack of accurate information on the best ways to quickly and easily identify accessibility issues using different accessibility evaluation methods [28] continues to limit access to websites by people with disabilities.”
BackgroundA Heuristic Method to Evaluate Web Accessibility for Users With Low Vision
Acosta-Vargas, P., Antonio Salvador-Ullauri, L., & Lujan-Mora, S. (2019) · IEEE Access · doi:10.1109/access.2019.2939068 · Cited by 78 · cited 3×
“It should be noted that the papers [52], [59] published by Ecuador refer to Universities websites in Latin America.”
BackgroundMethodInfluentialUniversities of the Kyrgyz Republic on the Web: accessibility and usability
İsmailova, R., & Kimsanova, G. (2016) · Universal Access in the Information Society · doi:10.1007/s10209-016-0481-0 · Cited by 61 · cited 1×
“Papers [49], [51] were evaluated with a level of conformance AA.”
Evaluating Web Accessibility of Educational Websites
Abu Shawar, B. (2015) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v10i4.4518 · Cited by 56 · cited 3×
“Paper [43] Equality Act 2010 (EQA).”
BackgroundAccessibility of academic library web sites in North America: Current status and trends (2002‐2012)
Comeaux, D., & Schmetzke, A. (2013) · Library Hi Tech · doi:10.1108/07378831311303903 · Cited by 55 · cited 1×
“Papers [35], [37], [41] do not specify the level of conformance.”
BackgroundImproving academic library website accessibility for people with disabilities
Billingham, L. (2014) · Library Management · doi:10.1108/lm-11-2013-0107 · Cited by 55 · cited 3×
“All the papers talk about disabilities, however, only papers [38]–[40], [42], [43], [45], [48], [49], [53], [54] specify in their research the disabilities with which they work, which are blind users or those with low vision, color blindness, users with cognitive or language limitations, or users…”
BackgroundWeb Accessibility Evaluation Methods: A Systematic Review
Nuñez, A., Moquillaza, A., & Paz, F. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-23535-2_17 · Cited by 50 · cited 1×
“Therefore, web accessibility can be defined as a universal access to the Web [17].”
BackgroundThe accessibility of Cyprus Islands’ Higher Education Institution Websites
İşeri, E. İ., Uyar, K., & İlhan, Ü. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.11.333 · Cited by 49 · cited 2×
“Paper [48], [50] Convention on the Rights of Persons with Disabilities (CRPD).”
BackgroundAccessibility analysis of higher education institution websites of Portugal
Ismail, A., Kuppusamy, K. S., & Paiva, S. (2020) · Universal Access in the Information Society · doi:10.1007/s10209-019-00653-2 · Cited by 43 · cited 2×
“Papers [38]–[40], [43], [44], [46], [52] were evaluated with conformance level A; papers [45], [47], [48], [50], [53]–[55] with conformance level AA; papers [57], [58] with conformance levels A and AA; papers [36], [42], [56] with conformance levels A, AA and AA.”
BackgroundMethodModeling and Management Big Data in Databases—A Systematic Literature Review
Martínez-Mosquera, D., Navarrete, R., & Luján‐Mora, S. (2020) · Sustainability · doi:10.3390/su12020634 · Cited by 43 · cited 1×
“Based on the suggestions of some papers [20]–[23] [25] conducted a historical review of the accessibility of online higher education.”
BackgroundAkram, M. I., & Bt, R. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.080642 · Cited by 42 · cited 2×
“Bt Sulaiman [26] conducted an SLR on research studies in Saudi Arabia and outside of Saudi Arabia to explore the web accessibility issue in the governmental and university websites.”
BackgroundEvaluation of Web content accessibility in an Israeli institution of higher education
Laufer Nir, H., & Rimmerman, A. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-018-0615-7 · Cited by 42 · cited 3×
“All the papers talk about disabilities, however, only papers [38]–[40], [42], [43], [45], [48], [49], [53], [54] specify in their research the disabilities with which they work, which are blind users or those with low vision, color blindness, users with cognitive or language limitations, or users…”
BackgroundA universal design resource for rich Internet applications based on design patterns
Fogli, D., Provenza, L. P., & Bernareggi, C. (2013) · Universal Access in the Information Society · doi:10.1007/s10209-013-0291-6 · Cited by 38
Accessibility of American University Special Education Departments’ Web sites
Ringlaben, R., Bray, M., & Packard, A. (2014) · Universal Access in the Information Society · doi:10.1007/s10209-013-0302-7 · Cited by 36 · cited 2×
“Papers [35], [37], [41] do not specify the level of conformance.”
BackgroundManaging Accessible Library Web Content
Lush, B. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0065-283020150000040017 · Cited by 33 · cited 3×
“Paper [45] did the evaluation with 3 automatic tools and one JAWS expert.”
BackgroundMethodBaule, S. M. (2019) · TechTrends · doi:10.1007/s11528-019-00421-2 · Cited by 30 · cited 2×
“Papers [38]–[40], [43], [44], [46], [52] were evaluated with conformance level A; papers [45], [47], [48], [50], [53]–[55] with conformance level AA; papers [57], [58] with conformance levels A and AA; papers [36], [42], [56] with conformance levels A, AA and AA.”
BackgroundAccessibility analysis of North Eastern India Region websites for persons with disabilities
Ismail, A., & Kuppusamy, K. S. (2016) · International Conference on Accessibility to Digital World (ICADW) · doi:10.1109/icadw.2016.7942530 · Cited by 28 · cited 1×
“INTRODUCTION The World Wide Web has emerged as the largest information repository and it is one of the most important communication media available [1].”
BackgroundUNIVERSITY WEBSITE ACCESSIBILITY FOR TOTALLY BLIND USERS
Hassouna, M. S., Sahari, N., & Ismail, A. (2017) · Journal of Information and Communication Technology · doi:10.32890/jict2017.16.1.8218 · Cited by 26 · cited 4×
“Paper [48] Figure 11 shows the number of real users, experts and the number of automatic tools that are repeated more than once in the selected papers to evaluate the accessibility of websites (see full information in Table 9, Appendix A).”
BackgroundInfluentialEvaluating Accessibility of Malaysian Public Universities Websites using AChecker and WAVEPreprint
Ahmi, A., & Mohamad, R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.3550314 · Cited by 24
Software Process Lines: A Systematic Literature Review
de Carvalho, D. D., Chagas, L. F., Lima, A. M., & Reis, C. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-13036-1_11 · Cited by 22
Assessment of Web Content Accessibility Levels in Spanish Official Online Education Environments
Roig-Vila, R., Ferrández, S., & Ferri-Miralles, I. (2014) · International Education Studies · doi:10.5539/ies.v7n6p31 · Cited by 19 · cited 2×
“All the papers talk about disabilities, however, only papers [38]–[40], [42], [43], [45], [48], [49], [53], [54] specify in their research the disabilities with which they work, which are blind users or those with low vision, color blindness,”
BackgroundAmin, A., Basri, S., Hassan, M. F., & Rehman, M. (2018) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-5281-1_47 · Cited by 18
A web accessibility assessment on the Texas public school system
May, S., & Zhu, Q. (2009) · Universal Access in the Information Society · doi:10.1007/s10209-009-0153-4 · Cited by 17 · cited 2×
“The disability laws used in the papers are listed below (see full information in Table 8, Appendix A): Paper [35] Americans with Disabilities Act (ADA), Section 504 of the Rehabilitation Act of 1973, US Public Law 105-220.”
BackgroundMethodUser Experience (UX) and the Web Accessibility Standards
Sohaib, O., Hussain, W., & Badini, M. K. (2011) · Cited by 16
Using WCAG 2.0 and Heuristic Evaluation to Evaluate Accessibility in Educational Web Based Pages
Debevc, M., Kožuh, I., Hauptman, S., Klembas, A., Bele, J. L., & Holzinger, A. (2015) · Communications in computer and information science · doi:10.1007/978-3-319-22629-3_16 · Cited by 14 · cited 2×
“Papers [38]–[40], [43], [44], [46], [52] were evaluated with conformance level A; papers [45], [47], [48], [50], [53]–[55] with conformance level AA; papers [57], [58] with conformance levels A and AA; papers [36], [42], [56] with conformance levels A, AA and AA.”
BackgroundMethodPereira, J., Martins, J., Cota, M. P., Gonçalves, R., & Santos, V. (2013) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.3217/jucs-019-18-2639 · Cited by 11 · cited 2×
“Paper [36] Constitution of the Portuguese Republic.”
BackgroundDigital assessment in higher education
Begnum, M. E. N., & Foss-Pedersen, R. J. (2017) · Universal Access in the Information Society · doi:10.1007/s10209-016-0513-9 · Cited by 10 · cited 3×
“The web accessibility evaluation in the paper [54] was carried out with JAWS, 2-switch and an anonymous user group.”
BackgroundMethodComparing and evaluating the effectiveness of mobile Web adequacy evaluation tools
Kaur, A., & Dani, D. (2016) · Universal Access in the Information Society · doi:10.1007/s10209-016-0466-z · Cited by 9 · cited 1×
“…2) description of the checkpoint, name of the HTML attribute containing the error/warning; 3) URL of the mobile web best practices guideline on the W3C site where the violated guideline is explained; 4) list of line numbers in the source code where the error/warning has been generated [62].”
BackgroundGuidelines and deployment of accessibility-aware framework approach
Ali, S., Al-Balushi, T., & Al-Badi, A. H. (2017) · International Journal of Web Information Systems · doi:10.1108/ijwis-08-2016-0043 · Cited by 8 · cited 2×
“All the papers talk about disabilities, however, only papers [38]–[40], [42], [43], [45], [48], [49], [53], [54] specify in their research the disabilities with which they work, which are blind users or those with low vision, color blindness, users with cognitive or language limitations, or users…”
BackgroundTaylor, Z., & Bıçak, İ. (2019) · Community College Journal of Research and Practice · doi:10.1080/10668926.2019.1600604 · Cited by 8 · cited 2×
“Papers [38]–[40], [43], [44], [46], [52] were evaluated with conformance level A; papers [45], [47], [48], [50], [53]–[55] with conformance level AA; papers [57], [58] with conformance levels A and AA; papers [36], [42], [56] with conformance levels A, AA and AA.”
BackgroundEvaluating the Accessibility of Online University Education
Pendergast, M. O. (2016) · International Journal of Online Pedagogy and Course Design · doi:10.4018/ijopcd.2017010101 · Cited by 7 · cited 2×
“Paper [47] Americans with Disabilities Act (ADA), Individuals with Disabilities Education Act (IDEA), Section 504 of the Rehabilitation Act of 1973.”
BackgroundCampoverde‐Molina, M., Luján‐Mora, S., & García, L. V. (2019) · EDULEARN proceedings · doi:10.21125/edulearn.2019.1171 · Cited by 3 · cited 1×
“In summary, all selected papers evaluate educational websites using the WCAG, which is the purpose of this SLR. Education is in an evolutionary process that adjusts to laws, regulations and the new demands of teaching and learning [69].”
BackgroundSelf-citationAAEM: Accessibility Assistance Evaluation Metric
Gohin, B., & Vinod, V. (2014) · International Review on Computers and Software (IRECOS) · doi:10.15866/irecos.v9i5.1207 · Cited by 2
Research works printed but not linked: 22
- eggert, 2019, How to Meet WCAG (Quick Reference)
- pribeanu, 2019, Large-scale accessibility evaluation of Romanian municipal websites, Int J User-Syst Interact, 12, 83
- martins, 2019, Desenvolvimento de Aplicações Acessíveis no Contexto de Sala de Aula da Disciplina de Interação Humano-Computador, Rev Iberica Sist e Tecnol Informacao, e17, 729
- eggert, 2016, Complete List of Web Accessibility Evaluation Tools
- abou-zahra, 2017, Selecting Web Accessibility Evaluation Tools
- 2017, Using JAWS to Evaluate Web Accessibility
- henry, 2010, Instructions for the Benefits of WCAG 2 0 Presentation
- abou-zahra, 2017, Diverse Abilities and Barriers
- campbell, 2018, Understanding WCAG 2 1
- 2011, World report on disability Summary
- henry, 2019, Accessibility
- otálora, 2016, Methodological guide for development of accessible educational virtual environments: A systematic approach [Guía metodológica para el desarrollo de ambientes educativos virtuales accesibles: Una visión desde un enfoque sistémico], Digital Education Review, 166
- ahmi, 2019, Bibliometric analysis of global scientific literature on Web accessibility, Int J Recent Technol Eng, 7, 250
- 10.14569/IJACSA.2017.080642 · DOI
- abou-zahra, 2018, WCAG 2 1 adoption in Europe
- kirkpatrick, 2020, Web Content Accessibility Guidelines (WCAG) 2 0
- chisholm, 1999, Web content accessibility guidelines 1 0
- henry, 2018, W3C Web Content Accessibility Guidelines (WCAG) Overview
- 1997, World Wide Web Consortium Launches International Program Office for Web Accessibility Initiative
- caldwell, 2008, Web Content Accessibility Guidelines (WCAG) 2 0
- kirkpatrick, 2018, Web Content Accessibility Guidelines (WCAG) 2 1
- 2006, Convention on the Rights of Persons with Disabilities
Cited by
Fernández-Díaz, E., Jambrino-Maldonado, C., Iglesias-Sánchez, P. P., & Heras-Pedrosa, C. D. L. (2022) · Tourism Review · doi:10.1108/tr-02-2022-0091 · Cited by 120
Accessibility of university websites worldwide: a systematic literature review
Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-021-00825-z · Cited by 84
Self-citationAccessibility engineering in web evaluation process: a systematic literature review
Ara, J., Sik‐Lányi, C., & Kelemen, A. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-023-00967-2 · Cited by 96
“Emphasizing the necessity of the SLR approach in the web accessibility context, Akram and Sulaiman [14] and Campoverde-Molina et al. [15] have conducted SLRs to analyze the accessibility of educational institute websites within a specific period.”
MethodScientific Research in Ecuador: A Bibliometric Analysis
Herrera-Franco, G., Montalván-Burbano, N., Mora-Frank, C., & Bravo-Montero, L. (2021) · Publications · doi:10.3390/publications9040055 · Cited by 89
“In Ecuador, the development of web applications has been developed for the benefit of society, such as websites of state entities (Geo-MOOC, WCAG 2.0) [213], website accessibility [214], educational websites [215,216] and models for quality evaluation in higher education [217,218].”
BackgroundInfluentialThe State of Web Accessibility for People with Cognitive Disabilities: A Rapid Evidence Assessment
Gartland, S., Flynn, P., Carneiro, M. A., Holloway, G., Fialho, J. D. S., Cullen, J., Hamilton, E., Harris, A. C., & Cullen, C. (2022) · Behavioral Sciences · doi:10.3390/bs12020026 · Cited by 70
“A second, focused on web accessibility, broadly speaking, not specifically for people with cognitive disabilities, with respect to educational websites [22].”
Background
Metadata
- Authors
- Campoverde-Molina, M., Lujan-Mora, S., & Garcia, L. V.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 91676-91700
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3024743641
- Cited by
- 94
- References
- 48
- Citations by year
- 2026: 10 · 2025: 17 · 2024: 19 · 2023: 20 · 2022: 12 · 2021: 13 · 2020: 3
- FWCI
- 5.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- RUA, Repositorio Institucional de la Universidad de Alicante (Universidad de Alicante) (submittedVersion, cc-by)
- Greater South Information System
- Funders
- Catholic University of Cuenca
- EduTech Project co-funded by the Erasmus+Programme of the European Union (609785-EPP-1-2019-1-ES-EPPKA2-CBHE-JP)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- web accessibility, educational websites, Web Content Accessibility Guidelines, user-centered evaluation, accessibility errors, disability, older adults, inclusive education, accessibility compliance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.