Web Accessibility Evaluation of Videos Published on YouTube by Worldwide Top-Ranking Universities
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Video consumption on the web has increased markedly in recent years. Universities use videos in different teaching-learning modalities, as well as on their websites, to publish information aimed at their stakeholders. Access to education and information has been recognized as a human right in several international conventions and the constitutions of most countries. Therefore, it is essential to ensure that videos published on the web can be accessed by people with disabilities. The universality of the web is so important that some organizations worldwide have contributed to the development of standards and recommendations focused on web accessibility. Despite these efforts, the rights of millions of people are currently violated, as they are excluded from access to both education and information published on the web. Regarding videos, the reasons are a lack of captions, sign language, audio descriptions, and transcriptions, among others. The objective of this study is to evaluate the accessibility of videos published on YouTube by the best universities in the world based on compliance with the Web Content Accessibility Guidelines (WCAG) 2.1 of the World Wide Web Consortium. We carry out a manual evaluation of 91,421 videos, which were all published on YouTube by 113 universities taken from the Shanghai Ranking. Our purpose is to highlight the urgent need to change the current low level of accessibility that their educational videos show. Consequently, statistical results are presented regarding the compliance with video accessibility according to the regions and positions of the universities in the ranking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“WCAG 2.1 has been used in papers [66, 72, 73, 76] to evaluate the accessibility of university websites.”
From Accessibility of university websites worldwide: a systematic literature review (2023) · cites this paper as [76]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One paper [76] presented the manual evaluation of the YouTube videos published on university websites with the expert knowledge of the authors of the paper on web accessibility.”
From Accessibility of university websites worldwide: a systematic literature review (2023) · cites this paper as [76]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“A total of 91,421 YouTube videos have been evaluated in the paper [76]”
From Accessibility of university websites worldwide: a systematic literature review (2023) · cites this paper as [76]
The cited source says what the claim attributes to it.
In the citing paper
“The papers [47, 48, 54, 76] do not refer in their content to the web pages that have been evaluated in the universities.”
From Accessibility of university websites worldwide: a systematic literature review (2023) · cites this paper as [76]
The cited source says what the claim attributes to it.
In the citing paper
“only papers [45, 76] have dealt with the evaluation of other resources that exist on the web pages, and the rest have only focused on the web pages.”
From Accessibility of university websites worldwide: a systematic literature review (2023) · cites this paper as [76]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shakespeare, T., & Officer, A. (2011) · Disability and Rehabilitation · doi:10.3109/09638288.2011.590392 · Cited by 1,792
Digital Literacy: A Conceptual Framework for Survival Skills in the Digital era
Eshet‐Alkalai, Y. (2004) · Journal of educational multimedia and hypermedia · Cited by 1,326
The Academic Ranking of World Universities
Liu, N. C., & Cheng, Y. (2005) · Higher Education in Europe · doi:10.1080/03797720500260116 · Cited by 1,070 · cited 2×
“The selection of the universities was made considering the latest Academic Ranking of World Universities report, published by the Shanghai Ranking Consultancy in August 2019 [51].”
Convention on the Rights of Persons with Disabilities and Optional Protocol
States, M. (2012) · Cited by 623
Use of Multimedia as a New Educational Technology Tool–A Study
Malik, S., & Agarwal, A. (2012) · International Journal of Information and Education Technology · doi:10.7763/ijiet.2012.v2.181 · Cited by 158 · cited 2×
“Videos are one of the technological resources with the greatest potential on the web because they are widely used in many fields, such as education, the economy, entertainment, business, and politics [2]–[4].”
BackgroundAcosta-Vargas, P., Acosta, T., & Lujan-Mora, S. (2018) · IEEE Access · doi:10.1109/access.2018.2848978 · Cited by 92 · cited 1×
“…countries; for example, in 2010, a study was carried out in Turkey [42]; in 2016, in the Kyrgyz Republic [43]; in 2017, in Ecuador [44]; in 2018, in Israel [45]; South Africa [46] and Latin America [47]; and in 2019, in Portugal [48], Spain, Chile and Mexico [49] and the United States [50].”
BackgroundSelf-citationAbuaddous, H. Y., Zalisham, M., & Basir, N. (2016) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2016.071023 · Cited by 87 · cited 2×
“This inaccessibility occurs for a number of reasons, including little or no developer experience on web accessibility and a lack of information about the best ways to quickly and easily identify accessibility problems using different accessibility evaluation methods [20].”
BackgroundThe accessibility of university web sites: the case of turkish universities
Kurt, S. (2011) · Universal Access in the Information Society · doi:10.1007/s10209-010-0190-z · Cited by 77 · cited 1×
“…the websites of universities, several studies have been carried out in different countries; for example, in 2010, a study was carried out in Turkey [42]; in 2016, in the Kyrgyz Republic [43]; in 2017, in Ecuador [44]; in 2018, in Israel [45]; South Africa [46] and Latin America [47]; and in 2019,…”
BackgroundUniversities of the Kyrgyz Republic on the Web: accessibility and usability
İsmailova, R., & Kimsanova, G. (2016) · Universal Access in the Information Society · doi:10.1007/s10209-016-0481-0 · Cited by 61 · cited 1×
“…studies have been carried out in different countries; for example, in 2010, a study was carried out in Turkey [42]; in 2016, in the Kyrgyz Republic [43]; in 2017, in Ecuador [44]; in 2018, in Israel [45]; South Africa [46] and Latin America [47]; and in 2019, in Portugal [48], Spain, Chile and…”
BackgroundHow Could MOOCs Become Accessible? The Case of edX and the Future of Inclusive Online Learning
Sánchez-Gordón, S., & Luján‐Mora, S. (2020) · TUGraz OPEN Library (Graz University of Technology) · doi:10.3217/jucs-022-01-0055 · Cited by 55 · cited 1×
“The incorporation of videos in massive open online courses (MOOCs) has similarly increased notably in recent years, further contributing to inclusive education [12], [13].”
BackgroundAccessibility of South African university websites
Verkijika, S. F., & De Wet, L. (2020) · Universal Access in the Information Society · doi:10.1007/s10209-018-0632-6 · Cited by 53 · cited 1×
“…countries; for example, in 2010, a study was carried out in Turkey [42]; in 2016, in the Kyrgyz Republic [43]; in 2017, in Ecuador [44]; in 2018, in Israel [45]; South Africa [46] and Latin America [47]; and in 2019, in Portugal [48], Spain, Chile and Mexico [49] and the United States [50].”
BackgroundWeb accessibility evaluation of top-ranking university Web sites in Spain, Chile and Mexico
Máñez-Carvajal, C., Cervera-Mérida, J. F., & Fernández-Piqueras, R. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-019-00702-w · Cited by 52
Accessibility analysis of higher education institution websites of Portugal
Ismail, A., Kuppusamy, K. S., & Paiva, S. (2020) · Universal Access in the Information Society · doi:10.1007/s10209-019-00653-2 · Cited by 43 · cited 2×
“America [47]; and in 2019, in Portugal [48], Spain, Chile and Mexico [49] and the United States [50].”
BackgroundEvaluating Alternatives for Better Deaf Accessibility to Selected Web-Based Multimedia
Shiver, B. N., & Wolfe, R. J. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809857 · Cited by 42
Evaluation of Web content accessibility in an Israeli institution of higher education
Laufer Nir, H., & Rimmerman, A. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-018-0615-7 · Cited by 42 · cited 1×
“…countries; for example, in 2010, a study was carried out in Turkey [42]; in 2016, in the Kyrgyz Republic [43]; in 2017, in Ecuador [44]; in 2018, in Israel [45]; South Africa [46] and Latin America [47]; and in 2019, in Portugal [48], Spain, Chile and Mexico [49] and the United States [50].”
BackgroundMaking multimedia content accessible for screen reader users
Miyashita, H., Sato, D., Takagi, H., & Asakawa, C. (2007) · International Web for All Conference (W4A) · doi:10.1145/1243441.1243443 · Cited by 32 · cited 1×
“Videos are one of the technological resources with the greatest potential on the web because they are widely used in many fields, such as education, the economy, entertainment, business, and politics [2]–[4].”
BackgroundDisability Standards for Multimedia on the Web
Moreno, L. D. L. R., Martı́nez, P., & Ruíz‐Mezcua, B. (2008) · IEEE Multimedia · doi:10.1109/mmul.2008.85 · Cited by 25 · cited 1×
“0 could be applied to make multimedia content accessible [28].”
BackgroundAnálisis de la accesibilidad de los sitios web de las universidades ecuatorianas de excelencia
Acosta, T., & Luján‐Mora, S. (2017) · Enfoque UTE · doi:10.29019/enfoqueute.v8n1.133 · Cited by 25
Self-citationA System to Generate SignWriting for Video Tracks Enhancing Accessibility of Deaf People
Verdú, E., G‐Bustelo, B. C. P., Sánchez, M. Á. M., & Crespo, R. A. G. (2017) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2017.09.002 · Cited by 22 · cited 1×
“for video tracks, enhancing the accessibility for deaf people [31].”
BackgroundWebsite accessibility: an Australian view
Grantham, J., Grantham, E., & Powers, D. M. W. (2012) · Australasian User Interface Conference · Cited by 20
Characteristics and Potentials of YouTube: A Measurement Study
Cheng, X., Dale, C., & Liu, J. (2008) · Springer eBooks · doi:10.1007/978-0-387-76450-4_9 · Cited by 16
Țapu, R., Mocanu, B., & Zaharia, T. B. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00313 · Cited by 15 · cited 1×
“In 2019, two proposals were presented to improve video accessibility for deaf and hearing-impaired people through the use of dynamic subtitles and captions [32], [33].”
BackgroundWeb Accessibility Requirements for Media Players
González, M., Moreno, L., Martı́nez, P., & Iglesias, A. M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23768-3_109 · Cited by 14 · cited 1×
“Concerning the accessibility of video players, in 2011, the results of two studies on the accessibility of media players were presented [35], [36].”
A Study of Accessibility Requirements for Media Players on the Web
Moreno, L., Gonzalez, M., Martı́nez, P., & Iglesias, A. M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21672-5_28 · Cited by 12 · cited 1×
“Concerning the accessibility of video players, in 2011, the results of two studies on the accessibility of media players were presented [35], [36].”
Techniques for the Publication of Accessible Multimedia Content on the Web
Acosta, T., Zambrano-Miranda, J., & Luján‐Mora, S. (2020) · IEEE Access · doi:10.1109/access.2020.2981326 · Cited by 12 · cited 1×
“To contribute to the understanding and compliance of accessibility requirements by content authors and web developers, in 2020, we presented a proposal with 278 techniques to guide content authors, programmers, designers, and evaluators in the publication of accessible multimedia on the web [21].”
MethodSelf-citationAn Accessible Video Player for Older People: Issues from a User Test
Villena, J. M. R., Ramos, B., Fortes, R. P. D. M., & Goularte, R. (2014) · Procedia Computer Science · doi:10.1016/j.procs.2014.02.020 · Cited by 10 · cited 1×
“In 2014, research was carried out describing the design and evaluation of an accessible video player [37].”
MethodTowards collaborative annotation for video accessibility
Champin, P.-A., Encelle, B., Evans, N., Ollagnier-Beldame, M., Prié, Y., & Raphaël Troncy, A. (2010) · International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806010 · Cited by 10 · cited 1×
“[29].”
The Inaccessibility of Video Players
Wild, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94277-3_9 · Cited by 9 · cited 1×
“In 2018, an evaluation of the accessibility of 37 video players, both free and paid, was performed [40].”
BackgroundChecklist for Accessible Media Player Evaluation
Moreno, L., González-García, M. D. C., Martı́nez, P., & González, Y. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3134791 · Cited by 8 · cited 1×
“In 2017, a checklist with 23 indicators focused on the design and evaluation of the accessibility of media players was presented [38].”
MethodAccessibility Evaluation of Multimedia Resources in Selected Latin America Universities
Acosta-Vargas, P., Salvador-Ullauri, L., Pérez-Medina, J.-L., & Rybarczyk, Y. P. (2019) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg.2019.8734439 · Cited by 8 · cited 3×
“This result differs from the results obtained in the study of 10 videos related to universities in Latin America, in which it was concluded that being in a high position in the ranking does not necessarily mean that the multimedia resources comply appropriately with the WCAG 2.1 [34].”
BackgroundMethodResultInfluentialSelf-citationMocanu, B., Țapu, R., & Zaharia, T. B. (2019) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb47216.2019.8970038 · Cited by 8 · cited 1×
“In 2019, two proposals were presented to improve video accessibility for deaf and hearing-impaired people through the use of dynamic subtitles and captions [32], [33].”
BackgroundACCESSIBILITY OF MULTIMEDIA RESOURCES IN WEB
Moreno, L., Iglesias, A. M., & Martı́nez, P. (2007) · International Conference on Web Information Systems and Technologies · doi:10.5220/0001288704700473 · Cited by 7 · cited 1×
“In previous investigations on the web accessibility of videos and multimedia, in 2007, a summary of some elements and best practices to take into account to make a multimedia resource accessible on the web was presented [27].”
BackgroundVideo Accessibility on the Most Accessed Websites - A Case Study Regarding Visual Disabilities
Villena, J. M. R., Ramos, B., Goularte, R., & Fortes, R. P. D. M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20678-3_23 · Cited by 6 · cited 1×
“In 2015, an investigation presented the results of a study centered on evaluating the accessibility of videos on the most commonly used websites [30].”
BackgroundANALYSIS OF THE ACCESSIBILITY OF EDUCATIONAL VIDEOS IN MASSIVE OPEN ONLINE COURSES
Acosta, T., Zambrano-Miranda, J., & Luján‐Mora, S. (2019) · EDULEARN proceedings · doi:10.21125/edulearn.2019.2076 · Cited by 6 · cited 3×
“These studies were based on compliance with the WCAG 2.1 [15].”
BackgroundMethodInfluentialSelf-citationANALYSIS OF ACCESSIBILITY REQUIREMENTS FOR VIDEO PLAYERS ON E-LEARNING
Acosta, T., Zambrano-Miranda, J., & Luján‐Mora, S. (2019) · EDULEARN proceedings · doi:10.21125/edulearn.2019.2071 · Cited by 6 · cited 1×
“Recent studies have also demonstrated that the native video player of YouTube is one of the most accessible considering the WCAG [41], [52], [53].”
BackgroundSelf-citationAccessible interfaces for educational multimedia contents
Moreno, L., Iglesias, A. M., Martı́nez, P., & Ruíz‐Mezcua, B. (2008) · Cited by 5
Research works printed but not linked: 25
- thompson, 2018, Media player accessibility: Summary of insights from interview & focus groups, Technol Persons Disabilities Conf, 6, 325
- 2008, New Captions Feature for Videos
- 2020, Introduction to Web accessibility
- 2020, Web Content Accessibility Guidelines (WCAG) 2 0
- 2020, Web Content Accessibility Guidelines (WCAG) 2 1
- 2020, Techniques for WCAG 2 1
- 2020, Media Accessibility User Requirements
- 2020, Higher Ed in 4k Project
- 2019, World Top 1000 Universities 2019
- 2019, The World’s Most Popular Websites Hare a Commitment to Accessibility Here’s How They Approach It
- 2020, Web content accessibility guidelines 1 0
- 2007, Your Guide to Countries That Have Banned YouTube
- 2020, YouTube
- scacca, 2020, How Do You Make Video Accessible
- 2020, Accessibility in Government
- 2020, COVID-19 Educational Disruption and Response
- 2020, 290 Million Students Out of School Due to COVID-19 UNESCO Releases First Global Numbers and Mobilizes Response
- allen, 2017, Digital Learning Compass Distance Education Enrollment Report 2017
- 2020, World Report on Disability
- 2020, Landmark Agreements Establish New Model for Online Accessibility in Higher Education and Business
- 2015, Sues Harvard and MIT for Discrimination in Public Online Content
- smith, 2019, 53 incredible facebook statistics and facts
- smith, 2019, 126 Amazing Social Media Statistics and Facts
- iqbal, 2020, Snapchat Revenue and Usage Statistics
- 2019, Sixth Annual State of Video in Education 2019 Insights and Trends
Cited by
Çavuş, N., Sani, S. A., Haruna, Y., & Lawan, A. A. (2021) · Sustainability · doi:10.3390/su13020808 · Cited by 118
“[51] C = 0 L = Ecuador SNS = YouTube 91,421 YouTube video clips published by 113 high-ranked universities of the world To evaluate the accessibility of the sampled YouTube videos based on conformity with the Web Content Accessibility Guidelines (WCAG) 2.”
BackgroundMethodInfluentialAccessibility of university websites worldwide: a systematic literature review
Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-021-00825-z · Cited by 84
“One paper [76] presented the manual evaluation of the YouTube videos published on university websites with the expert knowledge of the authors of the paper on web accessibility.”
BackgroundMethodInfluentialWhat Makes Videos Accessible to Blind and Visually Impaired People?
Liu, X., Carrington, P., Chen, X. '., & Pavel, A. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445233 · Cited by 87
“Further, a survey of 91,421 educational videos published by 113 universities found that only 13% of videos provided captions, and none of them provided audio descriptions [8].”
BackgroundAngerbauer, K., Rodrigues, N., Cutura, R., Öney, S., Pathmanathan, N., Morariu, C., Weiskopf, D., & Sedlmair, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502133 · Cited by 37
“How well is such research turned into practice? What issues or helpful aspects can we identify in figures used in our daily research? What can we learn from those aspects to make our figures more accessible? There is work surveying the accessibility of web pages [2, 50, 58] and research on the accessibility of psychol…”
BackgroundSlidecho: Flexible Non-Visual Exploration of Presentation Videos
Peng, Y.-H., Bigham, J. P., & Pavel, A. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471234 · Cited by 40
“Currently, most presentation videos online do not fully describe the visual content [52], contain audio descriptions [8], or provide corresponding slides (e.”
Background
Metadata
- Authors
- Acosta, T., Acosta-Vargas, P., Zambrano-Miranda, J., & Lujan-Mora, S.
- Affiliations
- National Polytechnic School (EC)
- Universidad de Las Américas (EC)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 110994-111011
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3034209002
- Cited by
- 30
- References
- 36
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 3 · 2023: 8 · 2022: 3 · 2021: 7
- FWCI
- 8.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- RUA, Repositorio Institucional de la Universidad de Alicante (Universidad de Alicante) (submittedVersion, cc-by)
- Funders
- Escuela Politcnica Nacional (PII-DETRI-2019-03)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
- Social Sciences › Sociology and Political Science › Disability Rights and Representation
- Keywords
- web accessibility, video accessibility, YouTube, universities, captions, sign language, audio description, transcription, accessibility compliance, educational videos, disability, Shanghai ranking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.