The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; 4 of the 19 sources its claims cite were checked for support.
Digital Accessibility in Higher Education: A Dutch case study
Open accessAbstract
This case study investigates the integration of digital accessibility within the IT portfolio of a Dutch higher education institution (HEX). Utilizing both quantitative conformance testing and qualitative interviews, the study identifies significant trends and challenges in implementing digital accessibility. Findings reveal 13 trends in non-compliance with WCAG 2.2 standards across 35 critical systems, highlighting issues such as poor contrast and inadequate text alternatives. The study underscores the need for a comprehensive digital accessibility policy, enhanced collaboration among departments, and the structural embedding of WCAG conformance-checking capabilities to achieve and maintain proper digital accessibility, fostering an inclusive educational environment.
Overview
CoChat Summary
TL;DR
This Dutch higher-education case study combines WCAG 2.2 conformance testing of 35 critical systems (245 pages) with six semi-structured interviews to assess digital accessibility integration at HEX. It finds widespread non-compliance concentrated in 13 success-criteria trends and identifies organizational barriers such as absent policy, siloed departments, and no structural conformance-testing process.
Key findings
Across 35 systems and 245 pages, testing against WCAG 2.2 A/AA found 13 trends of violations; strong trends included Info and Relationships (1.3.1) 56,223 violations, Language of Parts (3.1.2) 30,034, Contrast Minimum (1.4.3) 8,180, Name Role Value (4.1.2) 6,965, Non-text Content (1.1.1) 3,790, Labels or Instructions (3.3.2) 3,176, and Non-text Contrast (1.4.11) 3,119.
- Weak/light trends included Link Purpose in Text (2.4.4) 1,333, Keyboard (2.1.1) 1,085, Label in Name (2.5.3) 1,084, Identify Input Purpose (1.3.5) 845, Bypass Blocks (2.4.1) 676, and Focus Order (2.4.3) 455; the conclusion says 7 strong and 5 light, while the results section lists 7 strong and 6 weak-trend headings.
- Qualitative interviews found HEX lacks a comprehensive digital accessibility policy; departments such as IT, Digital Learning Environments, and Marketing & Communication have distinct viewpoints and do not collaborate, with no champion or department primarily responsible and a silo architecture.
- Product owners reported that conformance testing of new systems or functionalities is usually not done with all relevant user groups (often only lecturers), rarely focuses on WCAG, and external consultancies used by some departments did not evaluate with experiential experts.
Methods
Quantitative: (semi-)automated and manual conformance testing of 35 critical systems, 245 webpages (average six per system), January–September 2024, using Accessibility Insights, PEAT, PAC, and ARC Toolkit configured for WCAG 2.2 A/AA across 55 of 87 success criteria; pages were selected using usage statistics and with product owners.
- Qualitative: six semi-structured interviews October 2023–January 2024, average 60 minutes, one focus-group style with four product owners and one manager, and five one-to-one interviews with one IT manager and four product owners; themes covered knowledge, state of accessibility, testing practices, and importance/priority.
- Analysis: violations were presented in a heatmap per WCAG success criterion, with trends categorized as strong (>1500 violations) or light (440–1500), noting that violation frequency per page affects comparison.
Limitations
Stated: the mix of free closed- and open-source tools may differ from commercial tools; testing was predominantly on Dutch-language pages; not all pages were tested; heatmap colors are relative, not absolute WCAG standards; WCAG criteria could be further dissected; the study focused on critical systems and excluded infrequently used systems; no conformance testing was done with students, staff, or disabled users; interviews have limited generalizability; and systems may have updated during the study.
- Stated: interviews were not audio- or video-recorded due to confidentiality, so analysis relied on one dedicated interviewer and one minute-taker.
- Evident from the text: conformance testing was performed by four 2nd/3rd-year bachelor software development students (after calibration and agreement on process), which may affect reliability; the conclusion’s “7 strong, 5 light” count conflicts with the six weak-trend headings in the results, indicating a reporting inconsistency.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 0 Not valid · 11 Not checked · 61 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Contrast (minimum) (8180 violations) : WCAGSuccess Criterion 1.4.3, Contrast (Minimum), requires a minimum contrast ratio of 4.5:1 between small text (text that is less than 18 points (pt) in size, or less than 14 points if it is bold) and its background.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Bypass blocks (676 violations): WCAGSuccess Criterion 2.4.1 requires providing mechanisms to bypass blocks of content that are repeated on multiple web pages.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Language of parts (30034 violations): WCAG Success Criterion 3.1.2, Language of Parts, requires that the language of each passage or phrase in the content is identified.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Non-text contrast (3119 violations) : WCAGSuccess Criterion 1.4.11, Non-text Contrast, requires a minimum contrast ratio of 3:1 for graphical elements and user interface components.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings reveal 13 trends in non-compliance with WCAG 2.2 standards across 35 critical systems, highlighting issues such as poor contrast and inadequate text alternatives.”
- Also stated in: § 5 Results · p. 5 · plain
“Based on the heatmap, we identified 13 trends of success criteria violations across the systems, as presented in Figure 1.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 5 Results · p. 5 · plain
21 more claims
Create a free account to see all 76 claims and to verify the 7 references still open.
- Probably not a substantial claim. 32
- It may state two separate claims as one. 28
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“We identified 13 trends (7 strong, 5 light) influencing digital accessibility at HEX, supported by qualitative findings from interviews.”
Reported 13 · recomputed 12
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“A total of 245 pages were tested across 35 systems using the evaluation procedures described in section four. The results of the conformance checking are presented in Figure 1. A heatmap is chosen to present the identified errors for each WCAG success criterion. An average of six webpages were tested for each system.”
Reported 6 · recomputed 7
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.2 System Identification · p. 4
“The following type of systems were included in our sample; 1) planning, 2) Learning Management Systems (LMS), 3) communication, 4) Plan Do Check Act (PDCA), 5) Human Resources (HR), 6) Filesharing, and 7) Office systems.”
§ 4.4 Semi-Structured Interviews · p. 5
“| 11 | Filesharing | Employee | In-house | 29 | Assistive | Employee & student | Third-party |”
Citations
Cites
Artificial intelligence in higher education: the state of the field
Crompton, H., & Burke, D. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00392-8 · Cited by 2,010 · cited 1×
“…such as those powered by artificial intelligence, provide personalized learning experiences by adapting to individual student needs and offering tailored feedback, a feature particularly beneficial in educational settings where personalized learning can significantly enhance student outcomes [21].”
Vigo, M., Brown, J., & Conway, V. (2013) · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility · doi:10.1145/2461121.2461124 · Cited by 215 · cited 1×
“For example, the work of [30] states that combining automated, manual, and user-based conformance testing can enhance the coverage of the WCAG success criteria.”
Learning management systems and technology acceptance models: A systematic review
Alnuaimi, M., & Al-Emran, M. (2021) · Education and Information Technologies : Official Journal of the IFIP technical committee on Education · doi:10.1007/s10639-021-10513-3 · Cited by 174 · cited 1×
“LMS platforms, like Moodle and Blackboard, facilitate the organization and delivery of course materials, assessments, and communication between students and instructors, which is essential for managing the complex and diverse needs of academic courses [20].”
Digital technologies for social inclusion of individuals with disabilities
Manzoor, M., & Vimarlund, V. (2018) · Health and Technology · doi:10.1007/s12553-018-0239-1 · Cited by 165 · cited 4×
“Similarly, individuals with hearing impairments may find it difficult to engage with audio-based content if it lacks captions or transcripts [16].”
InfluentialIntroduction to Web Accessibility
Strategies, D. E. (2019) · Cited by 135
Automatic web accessibility metrics: Where we are and where we can go
Vigo, M., & Brajnik, G. (2011) · Interacting with Computers · doi:10.1016/j.intcom.2011.01.001 · Cited by 112 · cited 2×
“In essence, conformance testing only landing pages for Digital Ac-cessibility is supported by Vigo et al., [27], who found that the error profile of the landing page is generally similar to other pages of a given website.”
Organizational Silos: A Scoping Review Informed by a Behavioral Perspective on Systems and Networks
Bento, F., Tagliabue, M., & Lorenzo, F. (2020) · Societies · doi:10.3390/soc10030056 · Cited by 103 · cited 1×
“Our findings, amongst other focal points, also suggest that HEX’s silo architecture hinders internal cooperation, affecting overall performance and adaptability [31].”
Accessibility of university websites worldwide: a systematic literature review
Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-021-00825-z · Cited by 84 · cited 1×
“A larger meta study by Campoverde-Molina, Luján-Mora, and Valverde [26] provides a systematic literature review on the accessibility of university websites worldwide, including those in Western countries.”
AlMeraj, Z., Boujarwah, F., Alhuwail, D., & Qadri, R. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-020-00717-8 · Cited by 51 · cited 3×
“The approach and adopted frameworks utilized in our study are similar to other studies, as presented extensively in the work of [25].”
Sarasola, J. L., Martínez, A. J., Rueda, M. M., & Cerero, J. F. (2020) · Sustainability · doi:10.3390/su12208603 · Cited by 31
Research works printed but not linked: 3
- W. en S. Ministerie van Volksgezondheid, “Zorg voor mensen met een beperking,” 2024. https://www.rijksoverheid.nl/onderwerpen/leven-met-een-beperking/zorg-voor-mensen-met-een-beperking#:∼:text=In Nederland hebben ongeveer 2,zorg en ondersteuning is verschillend. (accessed Sep. 20, 2024).
- AHIMA Foundation, “Issue Brief | The Critical Role of Web Accessibility in Health Information Access, Understanding, and Use,” 2022. https://ahimafoundation.ahima.org/research/the-critical-role-of-web-accessibility-in-health-information-access-understanding-and-use/ (accessed Sep. 20, 2024).
- W. A. I.-C. of P. (WAI-CooP), “Web Accessibility Directive: Frequently Asked Questions,” 2024. https://web-directive.eu/#:∼:text=This directive aims to make,access to online public services (accessed Sep. 20, 2024).
Cited by
Leewis, S., Smit, K., van de Hoef, A., Hartman, F., Kuiper, N., Todorova, J., & Gerritsen, T. (2025) · International Conference on Software and e-Business (ICSEB) · doi:10.1145/3789037.3789044 · Cited by 1
“This issue is especially pressing in the context of Dutch higher education, where institutions face increasing superdiversity, not only among enrolled students but also among prospective students, their parents, and university staff [8], [9].”
Self-citation
Metadata
- Authors
- Smit, K., van de Hoef, A., Kuiper, N., Todorova, J., Hartman, F., Leewis, S., & Gevaert, R.
- Affiliations
- University of Applied Sciences Utrecht (NL)
- ORCID
- Venue
- Proceedings of the 2024 8th International Conference on Software and e-Business
- Publisher
- ACM
- Published
- 2024-12-06
- Pages
- 76-86
- OpenAlex
- W4408967738
- Semantic Scholar
- 826477871f9a63d014cec3dcc53de614b00d5433
- Cited by
- 1
- References
- 18
- Citations by year
- 2025: 1
- FWCI
- 0.55
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- International Conference on Software and e-Business (ICSEB) (publishedVersion, cc-by)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Social Sciences › Education › Disability Education and Employment
- Social Sciences › Education › Digital Transformation of Higher Education
- Keywords
- digital accessibility, higher education, inclusive education, students with disabilities, assistive technology, Dutch universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-25, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-25 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital Accessibility in Higher Education: A Dutch case study. https://app.cochat.ai/papers/10.1145/3715885.3715890
- The paper
- Smit, K., van de Hoef, A., Kuiper, N., Todorova, J., Hartman, F., Leewis, S., & Gevaert, R. (2024). Digital Accessibility in Higher Education: A Dutch case study. Proceedings of the 2024 8th International Conference on Software and e-Business. https://doi.org/10.1145/3715885.3715890
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.