The DOI matches its Crossref record, with a small difference in title or year; 30 of the 31 references it cites were found in a registry or an index; 11 of the 48 sources its claims cite were checked for support.
Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages
Open accessAbstract
Information and communication technology (ICT) has made higher education available to many students in a new way. The role of online learning in higher education institutions (HEIs) has grown to an unprecedented scale due to the COVID-19 pandemic. The diversity of higher education students has increased, and accessible solutions are needed. New European and national regulations support these trends. The research reported in this paper was conducted in Finland, which is one of the leading European countries in terms of high technology and digitalisation. The aim of this research is to explore the accessibility of all Finnish HEIs’ ( N = 38) landing pages based on Web Content Accessibility Guidelines (WCAG 2.1). The situations before and after recent legislation are compared. Previous studies have shown that HEIs’ landing pages typically have many accessibility errors. Unlike previous studies, this study considered the types of accessibility errors at a detailed level to support HEIs’ development and implementation of accessibility standards. A combination of two automated accessibility testing tools was used, and the performance of individual tools was analysed. The results show that HEIs’ landing pages are not accessible and there are enormous differences between institutions. Two clusters of HEIs were found: one with good accessibility in terms of WCAG 2.1’s four principles (perceivable, operable, understandable, and robust), and one with poor accessibility. On half of the HEIs’ landing pages with poor accessibility, the number of errors increased even given the binding nature of the law. Obviously, there is still work to be done. Implications for practice are also discussed.
Overview
CoChat Summary
TL;DR
This study evaluated the accessibility of all 38 Finnish higher education institutions’ landing pages against WCAG 2.1 before and after Finland’s binding digital accessibility legislation. It found that the pages were still largely inaccessible, with large differences between institutions, although total errors decreased somewhat after the law became binding.
Key findings
- None of the Finnish HEIs’ landing pages were fully accessible. Siteimprove reported an average of 87 errors per institution (minimum 0, median 50, maximum 685), while WAVE reported an average of 65 errors (minimum 0, median 21, maximum 704). The fewest errors were on Laurea UAS (Siteimprove 3, WAVE 1), and the most on Åbo Akademi University (Siteimprove 685, WAVE 704).
- The most common error types were insufficient colour contrast, link purpose not determinable from link text, and missing text alternatives for non-text content. WAVE reported that 58% of its errors (1,431 of 2,471) involved too-low colour contrast. The two tools differed significantly in total errors found (p = 0.043), and the authors recommend using more than one automated tool.
- After the Act became binding, total accessibility errors decreased by one-fifth, from 5,506 to 4,504, but the difference was not significant (p = 0.050). Errors decreased in 20 HEIs, increased in 14, and remained the same in four. Contrast errors decreased significantly (p = 0.006), while bypass block errors (p = 0.034) and headings and labels errors (p = 0.000) increased.
- Cluster analysis divided the 38 HEIs into two clusters of 19 each: one with poor accessibility and one with good accessibility across all four WCAG principles. Most science universities were in the better cluster, while universities of applied sciences were split; HEIs with more accessibility issues were on average smaller organizations (p = 0.038).
Methods
- The study analysed the landing pages of all Finnish HEIs (N = 38), using the Finnish Ministry of Education and Culture database to identify institutions. Data were collected before the law became binding in February 2020 (reference data) and after it became binding in December 2020, 2.5 months after the regulations came into force (main data).
- Two automated tools, Siteimprove and WAVE, were used to test WCAG 2.1 A and AA conformance, considering only errors. Reference data were collected manually; main data were collected via Robot Framework automation with Selenium and PyAutoGUI.
- Analyses included descriptive statistics, the Wilcoxon Signed Rank Test, hierarchical cluster analysis, the Kruskal–Wallis test, and a t-test. A new variable selected the larger error count per WCAG criterion across tools to reduce duplication bias.
Limitations
- The paper states that the research sampled only landing pages, not the full institutional websites; that the two data collections capture only two moments and dynamic content can change; and that automated tools do not reveal all accessibility issues, so multiple browsers, tools, platforms, and user testing would be needed for more reliable results.
- Evident from the text: automated testing cannot assess whether alternative texts are understandable or whether videos are captioned, and the before–after comparison is observational, so it cannot establish that the law caused the observed changes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
10 Valid · 0 Not valid · 27 Not checked · 87 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“These were among the most common errors in previous studies (see [14, 36, 40]).”
§ Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages > Discussion > Discussion of major findings
What the sources say
- Supportedcites [14] Alahmadi T Drew S Accessibility evaluation of top-ranking university websites in world, oceania, and arab categories for home, admission, and course description webpages J. Open Flex. Distance Learn. 2017 21 7 24 10.3316/informit.957118278379895 source
The source's “Common errors that affect accessibility” section identifies the accessibility errors most common across the university websites it evaluated and ranks specific errors by frequency. This supports citing it as a previous study in which those error types were common; the citing sentence does not require the source to compare its findings with other studies. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites [36] Ismail A Kuppusamy KS Paiva S Accessibility analysis of higher education institution websites of Portugal Univers. Access Inf. Soc. 2020 19 685 700 10.1007/s10209-019-00653-2 source
- Not checked — no full text of the sourcecites [40] Campoverde-Molina M Lujan-Mora S Garcia LV Empirical studies on web accessibility of educational websites: a systematic literature review IEEE Access. 2020 8 91676 91700 10.1109/ACCESS.2020.2994288 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“WAVE reported inadequate contrasts in more detail, with 58% (1,431 of the 2,471) of the errors on HEIs’ landing pages involving too-low colour contrasts”
§ Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages > How accessible are Finnish HEIs’ landing pages? > Types and frequency of accessibility errors on landing pages
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Two clusters of HEIs were found: one with good accessibility in terms of WCAG 2.1’s four principles (perceivable, operable, understandable, and robust), and one with poor accessibility.”
§ Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The most errors were found on the landing page of Åbo Akademi University (Siteimprove 685, WAVE 704).”
§ Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages > How accessible are Finnish HEIs’ landing pages? > Remarkable differences between institutions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The automated test tools found different numbers and types of accessibility errors on the landing pages.”
- Also stated in: § Discussion of major findings · hedged
“As indicated in previous studies and confirmed in this study, different test tools find different types1 and numbers of errors.”
§ Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages > How accessible are Finnish HEIs’ landing pages? > Types and frequency of accessibility errors on landing pages
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Discussion of major findings · hedged
52 more claims
Create a free account to see all 124 claims and every source verdict.
- It may state two separate claims as one. 36
- Probably not a substantial claim. 42
- The quote only partly states this claim. 4
Citations
Cites
Rethinking the accessibility of online higher education: A historical review
Lee, K. (2017) · The Internet and Higher Education · doi:10.1016/j.iheduc.2017.01.001 · Cited by 302 · cited 1×
“Notably, resent reviews emphasise two facets of online education: considering the characteristics of online students and applying evidence-based pedagogical practices [19, 20].”
Bong, W. K., & Chen, W. (2021) · International Journal of Inclusive Education · doi:10.1080/13603116.2021.1937344 · Cited by 240 · cited 1×
“Notably, resent reviews emphasise two facets of online education: considering the characteristics of online students and applying evidence-based pedagogical practices [19, 20].”
Vigo, M., Brown, J., & Conway, V. (2013) · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility · doi:10.1145/2461121.2461124 · Cited by 215 · cited 2×
“Automated test tools cannot detect all types of WCAG accessibility errors [31].”
The role of accessibility in a universal web
Henry, S. L., Abou-Zahra, S., & Brewer, J. (2014) · International Web for All Conference (W4A) · doi:10.1145/2596695.2596719 · Cited by 141 · cited 1×
“In addition to people with disabilities, accessibility-focussed research and development benefits everyone, especially those who have contextual constraints related to, for example, network connections, equipment, ambient sound or lighting conditions [21].”
E-learning and Disability in Higher Education
Seale, J. (2013) · doi:10.4324/9780203095942 · Cited by 102
Alsaeedi, A. (2020) · Information · doi:10.3390/info11010040 · Cited by 101 · cited 1×
“The major errors include low-contrast text and images; links without visible text; document file issues, such as inaccessible uploaded document files; missing alternative texts for images, as well as buttons, and a lack of navigation information (see [11, 12, 27, 35–39]).”
Lancet, T. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60844-1 · Cited by 101
Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review
Campoverde-Molina, M., Lujan-Mora, S., & Garcia, L. V. (2020) · IEEE Access · doi:10.1109/access.2020.2994288 · Cited by 94 · cited 4×
“Furthermore, an analysis of 25 selected studies of educational websites’ accessibility showed that none of the sites were flawless [40].”
InfluentialTools for web accessibility evaluation
Abascal, J., Arrue, M., & Valencia, X. (2019) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-7440-0_26 · Cited by 88 · cited 1×
“Because the manual testing of web accessibility guidelines requirements may be difficult and burdensome, it is critical to have proper tools to assist in this [29].”
Exploring experiences of ableism in academia: a constructivist inquiry
Brown, N., & Ramlackhan, K. (2022) · Higher Education · doi:10.1007/s10734-021-00739-y · Cited by 62 · cited 1×
“It is important to inform and train staff to develop accessible practices and avoid bias and lack of knowledge [52–55].”
Research works printed but not linked: 3
- UNESCO: The Salamanca statement and framework for action on special needs education. Adopted by the world conference on special needs education: access and quality, Salamanca, Spain 10.6. (1994). https://unesdoc.unesco.org/ark:/48223/pf0000098427
- Pribeanu, C.: Large-scale accessibility evaluation of Romanian municipal websites. Int. J. User - Syst. Interact. 12, 83–98 (2019)
- Karhu, M., Hilera, J.R., Fernández, L., Ríos, R., (2012) Accessibility and readability of university websites in Finland. J. Access. Des. All. 2 http://hdl.handle.net/2099/12842
Cited by
Legal Protection of the Right to Education for People With Special Needs
Alqodsi, E. M., & Jahoori, S. A. H. N. A. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-6684-8504-0.ch010 · Cited by 26
Automated evaluation of accessibility issues of webpage content: tool and evaluation
Ara, J., & Sik‐Lányi, C. (2025) · Scientific Reports · doi:10.1038/s41598-025-92192-5 · Cited by 17
İnal, Y., & Torkildsby, A. B. (2025) · Universal Access in the Information Society · doi:10.1007/s10209-024-01183-2 · Cited by 14
“The fact that having legislation at the national level, consequently enforcing organizations to integrate accessibility practices into the development process, is also evidenced by previous research such as that of Laamanen et al. [27].”
Web Accessibility in Higher Education in Norway: To What Extent are University Websites Accessible?
İnal, Y., & Torkildsby, A. B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42280-5_7 · Cited by 10
Fakrudeen, M., Rajan, A., Alameri, A. H. M., & Almheiri, A. M. L. O. (2023) · International Conference on Information Technology Trends (ITT) · doi:10.1109/itt59889.2023.10184230 · Cited by 5
Metadata
- Authors
- Laamanen, M., Ladonlahti, T., Puupponen, H., & Kärkkäinen, T.
- Affiliations
- University of Jyväskylä (FI)
- Corresponding author
- Laamanen, Merja
- Venue
- Universal Access in the Information Society
- Published
- 2022-11-14
- Volume
- 23
- Issue
- 1
- Pages
- 475-491
- ISSN
- 1615-5289 (ISSN-L)
- 1615-5297
- PMC
- PMC9662130
- OpenAlex
- W4308967537
- Semantic Scholar
- 824cabc7577666c5b7e063cda11fdf2bb91e4abf
- Cited by
- 29
- References
- 30
- Citations by year
- 2026: 10 · 2025: 7 · 2024: 7 · 2023: 4 · 2022: 1
- FWCI
- 12.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Universal Access in the Information Society (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Jyväskylä University Digital Archive (University of Jyväskylä) (submittedVersion, cc-by)
- Funders
- Opetus- ja Kulttuuriministeriö
- University of Jyväskylä
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Education › Disability Education and Employment
- Keywords
- web accessibility, higher education institutions, landing pages, accessibility legislation, online learning, COVID-19 pandemic, accessibility errors, Finnish higher education, digital inclusion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages. https://app.cochat.ai/papers/10.1007/s10209-022-00931-6
- The paper
- Laamanen, M., Ladonlahti, T., Puupponen, H., & Kärkkäinen, T. (2024). Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages. Universal Access in the Information Society. https://doi.org/10.1007/s10209-022-00931-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.