Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record, with a small difference in title or year; 30 of the 31 references it cites were found in a registry or an index; 11 of the 48 sources its claims cite were checked for support.

Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages

Open access
Laamanen, Merja, Ladonlahti, Tarja, Puupponen, Hannu, Kärkkäinen, Tommi · 2024 · Universal Access in the Information Society

Abstract

Information and communication technology (ICT) has made higher education available to many students in a new way. The role of online learning in higher education institutions (HEIs) has grown to an unprecedented scale due to the COVID-19 pandemic. The diversity of higher education students has increased, and accessible solutions are needed. New European and national regulations support these trends. The research reported in this paper was conducted in Finland, which is one of the leading European countries in terms of high technology and digitalisation. The aim of this research is to explore the accessibility of all Finnish HEIs’ ( N = 38) landing pages based on Web Content Accessibility Guidelines (WCAG 2.1). The situations before and after recent legislation are compared. Previous studies have shown that HEIs’ landing pages typically have many accessibility errors. Unlike previous studies, this study considered the types of accessibility errors at a detailed level to support HEIs’ development and implementation of accessibility standards. A combination of two automated accessibility testing tools was used, and the performance of individual tools was analysed. The results show that HEIs’ landing pages are not accessible and there are enormous differences between institutions. Two clusters of HEIs were found: one with good accessibility in terms of WCAG 2.1’s four principles (perceivable, operable, understandable, and robust), and one with poor accessibility. On half of the HEIs’ landing pages with poor accessibility, the number of errors increased even given the binding nature of the law. Obviously, there is still work to be done. Implications for practice are also discussed.

Overview

CoChat Summary

TL;DR

This study evaluated the accessibility of all 38 Finnish higher education institutions’ landing pages against WCAG 2.1 before and after Finland’s binding digital accessibility legislation. It found that the pages were still largely inaccessible, with large differences between institutions, although total errors decreased somewhat after the law became binding.

Key findings

  • None of the Finnish HEIs’ landing pages were fully accessible. Siteimprove reported an average of 87 errors per institution (minimum 0, median 50, maximum 685), while WAVE reported an average of 65 errors (minimum 0, median 21, maximum 704). The fewest errors were on Laurea UAS (Siteimprove 3, WAVE 1), and the most on Åbo Akademi University (Siteimprove 685, WAVE 704).
  • The most common error types were insufficient colour contrast, link purpose not determinable from link text, and missing text alternatives for non-text content. WAVE reported that 58% of its errors (1,431 of 2,471) involved too-low colour contrast. The two tools differed significantly in total errors found (p = 0.043), and the authors recommend using more than one automated tool.
  • After the Act became binding, total accessibility errors decreased by one-fifth, from 5,506 to 4,504, but the difference was not significant (p = 0.050). Errors decreased in 20 HEIs, increased in 14, and remained the same in four. Contrast errors decreased significantly (p = 0.006), while bypass block errors (p = 0.034) and headings and labels errors (p = 0.000) increased.
  • Cluster analysis divided the 38 HEIs into two clusters of 19 each: one with poor accessibility and one with good accessibility across all four WCAG principles. Most science universities were in the better cluster, while universities of applied sciences were split; HEIs with more accessibility issues were on average smaller organizations (p = 0.038).

Methods

  • The study analysed the landing pages of all Finnish HEIs (N = 38), using the Finnish Ministry of Education and Culture database to identify institutions. Data were collected before the law became binding in February 2020 (reference data) and after it became binding in December 2020, 2.5 months after the regulations came into force (main data).
  • Two automated tools, Siteimprove and WAVE, were used to test WCAG 2.1 A and AA conformance, considering only errors. Reference data were collected manually; main data were collected via Robot Framework automation with Selenium and PyAutoGUI.
  • Analyses included descriptive statistics, the Wilcoxon Signed Rank Test, hierarchical cluster analysis, the Kruskal–Wallis test, and a t-test. A new variable selected the larger error count per WCAG criterion across tools to reduce duplication bias.

Limitations

  • The paper states that the research sampled only landing pages, not the full institutional websites; that the two data collections capture only two moments and dynamic content can change; and that automated tools do not reveal all accessibility issues, so multiple browsers, tools, platforms, and user testing would be needed for more reliable results.
  • Evident from the text: automated testing cannot assess whether alternative texts are understandable or whether videos are captioned, and the before–after comparison is observational, so it cannot establish that the law caused the observed changes.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s10209-022-00931-6

Cites

30 of 31 references verified1 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 The timing of the accessibility of web pages, the Act on the Provision of Digital Services and the data collections of the current study
Fig. 1 The timing of the accessibility of web pages, the Act on the Provision of Digital Services and the data collections of the current studyCC BY · PubMed Central
Fig. 2 Numbers of errors found by WAVE and Siteimprove on HEIs’ landing pages
Fig. 2 Numbers of errors found by WAVE and Siteimprove on HEIs’ landing pagesCC BY · PubMed Central
Fig. 3 Changes in the number of errors on HEIs’ landing pages
Fig. 3 Changes in the number of errors on HEIs’ landing pagesCC BY · PubMed Central
Fig. 4 Accessibility errors found on HEIs’ landing pages on reference and main data collection
Fig. 4 Accessibility errors found on HEIs’ landing pages on reference and main data collectionCC BY · PubMed Central
Fig.5 Box plots of the WCAG principles (perceivable, operable, understandable and robust) for Clusters 1 and 2
Fig.5 Box plots of the WCAG principles (perceivable, operable, understandable and robust) for Clusters 1 and 2CC BY · PubMed Central
Fig. 6 Number of accessibility errors found by WAVE and Siteimprove on HEIs’ landing pages
Fig. 6 Number of accessibility errors found by WAVE and Siteimprove on HEIs’ landing pagesCC BY · PubMed Central

Verification

Claims the paper makes

10 Valid · 0 Not valid · 27 Not checked · 87 Own results and interpretations

52 more claims

Create a free account to see all 124 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 36
  • Probably not a substantial claim. 42
  • The quote only partly states this claim. 4

Create a free account to see these claims.

Citations

Cites

Show all 30 references

Research works printed but not linked: 3

  1. UNESCO: The Salamanca statement and framework for action on special needs education. Adopted by the world conference on special needs education: access and quality, Salamanca, Spain 10.6. (1994). https://unesdoc.unesco.org/ark:/48223/pf0000098427
  2. Pribeanu, C.: Large-scale accessibility evaluation of Romanian municipal websites. Int. J. User - Syst. Interact. 12, 83–98 (2019)
  3. Karhu, M., Hilera, J.R., Fernández, L., Ríos, R., (2012) Accessibility and readability of university websites in Finland. J. Access. Des. All. 2 http://hdl.handle.net/2099/12842

Cited by

See all 29

Metadata

Authors
Laamanen, M., Ladonlahti, T., Puupponen, H., & Kärkkäinen, T.
Affiliations
University of Jyväskylä (FI)
Corresponding author
Laamanen, Merja
Venue
Universal Access in the Information Society
Published
2022-11-14
Volume
23
Issue
1
Pages
475-491
ISSN
  • 1615-5289 (ISSN-L)
  • 1615-5297
OpenAlex
W4308967537
Cited by
29
References
30
Citations by year
2026: 10 · 2025: 7 · 2024: 7 · 2023: 4 · 2022: 1
FWCI
12.78
Type
journal article
Language
en
Open access
Licence
Locations
  • Universal Access in the Information Society (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Jyväskylä University Digital Archive (University of Jyväskylä) (submittedVersion, cc-by)
Funders
  • Opetus- ja Kulttuuriministeriö
  • University of Jyväskylä
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Social Sciences › Education › Disability Education and Employment
Keywords
web accessibility, higher education institutions, landing pages, accessibility legislation, online learning, COVID-19 pandemic, accessibility errors, Finnish higher education, digital inclusion

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages. https://app.cochat.ai/papers/10.1007/s10209-022-00931-6
The paper
Laamanen, M., Ladonlahti, T., Puupponen, H., & Kärkkäinen, T. (2024). Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages. Universal Access in the Information Society. https://doi.org/10.1007/s10209-022-00931-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.