Recommendations for digital inclusion in the use of European digital public services
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index; 13 of the 93 sources its claims cite were checked for support.
Abstract
This study examines digital public services within the European Union, focusing on digital inclusion and the barriers preventing widespread e-government adoption. A significant knowledge gap exists in understanding the interaction between citizens and digital public services, particularly for vulnerable groups, and in evaluating the impact of regional and sector-specific factors. The research employs a mixed-methods approach, including a systematic review based on PRISMA methodology, a document analysis of the digital and programs of the European Union and the Member States, 33 semi-structured expert interviews, and a survey targeting Spanish intermediate leaders, to explore digital divides in access, skills, and outcomes. Key findings reveal that barriers such as limited digital skills, access to technology, and inadequate service design disproportionately affect the elderly, low-income populations, and those with minimal education. Eighteen recommendations have been proposed, associated to five indicators of the model proposed to evaluate the key dimensions of e- government adoption and digital inclusion: internet access, digital skills, user interaction, social drivers and barriers, and outcomes. The recommendations include, among others, enhancing digital skills through tailored training programs, involving the third sector, simplifying service interfaces, and promoting a hybrid service model combining digital and face-to-face options. The study also highlights gaps in addressing civic participation as part of e- government, suggesting it as a focus for future research. These findings underscore the need for user-centred, context-specific policies to ensure equitable access to digital public services and reduce digital exclusion.
Overview
CoChat Summary
TL;DR
This mixed-methods study examines digital inclusion in European digital public services and proposes 18 recommendations linked to five indicators of e-government adoption and digital inclusion. It finds that limited digital skills, access barriers, and poor service design disproportionately exclude older, low-income, and less-educated citizens, supporting tailored, user-centred, hybrid policies.
Key findings
- Barriers such as limited digital skills, access to technology, and inadequate service design disproportionately affect the elderly, low-income populations, and those with minimal education; digital skills emerge as a critical determinant of adoption. The study proposes 18 recommendations associated with five indicators: internet access, digital skills, user interaction, social drivers and barriers, and outcomes.
- The systematic review of 66 articles and document analysis of 25 documents from 19/28 countries found that policies focus more on digital inclusion than on e-government; education is crucial for bridging the divide; strategies rarely target individuals unwilling or unable to use digital services; only Ireland, Portugal, and Malta recognize broader stakeholder involvement, and only one Spanish region (Aragon) has a defined strategy for this.
- The 33 expert interviews and survey of 602 Spanish intermediate leaders identified privacy/data security (M = 4.34) and administrative language (M = 4.26) as top barriers; contacting a civil servant was the most challenging task (M = 3.69); support from civil servants was important (M = 4.04); affordable connectivity (M = 4.26), internet access (M = 4.17), digital skills training (M = 3.92), and local centres (M = 3.94) were prioritized over digital competence centres (M = 3.67).
- EU context reported: DESI 2024 gives an overall digital public services score of 79.4; 75% of European internet users interacted with public administration online; 55.56% of individuals aged 16–74 have at least basic digital skills, far from the 80% target for 2030. Recommendations include tailored training, third-sector involvement, simplified interfaces, and a hybrid digital/face-to-face service model; gaps in addressing civic participation are noted.
Methods
- Concurrent triangulation mixed-methods design: PRISMA systematic review (66 articles, 2011–2024, EU Member State, English/French/Spanish); document analysis of EU and Member State digital strategies (25 documents from 19/28 countries; Spanish NUTS2 regional strategies); 33 in-depth semi-structured expert interviews online between November 2022 and April 2023; and a survey of 602 Spanish intermediate leaders via online panel from 30 March to 11 April 2023, with an 89% response rate.
- Interviews were transcribed verbatim and coded with Atlas.ti (21:07:29 total analysed; average duration 38 min 25 s); the survey used Likert scales and proportional quota sampling by sex and age. Data were integrated and triangulated into five themes: state of digital public services in the EU, vulnerable groups, drivers, barriers, and measures. The model draws on TAM, UTAUT, DigComp 2.2, and the three-level digital divide, using indicators: internet access, digital skills, user interaction, social drivers and barriers, and outcomes.
Limitations
- Paper-stated: the recommendations are general guidelines and do not apply equally to all individuals, all government services, or different administrative levels; the study focuses only on interaction with digital public services, setting aside public participation in political and civic decision-making (e.g., e-voting, online forums, public consultations); and it did not focus on the school-age population or compulsory education content.
- Evident from the text: the expert sample is biased toward researchers (66%) and Spanish participants (63%); the survey is limited to Spanish intermediate leaders; and the document analysis excluded nine countries (Belgium, Czech Republic, Greece, Hungary, Latvia, Lithuania, Luxembourg, Poland, and Sweden).
- Evident from the text: sectoral analysis was unfeasible because most studies addressed general e-government services and no studies focused on education; both EU and Spanish strategies rely heavily on quantitative data, with limited evaluation of measures or inclusion of third-sector roles.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
11 Valid · 10 Not valid · 44 Not checked · 103 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Vulnerable groups, particularly older adults, individuals with lower educational attainment, and those from low-income households, are disproportionately affected and face signi fi cant barriers that perpetuate exclusion cycles (Belanger and Carter, 2009; Ragnedda et al. 2022).”
What the sources say
- Not checked — no full text of the sourcecites Belanger and Carter, 2009 source
- Supportedcites Ragnedda et al. 2022 source
The Conclusion and discussion identifies less-educated, older, and low-income users as especially at risk of a limited digital experience. It also describes interconnected digital divides that generate a vicious circle that may be difficult to break. Page numbers were not provided in our copy. (LLM, conf=0.94)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, there is a notable lack of qualitative research aimed at identifying the conditioning factors that in fl uence the uptake of digital public services.”
What the sources say
- Partly supportedcites Lindgren et al. 2019 sourceExperimental — accuracy not yet measured
The Introduction and background (page unavailable) says that studies of citizens’ willingness to adopt e-government services often ignore the context and diversity of those services. This supports a gap in adoption research, but the paper does not specifically identify a lack of qualitative research into factors conditioning uptake. (LLM, conf=0.83)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Evidence (Van Deursen and Helsper, 2015; Dobrolyubova, 2021; Ln ě ni č ka and Máchová, 2022) indicates that a techno-determinist approach focusing on infrastructure provision, which prioritizes infrastructure provision and technological advancements over social and cultural contexts, fails to accommodate individuals lacking digital skills, particularly those in vulnerable circumstances.”
What the sources say
- Not checked — no full text of the sourcecites Van Deursen and Helsper, 2015 source
- Partly supportedcites Dobrolyubova, 2021 sourceExperimental — accuracy not yet measured
In section 2.2 Dobrolyubova (2021) does criticise output-/infrastructure-centric approaches — the UN EGDI is 'significantly driven by dimensions related to ICT infrastructure rather than factors measuring the outcomes of government digitalization', and 'maintaining the current focus on output-level indicators ... does not allow for a timely identification of risks'; the Conclusions add that such imbalances make digital transformation 'a goal in itself rather than a means'. Section 3 and Table 1 likewise flag the unresolved digital divide, 'discrimination of vulnerable groups' and 'time and financial costs related to acquiring and developing digital skills', recommending measures with 'special attention to potentially vulnerable groups'. So the paper supports the general thrust (technology/infrastructure focus neglects social outcomes and risks excluding low-skill, vulnerable users), but it never uses or endorses a 'techno-determinist' label, frames the deficit as one of measurement/indicator design rather than of provision failing to accommodate individuals, and says nothing about prioritising technology over 'social and cultural contexts'. That specific framing is not attributable to this source. (LLM, conf=0.70)
- Not matchedcites Ln ě ni č ka and Máchová, 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The studies underscore a persistent social gap: those most in need of digital public services often fail to access them, necessitating policies to prevent social and digital exclusion.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Key barriers include sociodemographic factors such as age, education, and income, compounded by low digital and administrative literacy, limited technology access, and usability fl aws.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
52 more claims
Create a free account to see all 168 claims and to verify the 2 references still open.
- It may state two separate claims as one. 50
- Probably not a substantial claim. 83
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Gender balance was sought among the interviewees: 18 (55.5%) were male and 15 (45.5%) were females.”
Reported 55.5 · recomputed 54.545455
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Discussion · p. 9
“the language used by the public administration as a barrier was highly emphasized by the experts and rated highly by the intermediate leaders (M = 426).”
§ Discussion · p. 8
“the language used by public administration (M = 4.26)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Methods · p. 5
“a higher proportion of Spanish participants (63% of the sample)”
§ Methods · p. 6
“Country workplace | Spain | Finland Spain Spain The Netherlands | The Netherlands Poland Spain Finland EU Finland EU Spain Belgium United Kingdom Spain Spain Spain Spain Colombia Spain Spain United Kindgom Spain Spain Spain Spain Spain Spain Argentina Spain Spain Spain”
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 1×
“The preparation of a protocol is an essential component of the systematic review process because reduces arbitrary in decision making when extracting and using data from primary research (Moher et al. 2015).”
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617 · cited 1×
“There are no guidelines for data analysis, since it is a (Elo and Kyngäs, 2008).”
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · cited 2×
“…for assessing the usability and effectiveness of digital services, complements the perspective provided by the Information System Success Model (DeLone and McLean, 2003), which emphasizes attributes such as system quality, information quality, service quality, usage intentions, user…”
Scheerder, A., van Deursen, A., & van Dijk, J. (2017) · Telematics and Informatics · doi:10.1016/j.tele.2017.07.007 · Cited by 1,471 · cited 2×
“…and bene fi ts through the use of ICTs, such as improving education, health or socio-economic situation (Van Deursen and Helsper, 2015; Ragnedda, 2016; Scheerder et al. 2017), as well as fostering the ability to innovate and create products and services in the digital economy (Esteban-Navarro et…”
The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation
Frey, B. B. (2018) · doi:10.4135/9781506326139 · Cited by 1,471
The unified theory of acceptance and use of technology (UTAUT): a literature review
Williams, M. D., Rana, N. P., & Dwivedi, Y. K. (2015) · Journal of Enterprise Information Management · doi:10.1108/jeim-09-2014-0088 · Cited by 1,339
COVID-19 and digital inequalities: Reciprocal impacts and mitigation strategies
Beaunoyer, E., Dupéré, S., & Guitton, M. J. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106424 · Cited by 1,114 · cited 1×
“…worldwide increasingly implement digital public services and citizens must use them without an of fl ine choice, initial concerns about the potential impacts of the digital divide persist over time (Belanger and Carter, 2009; Hall and Owens, 2011; Zhao et al. 2014; Beaunoyer et al. 2020).”
Research works printed but not linked: 3
- Capgemini, Sogeti, IDC, Politecnico di Milano (2023). eGovernment Benchmark 2023: Connecting Digital Governments. Insight report. Publications Office of the European Union. https://doi.org/10.2759/474056 · doi:10.2759/474056
- European Commission, Joint Research Centre, Vuorikari R, Kluzer S, Punie Y (2022). DigComp 2.2, The Digital Competence framework for citizens: with new examples of knowledge, skills and attitudes. Publications Office of the European Union. https://data.europa.eu/doi/10.2760/115376 · doi:10.2760/115376
- Medina Molina C, Rey Moreno M, Rufín Moreno R (2012) Nivel de educación y adopción de e-servicios: una aplicación al caso del e-gobierno. Sociol Tecnocienc 2:22–43
Cited by
Social Inclusivity in the Smart City Governance: Overcoming the Digital Divide
Круглов, В. В., & Dvořák, J. (2025) · Sustainability · doi:10.3390/su17135735 · Cited by 43
Южаков, В. Н., Николаевич, П. А., Владимировна, З. Н., & Starostina, A. (2025) · Public Administration Issues · doi:10.17323/1999-5431-2025-0-4-7-33 · Cited by 5
Ortega, R. V., & Amaya, L. Y. (2025) · Revista Española de la Transparencia · doi:10.51915/ret.407 · Cited by 3
Financial support, sports venue investment, and public service improvement
Liu, T., Zhu, Q., Zhang, R., et al. (2025) · Finance research letters · doi:10.1016/j.frl.2025.108696 · Cited by 3
Tang, M., Li, M., & Xie, L. (2026) · Risk Analysis · doi:10.1111/risa.70254 · Cited by 1
Metadata
- Authors
- Morte-Nadal, T., & Esteban-Navarro, M. Á.
- Affiliations
- Universidad de Zaragoza (ES)
- ORCID
- Morte-Nadal, Tamara
- Venue
- Humanities and Social Sciences Communications
- Published
- 2025-02-28
- Volume
- 12
- Issue
- 1
- ISSN
- 2055-1045 (ISSN-L)
- 2662-9992
- OpenAlex
- W4408067630
- Semantic Scholar
- 2fa10e87856fdb23fa8d6532ca759cc00e5e0a24
- Cited by
- 30
- References
- 73
- Citations by year
- 2026: 23 · 2025: 7
- FWCI
- 111.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor)
- Locations
- Humanities and Social Sciences Communications (publishedVersion, cc-by-nc-nd)
- Zaguan (University of Zaragoza Repository) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- digital inclusion, e-government, digital public services, digital divide, vulnerable populations, digital skills, internet access, older adults, low-income populations, service design, user-centered design, hybrid service models, citizen participation, digital exclusion, EU digital policy, Spain
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Recommendations for digital inclusion in the use of European digital public services. https://app.cochat.ai/papers/10.1057/s41599-025-04576-7
- The paper
- Morte-Nadal, T., & Esteban-Navarro, M. Á. (2025). Recommendations for digital inclusion in the use of European digital public services. Humanities and Social Sciences Communications. https://doi.org/10.1057/s41599-025-04576-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.