Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record, with a small difference in title or year; 94 of the 94 references it cites were found in a registry or an index; 7 of the 52 sources its claims cite were checked for support.

Do New Forms of Reading Pay Off? A Meta-Analysis on the Relationship Between Leisure Digital Reading Habits and Text Comprehension

Open access
Altamura, Lidia, Vargas, Cristina, Salmerón, Ladislao · 2025 · Review of Educational Research

Abstract

Previous research has evidenced a strong positive relationship between leisure print reading habits and reading comprehension across the lifespan. The rapid evolution of new forms of leisure digital reading could modify such a relationship. This meta-analysis extends previous research by analyzing the relationship between leisure digital reading habits and reading comprehension. We analyzed 40 effect sizes using multilevel analysis. Data involved 469,564 participants from studies published between 2000 and 2022. The average effect size reflects a small significant effect on reading comprehension (r = .055), which contrasts with the medium size effects found in the literature related to print reading habits and comprehension. This relationship is significantly moderated by the reader’s educational stage. At early stages (primary and middle school) negative relationships are observed between leisure digital reading and text comprehension, while at later stages (high school and university) the relationship turns positive. We highlight the different contributions that reading modalities and technological contexts have on our reading comprehension, especially across the lifespan. In sum, leisure digital reading does not seem to pay off in terms of reading comprehension, at least, as much as traditional print reading does.

Overview

CoChat Summary

TL;DR

This meta-analysis of 26 studies (40 effect sizes; 469,564 participants) found a small positive average association between leisure digital reading habits and reading comprehension (r = .055 after outlier removal), far smaller than print-reading associations. The association was moderated by educational stage, being negative in primary/middle school and positive in high school/university.

Key findings

  • Overall association was significant but small: r = .055, 95% CI [.003, .107], p = .03, k = 39, n = 25 after removing one influential outlier; prediction interval was -.18 to .29. Heterogeneity was high: Q(38) = 2591.93, p < .001; I² = 98.9.
  • Educational stage significantly moderated the effect (p = .047; R² = .57): middle school r = -.025, high school r = .085, primary/elementary r = -.095, undergraduate r = .070. Significant pairwise comparisons were middle vs. high school (p = .021) and primary vs. university (p = .030).
  • Type of digital reading habit was not a significant moderator (p = .18): social-communicative r = .03, linear-informative r = .12, mixed r = .03.
  • Data collection year was not significant in the main analysis (p = .121), but became significant when the outlier was included (b = -.014, 95% CI [-.27, -.001], p = .043). Publication bias was not indicated (Egger p = .427; published vs. unpublished p = .525).

Methods

  • Systematic search in Web of Science, Scopus, PsychInfo, and Eric, plus a PISA/PIRLS-specific search, reference checks, expert contact, and forward search; publication years restricted to 2000–2022. The search yielded 1,866 records, with 26 studies meeting inclusion criteria and 40 independent effect sizes from 469,564 participants.
  • Effect sizes were Pearson correlations, transformed to Fisher’s Z; a three-level random-effects multilevel meta-analysis used robust variance estimation (CR2), REML, and inverse-variance weighting, with multilevel meta-regressions for moderators and sensitivity/publication-bias analyses.
  • Sample average age was 15.9 years (range 9.9–72.5), 54.84% female; most participants were middle school (35.89%) or high school (35.89%) students; 66.67% of effect sizes came from non-probability samples; digital reading habits were mostly measured by questionnaire (97.37%) with closed-answer formats (97.7%); reliability was α = .77 for comprehension tests and α = .59 for habit questionnaires.

Limitations

  • The paper states that several studies came from the same research teams; most primary studies were cross-sectional, so correlations cannot inform causal effects; and most reading-habit measures were self-reports with closed-answer options, which may be biased and tied to measurement error.
  • The paper also states limitations from heterogeneous scales/instruments, aggregated means that do not reflect individual differences, pseudo R² instability when fewer than 40 studies are included, restriction to native-language assessments, exclusion of readers with learning difficulties or physical impairments, and a dependent variable focused on traditional linear text comprehension rather than digital hypertext/Internet documents.
  • Evident from the text: heterogeneity was very high (I² = 98.9) with a wide prediction interval, and some moderator categories were small (e.g., primary/elementary k = 2; undergraduate k = 6), limiting precision for moderator conclusions.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3102/00346543231216463

Cites

94 of 94 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 1 Not valid · 31 Not checked · 64 Own results and interpretations

35 more claims

Create a free account to see all 102 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 39
  • It may state two separate claims as one. 34
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 94 references

Research works printed but not linked: 20

  1. *Altamura L. (2019). Digital reading habits and reading comprehension. [Unpublished bachellor dissertation, University of Valencia]. https://go.uv.es/D4FyR5I
  2. Borenstein M., 2019, Common mistakes in meta-analysis and how to avoid them
  3. Chen J. L., 2010, 20th Annual meeting of the Society for Text & Discourse
  4. Cuetos E., 2014, Batería de evaluación de los procesos lectores, revisada (5a ed.) [Battery for the reading process assessment, reviewed (5th ed.)]
  5. Cuetos F., 2016, Batería de evaluación de los procesos lectores en secundaria y bachillerato, revisada [Battery for the reading process assessment in middle and high school, reviewed]
  6. Duchêne M. C. A., 2010, Protocole Emilie—Evaluation de la compréhension de textes chez les collégiens [Emilie protocol—Text comprehension assessment for secondary school students]
  7. Dunn L. M., 1970, Peabody individual achievement test
  8. García V. (2019). Construcción de mapas conceptuales navegables y comprensión lectora: análisis de procesos y diseño de instrucción [Navigable concept maps and Reading comprehension: process analysis and instruction design] [Doctoral dissertation, University of Valencia]. https://roderic.uv.es/handle/10550/70352
  9. *Heesbeen S.E.A., Schaars M.M.H. (2021). Leisure reading and reading comprehension: The moderating role of executive functions [Unpublished master’s thesis]. Utrecht University.
  10. Lerkkanen M. K., 2018, YKÄ—Luku- ja kirjoitustaidon arviointimenetelmä yläkouluun [YKÄ—Reading test for lower secondary school]
  11. Leslie L., 2001, Qualitative reading inventory
  12. Macmillan Test Unit, 2000, Group Reading Test II, 6–14
  13. National Assessment Program Literacy and Numeracy, 2013, NAPLAN achievement in Reading, Persuasive Writing, Language Conventions and Numeracy: National Report for 2013
  14. *Norris T. (2010). Adolescent academic achievement, bullying behavior, and the frequency of Internet use [Doctoral dissertation, Kent State University]. ProQuest Dissertations and Theses Global. https://www.proquest.com/docview/193947450
  15. *Park S., Weng W. (2020). The relationship between ICT-related factors and student academic achievement and the moderating effect of country economic index across 39 countries. Educational Technology & Society, 23(3), 1–15. https://bit.ly/3rVyTc2
  16. Stothard S. E., 2010, York assessment of reading for comprehension. Secondary test
  17. SweSAT-R, 2006, Swedish scholastic aptitude test reviewed
  18. Wiederholt J. L., 2000, Gray silent reading tests GSRT
  19. Wilkinson G. S., 1993, Wilmington, DE: Wide Range, Inc
  20. Wilkinson G. S., 2006, Lutz, FL: Psychological Assessment Resources

Cited by

See all 59

Metadata

Authors
Altamura, L., Vargas, C., & Salmerón, L.
Affiliations
Universitat de València (ES)
Corresponding author
Salmerón, Ladislao
Venue
Review of Educational Research
Published
2023-12-12
Volume
95
Issue
1
Pages
53-88
ISSN
  • 0034-6543 (ISSN-L)
  • 1935-1046
OpenAlex
W4389639978
Cited by
59
References
94
Citations by year
2026: 27 · 2025: 21 · 2024: 10 · 2023: 1
FWCI
3.63
Type
journal article
Language
en
Open access
Licence
  • cc-by-nc
  • journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Review of Educational Research (publishedVersion)
  • Repository of Digital Objects for Teaching Research and Culture (University of Valencia) (submittedVersion, cc-by-nc)
Funders
Ministerio de Ciencia e Innovación (PID2020-118512GB-I00)
Topics
  • Social Sciences › Education › Literacy and Educational Practices
  • Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
  • Social Sciences › Library and Information Sciences › Library Collection Development and Digital Resources
Keywords
reading for pleasure, digital reading, print reading, reading comprehension, reading habits, educational stages, lifespan development, e-books

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Do New Forms of Reading Pay Off? A Meta-Analysis on the Relationship Between Leisure Digital Reading Habits and Text Comprehension. https://app.cochat.ai/papers/10.3102/00346543231216463
The paper
Altamura, L., Vargas, C., & Salmerón, L. (2025). Do New Forms of Reading Pay Off? A Meta-Analysis on the Relationship Between Leisure Digital Reading Habits and Text Comprehension. Review of Educational Research. https://doi.org/10.3102/00346543231216463

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.