The causal relationship between digital literacy and students’ academic achievement: a meta-analysis
Open accessThe DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index; 3 of the 18 sources its claims cite were checked for support.
Abstract
This meta-analysis focuses on the relationship between digital literacy (DL) and academic achievement. The 35 independent effect sizes that were collected were analyzed using Comprehensive Meta-analysis (CMA) software version 2.0, and the results showed a significant, medium positive correlation between DL and academic achievement. In addition, there were significant differences in the correlation between DL and academic achievement among students of different grade levels, orientations of DL, subjects, sampling methods, and genders. We suggest that (1) schools should develop students’ DL by strengthening the construction of a digital learning environment; (2) teachers and parents should give more guidance to primary and middle school students on the application of digital tools, making them aware of the advantages and disadvantages of digital technology for learning; and (3) students should have general digital operation skills and further master the special methods and learning models of digital technology applied to different subjects. Finally, although the relationship between DL and academic achievement was moderated by gender, with a stronger link observed in males than females, there are no full gender ratios of participants from the samples. Therefore, the relationship between DL and achievement across genders needs to be further verified in future research.
Overview
CoChat Summary
TL;DR
This meta-analysis found a significant medium positive association between digital literacy and students’ academic achievement across 35 effect sizes from 33 articles. The relationship varied by grade level, digital literacy orientation, subject, sampling method, and gender.
Key findings
- Across 35 effect sizes from 33 articles and 48,115 participants, the random-effects meta-analysis found a medium positive correlation between digital literacy (DL) and academic achievement: r = 0.240, z = 10.060, p < 0.001, 95% CI = 0.194 to 0.284.
- The association differed by grade level: primary school r = 0.166, middle school r = 0.065, high school r = 0.301, and college r = 0.268; the paper says the strongest correlation was for high school students.
- The association differed by DL orientation: Comprehensive Literacy r = 0.278 vs Technological Skills r = 0.186.
- The association differed by subject and sampling method: Math r = 0.267, Other r = 0.262, Language Arts r = 0.238, Computer Science r = 0.232, Social Science r = 0.218, and Natural Science r = 0.077; convenience sampling r = 0.251 vs random sampling r = 0.214.
- Gender moderated the relation, with a stronger link in males than females; the paper reports male sample r = 0.522 and female sample r = -0.046 in the meta-regression table/text.
Methods
- Meta-analysis of studies on DL and academic achievement; studies were searched in Springer, Taylor & Francis, ScienceDirect, EBSCO, Web of Science, and Google Scholar using keywords related to digital literacy and student achievement.
- Inclusion criteria required studies on the DL–achievement relationship that reported assessment tools and methods and provided Pearson r or t/F values convertible to r; only English-language articles were included.
- Data were coded for author/year, sample size, male/female proportion, grade level, DL orientation, subject, and sampling method, and analyzed with Comprehensive Meta-Analysis (CMA) version 2.0 using a random-effects model because heterogeneity was high (Q = 775.177, df = 34, p < 0.001; I² = 95.614%).
Limitations
- The paper states it only analyzed five moderating variables (grade, orientation of DL, subject, sampling method, gender), and notes that other variables, such as teaching styles, may also affect the relationship.
- The paper states that including only English-language articles may have narrowed the scope and neglected some cultures; it calls for future analysis of other languages.
- Evident from the text: the meta-analysis had high heterogeneity (I² = 95.614%), meaning the pooled estimate combines quite diverse studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 0 Not valid · 10 Not checked · 53 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Convenience sampling is often limited to speci fi c regions or groups (Obilor, 2023; Penn et al. 2023)”
What the sources say
- Not matchedcites Obilor, 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Penn et al. 2023 source
The 'Implementation and adjustment of probability and non-probability samples' section states that non-probability/convenience sampling arises where there is no clear sample frame or limited resources, and that 'in smaller or localized studies, participation occurs typically as a function of convenient location or accessibility to the researcher,' with 'its high likelihood of bias to a population frame' as the primary disadvantage. The Discussion (regional, state, or local projects being the context where representative samples are unaffordable and convenience samples are relied upon) and the Sample description and comparison section (their convenience sample over-sampling Alabama, Louisiana and Mississippi and under-sampling Florida and Texas) illustrate the same point. The claim is a broad background statement and our copy treats convenience sampling that way. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“On the whole, the results indicated that DL could in fl uence academic achievement in most subjects and con fi rmed that DL plays a key role in most aspects of learning in a digital environment (Gómez-Galán et al. 2021).”
What the sources say
- Partly supportedcites Gómez-Galán et al. 2021 sourceExperimental — accuracy not yet measured
The Introduction (pp. 1–2) describes digital skills as critical to university training and digital literacy as a determining factor in it. That supports the broad importance of digital literacy, but the cited passages do not establish the citing sentence’s stronger claim that the paper’s results confirmed its role in most aspects of learning or its influence on achievement in most subjects. (LLM, conf=0.83)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“there were significant differences in the correlation between DL and academic achievement among students of different grade levels, orientations of DL, subjects, sampling methods, and genders.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results of the random-effects model indicated that there was a signi fi cant medium positive correlation between DL and academic achievement ( r = 0.240, z = 10.060, p < 0.001, k = 35, 95% CI = 0.194, 0.284).”
- Also stated in: § Discussion · plain
“We found a medium positive correlation between students ' DL and academic achievement.”
plainstates an associationn = 48,115- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Discussion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“there were significant differences in the correlation between DL and academic achievement among students of different grade levels, orientations of DL, subjects, sampling methods, and genders.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
39 more claims
Create a free account to see all 66 claims and to verify the 5 references still open.
- It may state two separate claims as one. 8
- Probably not a substantial claim. 16
Citations
Cites
Assessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256 · cited 1×
“I 2 = 95.614%, which is larger than 75%, indicating a high degree of heterogeneity (Huedo-Medina et al. 2006).”
InfluentialParental Involvement and Students' Academic Achievement: A Meta-Analysis
Fan, X., & Chen, M. (2001) · Educational Psychology Review · doi:10.1023/a:1009048817385 · Cited by 2,648 · cited 1×
“For instance, Fan and Chen (2001) adopted Cohen ’ s classi fi cation to explore the relationship between parental involvement and students ’ academic achievement.”
The relation between 21st-century skills and digital skills: A systematic literature review
van Laar, E., van Deursen, A. J. A. M., van Dijk, J. A. G. M., & de Haan, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.010 · Cited by 2,006 · cited 1×
“Individuals with DL can engage in activities and interactions in digital environments as well as ef fi ciently and freely access the knowledge present in these environments (Pangrazio et al. 2020; Van Laar et al. 2017).”
Can we teach digital natives digital literacy?
Ng, W. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.04.016 · Cited by 1,621 · cited 1×
“On the other hand, Comprehensive Literacy is more integrated and focuses on the pedagogical area of DL — for example, the integration of technical, cognitive, and social-emotional dimensions (Eshet, 2012; Ng, 2012).”
The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research
Wisniewski, B., Zierer, K., & Hattie, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03087 · Cited by 1,199 · cited 1×
“Meta-analysis is a further statistical analysis of existing research results in a certain research fi eld, aiming to integrate previous fi ndings (Hedges and Olkin, 2014) to obtain more comprehensive research results (Wisniewski et al. 2020).”
Timotheou, S., Miliou, O., Dimitriadis, Y., Sobrino, S. V., Giannoutsou, N., Cachia, R., Monés, A. M., & Ioannou, A. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11431-8 · Cited by 816 · cited 1×
“ith the rapid advancement and wide application of various information and communication technologies, society has become a technologically rich digital (Bilan et al. 2023; Timotheou et al. 2023; Jiang et al. 2024; Islam et al. 2024; Longwei et al. 2023).”
Hew, K. F., & Cheung, W. S. (2010) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2008.00900.x · Cited by 581
Activity Achievement Emotions and Academic Performance: A Meta-analysis
Camacho-Morles, J., Slemp, G. R., Pekrun, R., Loderer, K., Hou, H., & Oades, L. G. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09585-3 · Cited by 475 · cited 1×
“Therefore, there still is theoretical and practical signi fi cance in exploring the factors that lead to differences in academic achievement (Camacho-Morles et al. 2021).”
Digital Learning and Digital Institution in Higher Education
Alenezi, M. (2023) · Education Sciences · doi:10.3390/educsci13010088 · Cited by 376 · cited 1×
“Educational settings are also being changed by advanced digital technology, and a variety of digital teaching and learning modes have been devised (Alenezi, 2023; Hakimi et al. 2024).”
Thinking in the Digital Era: A Revised Model for Digital Literacy
Eshet-Alkalai, Y. (2012) · Issues in Informing Science and Information Technology · doi:10.28945/1621 · Cited by 364
Research works printed but not linked: 21
- Brown M (2018) The challenge of digital literacy: beyond narrow skills to critical mindsets (Junhong Xiao trans). Distance Educ China 4:42–53
- Díaz LMB, Cano EV (2019) Effects on academic performance in secondary students according to the use of ICT. Int J Educ Res Innov 12:90–108
- Falode OC, Shittu TA, Gambari AI, Falode ME (2017) Relationship between students’ ICT background exposure, access to ICT learning facilities and academic achievement in undergraduate educational technology programme. Int J Innov Technol Integr Educ 1(1):127–134
- Gelen İ (2017) P21-21st century skill frameworks in curriculum and instruction (USA practices). J Interdiscip Educ Res 1:15–29
- He J, Freeman LA (2010) Are men more technology-oriented than women? The role of gender on the development of general computer self-efficacy of college students. J Inf Syst Educ 21(2):203–212
- Hedges LV, Olkin I (2014) Statistical methods for meta-analysis. Academic press
- Irvin R (2007) Information and communication technology (ICT) literacy: Integration and assessment in higher education. J Syst Cybern Inform 5(4):50–55
- Kaeophanuek S, Na-Songkhla J, Nilsook P (2018) How to enhance digital literacy skills among information sciences students. Int J Inf Educ Technol 8(4):292–297
- Kim E, Jung J (2022) Exploring the digital literacy-related experiences of elementary school students engaged in distance learning. J Educ Cult 28:431–449
- Lee J (2015) The mediating role of self-regulation between digital literacy and learning outcomes in the digital textbook for secondary school. Educ Technol Int 16(1):58–83
- Lipsey MW, Wilson DB (2001) Practical meta-analysis. SAGE Publications, Inc
- Mukhlibaev M (2024) Theoretical analysis of the problem of Develo** technical creativity of gifted studentsin teaching technology Science Promotion 9(1):83–90
- Obilor EI (2023) Convenience and purposive sampling techniques: are they the same. Int J Innov Soc Sci Educ Res 11(1):1–7
- Pala SM, Basibuyuk A (2020) 10–12 Yas Grubu Ogrencileri Icin Dijital Okuryazarlik Olcegi Gelistirme Calismasi. Mediterr J Educ Res 14(33):542–565
- Palacios Garay JP, Fuster Guillen DE, Rodríguez Barboza JR, Ávila Sánchez GA, Fernández Díaz CM (2021) University digital literacy in engineering students times of pandemic. Nexo Sci J 34(06):1562–1574
- Sabir N, Naureen S (2017) Impact of ICT on academic achievement of government secondary school students in Quetta city (Chiltan town). Balochistaniyat 6(1):23–35
- Santos GM, Ramos EM (2019) ICT literacy and school performance. Turk Online J Educ Technol 18(2):19–39
- Tang CM, Chaw LY (2016) Digital literacy: a prerequisite for effective learning in a blended learning environment? Electron J E-Learn 14(1):54–65
- York TT, Gibson C, Rankin S (2015) Defining and measuring academic success. Pract Assess Res Eval 20(5):1–20. https://scholarworks.umass.edu/pare/vol20/iss1/5
- Yuki LK (2021) The influence of literature digitalization ability and willingness to develop on student achievement of the Faculty of Applied Technology UNSUR. Paper presented at the International Conference on Education of Suryakancana, Indonesia
- Ziya E, Dogan N, Kelecioglu H (2010) What is the predict level of which computer using skills measured in PISA for achievement in mathematics. Turk Online J Educ Technol 9(4):185–191
Cited by
Cui, Y., Bao, H., Wen, K., & Wen, H. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13872-6 · Cited by 13
“Digital literacy refers specifically to cognitive and technical capabilities for effective technology use [31].”
Yao, Y., Cao, J., Tan, Z., & Chen, K. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1634261 · Cited by 5
“It encompasses a wide range of aspects such as access to digital information, evaluation, management, and security awareness, and it is a way to safeguard the needs of a digital life, enjoy the convenience of digital society, and the basic ability to integrate into digital society (47).”
Digital literacy and ICT use: key predictors of mathematics achievement in schoolchildren
Caponera, E., Colonnello, V., Annunziata, F., Palmerio, L., & Russo, P. M. (2026) · European Journal of Psychology of Education · doi:10.1007/s10212-025-01055-0 · Cited by 8
“More recently, Li et al. (2025) conducted a meta-analysis showing a medium positive correlation between students’ academic achievement and digital literacy that was measured by self-reported not objective measures in the great majority of the studies.”
Rahmanov, F., Ganiyeva, S. A., Aliyeva, N., et al. (2025) · Problems and Perspectives in Management · doi:10.21511/ppm.23(2).2025.46 · Cited by 3
Spor Bilimleri Fakültesi Öğrencilerinin Dijital Okuryazarlık Düzeylerinin İncelenmesi
Birlik, A., & Yaraş, A. (2025) · Yeni Medya Dergisi · doi:10.55609/yenimedya.1636701 · Cited by 6
Metadata
- Authors
- Li, F., Cheng, L., Wang, X., Shen, L., Ma, Y., & Islam, A. Y. M. A.
- Affiliations
- East China Normal University (CN)
- Jiangsu University (CN)
- Corresponding author
- Islam, A. Y. M. Atiquil
- Venue
- Humanities and Social Sciences Communications
- Published
- 2025-01-30
- Volume
- 12
- Issue
- 1
- ISSN
- 2055-1045 (ISSN-L)
- 2662-9992
- OpenAlex
- W4406984661
- Cited by
- 38
- References
- 74
- Citations by year
- 2026: 30 · 2025: 8
- FWCI
- 5.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor)
- Locations
- Humanities and Social Sciences Communications (publishedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Digital literacy in education
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Social Sciences › Education › Literacy, Media, and Education
- Keywords
- digital literacy, academic performance, students, digital learning environments, digital technology in education, gender differences, primary and middle school students, digital skills
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The causal relationship between digital literacy and students’ academic achievement: a meta-analysis. https://app.cochat.ai/papers/10.1057/s41599-025-04399-6
- The paper
- Li, F., Cheng, L., Wang, X., Shen, L., Ma, Y., & Islam, A. Y. M. A. (2025). The causal relationship between digital literacy and students’ academic achievement: a meta-analysis. Humanities and Social Sciences Communications. https://doi.org/10.1057/s41599-025-04399-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.