The effectiveness of intelligent tutoring systems on K‐12 students' reading comprehension: A meta‐analysis
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
This meta‐analysis examined the effectiveness of improving reading comprehension for students in K‐12 classrooms using intelligent tutoring systems (ITSs), a computer‐based learning environment that provides customizable and immediate feedback to the learner. Nineteen studies from 13 publications incorporating approximately 10 000 students were included in the final analysis; using robust variance estimation to account for statistical dependencies, the 19 studies yielded 88 effect size estimates. The meta‐analysis indicated that the overall random effect size of ITSs on reading comprehension was 0.60 (using a mix of standardized and researcher‐designed measures) with a 95% confidence interval 0.36 to 0.85 ( p < 0.001). This review confirms previous studies comparing ITSs to human tutoring: ITSs produced a small effect size when compared to human tutoring (0.20, 0.02–0.38, p = 0.036, n = 21). All comparisons to human tutoring used standardized measures. This review also found that ITSs produced a larger effect size on reading comprehension when compared to traditional instruction (0.86) for mixed measures and (0.26) for standardized measures. These findings may be of interest to practitioners and policy makers seeking to improve reading comprehension using consistent and accessible ITSs. Recommendations for researchers include conducting studies to understand the difference between traditional and updated versions of ITSs and employing valid and reliable standardized tests and researcher‐designed measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982
Handbook of Research on Educational Communications and Technology
(2014) · doi:10.1007/978-1-4614-3185-5 · Cited by 1,475
Educational Outcomes of Tutoring: A Meta-analysis of Findings
Cohen, P. A., Kulik, J. A., & Kulik, C.-L. C. (1982) · American Educational Research Journal · doi:10.3102/00028312019002237 · Cited by 1,138
Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
Chi, M. T. H., Siler, S. A., Jeong, H., Yamauchi, T., & Hausmann, R. G. (2001) · Cognitive Science · doi:10.1207/s15516709cog2504_1 · Cited by 855
Intelligent tutoring systems and learning outcomes: A meta-analysis
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014) · Journal of Educational Psychology · doi:10.1037/a0037123 · Cited by 840
Cited by
Liang, J.-C., Hwang, G.-J., Chen, M.-R. A., & Darmawansah, D. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1958348 · Cited by 378
“…at three vertices through the triangular framework Tang et al. (2021) AIED bibliometric 86 1998–2019 The publishing model of AI in E-learning research Xu et al. (2019) AILEd meta-analysis 19 2000–2017 The effectiveness of improving reading comprehension for students in K-12 classrooms using…”
InfluentialAI and English language teaching: Affordances and challenges
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13460 · Cited by 282
Mustafa, M. Y., Tlili, A., Lampropoulos, G., Huang, R., Jandrić, P., Zhao, J., Salha, S., Xu, L., Panda, S., Kinshuk, et al. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00350-5 · Cited by 235
Understanding User Trust in Artificial Intelligence-Based Educational Systems: Evidence from China
Qin, F., Li, K., & Yan, J. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.12994 · Cited by 204
Jiang, R. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1049401 · Cited by 181
“, 2018) and reading comprehension (Xu et al., 2019).”
Background
Metadata
- Authors
- Xu, Z., Wijekumar, K. (., Ramirez, G., Hu, X., & Irey, R.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2019-03-05
- Volume
- 50
- Issue
- 6
- Pages
- 3119-3137
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W2918492595
- Cited by
- 143
- References
- 15
- FWCI
- 3.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effectiveness of intelligent tutoring systems on K‐12 students' reading comprehension: A meta‐analysis. https://app.cochat.ai/papers/10.1111/bjet.12758
- The paper
- Xu, Z., Wijekumar, K. (., Ramirez, G., Hu, X., & Irey, R. (2019). The effectiveness of intelligent tutoring systems on K‐12 students' reading comprehension: A meta‐analysis. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12758
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.