The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
A meta-analysis of the effectiveness of intelligent tutoring systems on K–12 students’ mathematical learning.
Abstract
In this study, we meta-analyzed empirical research of the effectiveness of intelligent tutoring systems (ITS) on K–12 students’ mathematical learning. A total of 26 reports containing 34 independent samples met study inclusion criteria. The reports appeared between 1997 and 2010. The majority of included studies compared the effectiveness of ITS with that of regular classroom instruction. A few studies compared ITS with human tutoring or homework practices. Among the major findings are (a) overall, ITS had no negative and perhaps a small positive effect on K–12 students’ mathematical learning, as indicated by the average effect sizes ranging from g = 0.01 to g = 0.09, and (b) on the basis of the few studies that compared ITS with homework or human tutoring, the effectiveness of ITS appeared to be small to modest. Moderator analyses revealed 2 findings of practical importance. First, the effects of ITS appeared to be greater when the interventions lasted for less than a school year than when they lasted for 1 school year or longer. Second, the effectiveness of ITS for helping students drawn from the general population was greater than for helping low achievers. This finding draws attentions to the issue of whether computerized learning might contribute to the achievement gap between students with different achievement levels and aptitudes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Steenbergen-Hu and Cooper (2013) found no difference in the effect of intelligent tutoring systems based on whether the assessments were course-related data, researcher-made tests, or standardized tests.”
From Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education (2017) · cites this paper as Steenbergen-Hu and Cooper (2013)
Citations
Cites
The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734 · cited 2×
“Although not as effective as what Bloom (1984) found, a recent meta-review by VanLehn (2011) found that human tutoring had a positive impact of d 0.79 on students’ learning.”
InfluentialVanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011) · Review of Educational Research · doi:10.3102/0034654310393361 · Cited by 1,029
“Intelligent tutoring systems,”
Graesser, A. C., Hu, X., & Sottilare, R. (2018) · International Handbook of the Learning Sciences · doi:10.4324/9781315617572-24 · Cited by 182
Flagged first, then by citations
Cited by
Sorted by citations
Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
Intelligent tutoring systems and learning outcomes: A meta-analysis
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014) · Journal of Educational Psychology · doi:10.1037/a0037123 · Cited by 840
Hillmayr, D., Ziernwald, L., Reinhold, F., Hofer, S. I., & Reiss, K. M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103897 · Cited by 574
Artificial Intelligence in Education (AIEd): a high-level academic and industry note 2021
Chaudhry, M. A., & Kazim, E. (2022) · AI and Ethics · doi:10.1007/s43681-021-00074-z · Cited by 425
Steenbergen-Hu, S., & Cooper, H. (2014) · Journal of Educational Psychology · doi:10.1037/a0034752 · Cited by 355
“Steenbergen-Hu and Cooper (2013) generated the overall effect sizes from 31 studies that compared ITS with regular classroom instruction.”
Self-citationSynthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education
Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017) · Review of Educational Research · doi:10.3102/0034654316670999 · Cited by 346
“…found varied average effects for intelligent tutoring systems, including ḡ = 0.41 among students of various levels (Ma et al., 2014), ḡ = 0.09 among K–12 students engaged in mathematics learning (Steenbergen-Hu & Cooper, 2013), and ḡ = 0.37 among college students (Steenbergen-Hu & Cooper, 2014).”
BackgroundMethodInfluentialKim, N. J., Belland, B. R., & Walker, A. E. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9419-1 · Cited by 220
Artificial Intelligence as an Effective Classroom Assistant
du Boulay, B. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.93 · Cited by 213
Fontaine, G., Cossette, S., Maheu-Cadotte, M.-A., Mailhot, T., Deschênes, M.-F., Mathieu-Dupuis, G., Côté, J., Gagnon, M.-P., & Dubé, V. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025252 · Cited by 193
Guo, L., Wang, D., Gu, F., Li, Y., Wang, Y., & Zhou, R. (2021) · Asia Pacific Education Review · doi:10.1007/s12564-021-09697-7 · Cited by 124
Bang, H. J., Li, L., & Flynn, K. (2023) · Early Childhood Education Journal · doi:10.1007/s10643-022-01332-3 · Cited by 91
Chow, J. C., & Ekholm, E. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9437-7 · Cited by 80
A meta-analysis of the effectiveness of ALEKS on learning
Fang, Y., Ren, Z., Hu, X., & Graesser, A. C. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1495829 · Cited by 79
Park, H., & Ahn, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642785 · Cited by 84
Ran, H., Kim, N. J., & Secada, W. G. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12611 · Cited by 69
Wen, F., Li, Y., Zhou, Y., An, X., & Zou, Q. (2024) · Journal of Educational Technology Development and Exchange · doi:10.18785/jetde.1701.07 · Cited by 39
“This imbalance poses risks and challenges to education such as AI inducing negative emotions such as anxiety and burnout in learners (Steenbergen-Hu & Cooper, 2013) and diminished students’ initiative (Miao et al., 2021).”
BackgroundGupta, S., Ojeh, N., Sa, B., Majumder, M. A. A., Singh, K., & Adams, O. P. (2020) · Advances in Medical Education and Practice · doi:10.2147/amep.s267834 · Cited by 23
The Effects of ALEKS on Mathematics Learning in K-12 and Higher Education: A Meta-Analysis
Sun, S., Else-Quest, N. M., Hodges, L. C., French, A. M., & Dowling, R. (2021) · Investigations in Mathematics Learning · doi:10.1080/19477503.2021.1926194 · Cited by 23
Mentigo: An Intelligent Agent for Mentoring Students in the Creative Problem Solving Process
Zha, S., Liu, Y., Zheng, C., Xu, J., Yu, F., Gong, J., & Xu, Y. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713952 · Cited by 19
“Tutors focus on helping students master specific academic content or skills and facilitate an effective learning environment within small groups [21].”
Generative AI and Higher Education Assessments: A Competency-Based Analysis
Tenakwah, E. S., Boadu, G., Tenakwah, E. J., Parzakonis, M., Brady, M., Kansiime, P., Said, S., Ayilu, R., Radavoi, C., & Berman, A. (2023) · doi:10.21203/rs.3.rs-2968456/v1 · Cited by 11
Metadata
- Authors
- Steenbergen-Hu, S., & Cooper, H.
- Venue
- Journal of Educational Psychology
- Published
- 2013-11
- Volume
- 105
- Issue
- 4
- Pages
- 970-987
- ISSN
- 1939-2176
- 0022-0663
- Cited by
- 175
- References
- 4
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review