Examining the applications of intelligent tutoring systems in real educational contexts: A systematic literature review from the social experiment perspective
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Intelligent Tutoring Systems (ITSs) have a great potential to effectively transform teaching and learning. As more efforts have been put on designing and developing ITSs and integrating them within learning and instruction, mixed types of results about the effectiveness of ITS have been reported. Therefore, it is necessary to investigate how ITSs work in real and natural educational contexts and the associated challenges of ITS application and evaluation. Through a systematic literature review method, this study analyzed 40 qualified studies that applied social experiment methods to examine the effectiveness of ITS during 2011–2022. The obtained results highlighted a complicated landscape regarding the effectiveness of ITS in real educational contexts. Specifically, there was an “intelligent” regional gap regarding the distribution of countries where ITS studies using social experiment methods were conducted. Compared to learning performance, relatively less attention was paid to investigating the impact of ITS on non-cognitive factors, process-oriented factors, and social outcomes, calling for more research in this regard. Considering the complexities and challenges existing in real educational fields, there was a lack of scientific rigor in terms of experimental design and data analysis in some of the studies. Based on these findings, suggestions for future study and implications were proposed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 3×
“Artificial Intelligence (AI) in Education is an emerging and booming field (Zawacki-Richter et al., 2019), where one form of its disruptive and transformative application is Intelligent Tutoring Systems (ITSs).”
BackgroundInfluentialIntelligent tutoring systems and learning outcomes: A meta-analysis
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014) · Journal of Educational Psychology · doi:10.1037/a0037123 · Cited by 840 · cited 5×
“…student diagnose module which collects and updates the information about students’ knowledge, skills, behaviors, responses, learning styles, etc. (Ma et al., 2014); (3) instructional module which focuses on the strategies and methods of teaching and delivering customized learning content…”
BackgroundMethodResultInfluentialHow to write a systematic review
Harris, J. D., Quatman, C. E., Manring, M. M., Siston, R. A., & Flanigan, D. C. (2014) · The American Journal of Sports Medicine · doi:10.1177/0363546513497567 · Cited by 606
Mousavinasab, E., Zarifsanaiey, N., R. Niakan Kalhori, S., Rakhshan, M., Keikha, L., & Ghazi Saeedi, M. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2018.1558257 · Cited by 605
Intelligent tutoring systems: an overview
Nwana, H. (1990) · Artificial Intelligence Review · doi:10.1007/bf00168958 · Cited by 531
Effectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317 · cited 4×
“For attitude and confidence in math learning, Pane et al. (2014) reported that ITS did not have any significant effect.”
BackgroundInfluentialNye, B. D. (2015) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0028-6 · Cited by 259
Intelligent tutoring systems for programming education: a systematic review
Crow, T., Luxton-Reilly, A., & Wuensche, B. (2018) · Proceedings of the 20th Australasian Computing Education Conference · doi:10.1145/3160489.3160492 · Cited by 166
Enhancing learning outcomes through self-regulated learning support with an Open Learner Model
Long, Y., & Aleven, V. (2017) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-016-9186-6 · Cited by 95
Using AI to Teach AI: Lessons from an Online AI Class
Goel, A. K., & Joyner, D. A. (2017) · AI Magazine · doi:10.1609/aimag.v38i2.2732 · Cited by 75 · cited 3×
“A lack of available time for an experiment is also an issue (Bartelet et al., 2016; Goel & Joyner, 2017; Wetzel et al., 2017) that hinders the conducted studies from having long-term evidence (Kegel & Bus, 2012).”
Background
Cited by
Digital learning in the 21st century: trends, challenges, and innovations in technology integration
Zou, Y., Kuek, F., Feng, W., & Cheng, X. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1562391 · Cited by 274
Sun, D., Boudouaia, A., Zhu, C., & Li, Y. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00446-5 · Cited by 190
Rawas, S. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00118-3 · Cited by 119
“Intelligent teaching systems are yet another advancement in educational AI [25].”
Malik, A., Khan, M. L., & Hussain, K. (2023) · doi:10.2139/ssrn.4413516 · Cited by 59
Malik, A., Khan, M. L., Hussain, K., Qadir, J., & Tarhini, A. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2409407 · Cited by 57
“Integrating AI into education has the potential to significantly improve educational outcomes, student engagement, and motivation (Wang et al., 2023).”
Metadata
- Authors
- Wang, H., Tlili, A., Huang, R., Cai, Z., Li, M., Cheng, Z., Yang, D., Li, M., Zhu, X., & Fei, C.
- Venue
- Education and Information Technologies
- Published
- 2023-01-07
- Volume
- 28
- Issue
- 7
- Pages
- 9113-9148
- ISSN
- 1360-2357 (ISSN-L)
- 1573-7608
- OpenAlex
- W4313679993
- Cited by
- 145
- References
- 13
- FWCI
- 4.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Examining the applications of intelligent tutoring systems in real educational contexts: A systematic literature review from the social experiment perspective. https://app.cochat.ai/papers/10.1007/s10639-022-11555-x
- The paper
- Wang, H., Tlili, A., Huang, R., Cai, Z., Li, M., Cheng, Z., Yang, D., Li, M., Zhu, X., & Fei, C. (2023). Examining the applications of intelligent tutoring systems in real educational contexts: A systematic literature review from the social experiment perspective. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11555-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.