Intelligent Tutoring Systems: Why Teachers Abandoned a Technology Aimed at Automating Teaching Processes
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Expectations that technology will improve and streamline education are high. However, technology often introduces new problems. This study aims to explore the challenges mathematics teachers encounter when they implement a digital mathematics textbook with an integrated intelligent tutoring system. A formative intervention was conducted in a two-year project with 16 secondary school teachers. The method was based on activity theory and required the teachers to collaborate with researchers in analyzing their work activity when the new teaching tool was introduced. In this paper, we show that an intelligent tutoring system created systemic contradictions for the teachers. Those contradictions involved predictability, division of labor, individual versus collective learning, accountability, and expectations versus experience. The teachers all tried to resolve the contradictions, but eventually felt compelled to abandon the intelligent tutoring system. The findings contribute to a better understanding of teachers’ responses to a technology aimed at automating teaching processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Acting with technology: Activity theory and interaction design
Kaptelinin, V., & Nardi, B. (2007) · First Monday · doi:10.5210/fm.v12i4.1772 · Cited by 1,647
Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
Intelligent tutoring systems and learning outcomes: A meta-analysis
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014) · Journal of Educational Psychology · doi:10.1037/a0037123 · Cited by 840 · cited 3×
“The literature reports the benefits of using intelligent tutoring systems in education [19, 20, 21].”
BackgroundStupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425 · cited 1×
“As such, they must have access to expert knowledge, and the topic to be taught needs to be appropriate for approaches supported by rule-based systems [27, 6].”
BackgroundContinued Progress: Promising Evidence on Personalized Learning
Pane, J., Steiner, E., Baird, M., & Hamilton, L. (2015) · doi:10.7249/rr1365 · Cited by 360
Virkkunen, J., & Newnham, D. S. (2013) · doi:10.1007/978-94-6209-326-3 · Cited by 245
“Intelligent tutoring systems,”
Graesser, A. C., Hu, X., & Sottilare, R. (2018) · International Handbook of the Learning Sciences · doi:10.4324/9781315617572-24 · Cited by 182
Hrastinski, S., Olofsson, A. D., Arkenback, C., Ekström, S., Ericsson, E., Fransson, G., Jaldemark, J., Ryberg, T., Öberg, L.-M., Fuentes, A., et al. (2019) · Postdigital Science and Education · doi:10.1007/s42438-019-00046-x · Cited by 145 · cited 1×
“[40], there is no common understanding of what intelligent systems can provide and how they can best be used.”
BackgroundA meta-analysis of the effectiveness of ALEKS on learning
Fang, Y., Ren, Z., Hu, X., & Graesser, A. C. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1495829 · Cited by 79 · cited 2×
“differences were found among educational levels in mathematics [24], but when the analyses included”
BackgroundAdaptive Intelligent Learning Environments
Herder, E., Sosnovsky, S., & Dimitrova, V. (2017) · Technology Enhanced Learning · doi:10.1007/978-3-319-02600-8_10 · Cited by 38
Cited by
Kim, J., Lee, H., & Cho, Y. H. (2022) · Education and Information Technologies · doi:10.1007/s10639-021-10831-6 · Cited by 669
Artificial Intelligence in Education (AIEd): a high-level academic and industry note 2021
Chaudhry, M. A., & Kazim, E. (2022) · AI and Ethics · doi:10.1007/s43681-021-00074-z · Cited by 425
Kawakami, A., Coston, A., Zhu, H., Heidari, H., & Holstein, K. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642849 · Cited by 54
“For example, AI design concepts have often been conceived in isolation from workers’ actual decision-making tasks and challenges, leading to AI deployments that are not actually viable in practice [26, 31, 62, 67, 68].”
BackgroundPack, A., Hartshorn, K. J., Escalante, J., & Gillette, N. (2025) · International Journal of English for Academic Purposes: Research and Practice · doi:10.3828/ijeap.2025.2 · Cited by 3
Metadata
- Authors
- Utterberg Modén, M., Tallvid, M., Lundin, J., & Lindström, B.
- Venue
- Proceedings of the Annual Hawaii International Conference on System Sciences
- Published
- 2021
- ISSN
- 1530-1605 (ISSN-L)
- 2572-6862
- OpenAlex
- W3127128771
- Cited by
- 40
- References
- 13
- FWCI
- 3.46
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.