Explanatory learner models: Why machine learning (alone) is not the answer
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Using data to understand learning and improve education has great promise. However, the promise will not be achieved simply by AI and Machine Learning researchers developing innovative models that more accurately predict labeled data. As AI advances, modeling techniques and the models they produce are getting increasingly complex, often involving tens of thousands of parameters or more. Though strides towards interpretation of complex models are being made in core machine learning communities, it remains true in these cases of “black box” modeling that research teams may have little possibility to peer inside to try understand how, why, or even whether such models will work when applied beyond the data on which they were built. Rather than relying on AI expertise alone, we suggest that learning engineering teams bring interdisciplinary expertise to bear to develop explanatory learner models that provide interpretable and actionable insights in addition to accurate prediction. We describe examples that illustrate use of different kinds of data (eg, click stream and discourse data) in different course content (eg, math and writing) and toward different goals (eg, improving student models and generating actionable feedback). We recommend learning engineering teams, shared infrastructure and funder incentives toward better explanatory learner model development that advances learning science, produces better pedagogical practices and demonstrably improves student learning. Practitioner Notes: What is already known about this topic Researchers in learning analytics and educational data mining have been successful in creating innovative models of data that optimize prediction. Some of these models produce scientific or practical insights and fewer have been put into use and demonstrated to enhance student learning. What this paper adds We provide examples of development of explanatory models of learners that not only accurately predict data but also provide scientific insights and yield practical outcomes. In particular, researchers with expertise in cognitive science and math education content use AI‐based data analytics to discover previously unrecognized barriers to geometry student learning. They use model‐derived insights to redesign an online tutoring system and “close‐the‐loop” by experimentally demonstrating that the new system produces better student learning than the original. Implications for practice and/or policy We define explanatory learning models and provide an articulation of a process for generating them that involves interdisciplinary teams employing human–computer interaction and learning engineering methods. Based on our experiences, we recommend learning engineering teams, shared infrastructure and funder incentives toward better explanatory learner model development that advances learning science, produces better pedagogical practices and demonstrably improves student learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Design-based research: Putting a stake in the ground
Barab, S., & Squire, K. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1301_1 · Cited by 2,642
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
“Learning factors analysis-a general method for cognitive model evaluation and improvement,”
Cen, H., Koedinger, K., & Junker, B. (2006) · Lecture notes in computer science · doi:10.1007/11774303_17 · Cited by 572
Self-citationUser-Centered Design and Interactive Health Technologies for Patients
DABBS, A. D. V., MYERS, B. A., MC CURRY, K. R., DUNBAR-JACOB, J., HAWKINS, R. P., BEGEY, A., & DEW, M. A. (2009) · CIN: Computers, Informatics, Nursing · doi:10.1097/ncn.0b013e31819f7c7c · Cited by 517
Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms
Holstein, K., McLaren, B. M., & Aleven, V. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93843-1_12 · Cited by 235
Towards an Agile Approach to Adapting Dynamic Collaboration Support to Student Needs
Adamson, D., Dyke, G., Jang, H., & Rosé, C. P. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-013-0012-6 · Cited by 156
Self-citationFrom data to personal user models for life‐long, life‐wide learners
Kay, J., & Kummerfeld, B. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12878 · Cited by 61
Cited by
Educational data mining and learning analytics: An updated survey
Romero, C., & Ventura, S. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1355 · Cited by 1,120
Artificial Intelligence in Education: The Three Paradigms
Ouyang, F., & Jiao, P. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100020 · Cited by 991
Chounta, I.-A., Bardone, E., Raudsep, A., & Pedaste, M. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00243-5 · Cited by 441
Exploring students' perspectives on generative AI-assisted academic writing
Kim, J., Yu, S., Detrick, R., & Li, N. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12878-7 · Cited by 438
“…subject of interactions with GenAI in learning to develop a thorough understanding of the circumstances in which the use of such systems may be appropriate, how students relate to GenAI, and what challenges arise during GenAI-assisted writing tasks (Rosé et al., 2019; Zawacki-Richter et al., 2019).”
Assessment in the age of artificial intelligence
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100075 · Cited by 409
Data-Driven Artificial Intelligence in Education: A Comprehensive Review
Ahmad, K., Iqbal, W., El-Hassan, A., Qadir, J., Benhaddou, D., Ayyash, M., & Al-Fuqaha, A. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3314610 · Cited by 347
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00406-5 · Cited by 332
Dai, C.-P., & Ke, F. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100087 · Cited by 271
Adnan, M., Habib, A., Ashraf, J., Mussadiq, S., Raza, A. A., Abid, M., Bashir, M., & Khan, S. U. (2021) · IEEE Access · doi:10.1109/access.2021.3049446 · Cited by 250
Dai, C.-P., Ke, F., Pan, Y., Moon, J., & Liu, Z. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09855-4 · Cited by 116
“Peng and Wang (2022) suggested that a higher degree of AI is better for personalization and adaptivity, whereas Rosé et al. (2019) explicated that interpretability, explainability, and actionability are crucial along with AI accuracy.”
The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms
An, P., Holstein, K., d'Anjou, B., Eggen, B., & Bakker, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376277 · Cited by 69
“…higher-level, more immediately meaningful information, by having the system provide more upfront interpretation on behalf of the teacher [33, 54, 109] For example, MTDashboard provides a layer of interpretation by visualizing the distance between a student’s work (on a concept mapping task) and…”
BackgroundDakshit, S., Mokhtari, K., & Khalid, A. (2026) · Education Sciences · doi:10.3390/educsci16020198 · Cited by 4
Exploring the role of automated feedback in programming education: a systematic literature review
Jung, Y., Lee, Y., Bae, J., Kim, D., Choi, H., Kang, M., & Lee, U. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2701430 · Cited by 4
AI-Driven Learning: Current Applications, Challenges, and Future Prospects
Ismail, I. A., Alkhateeb, M. O., & Alkaabi, M. H. (2025) · Advances in Computational Intelligence and Robotics · doi:10.4018/979-8-3693-7873-1.ch001 · Cited by 1
Metadata
- Authors
- Rosé, C. P., McLaughlin, E. A., Liu, R., & Koedinger, K. R.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2019-08-13
- Volume
- 50
- Issue
- 6
- Pages
- 2943-2958
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W2967076347
- Cited by
- 136
- References
- 7
- FWCI
- 15.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.