Open learner models and learning analytics dashboards: a systematic review
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
This paper aims to link student facing Learning Analytics Dashboards (LADs) to the corpus of research on Open Learner Models (OLMs), as both have similar goals. We conducted a systematic review of literature on OLMs and compared the results with a previously conducted review of LADs for learners in terms of (i) data use and modelling, (ii) key publication venues, (iii) authors and articles, (iv) key themes, and (v) system evaluation. We highlight the similarities and differences between the research on LADs and OLMs. Our key contribution is a bridge between these two areas as a foundation for building upon the strengths of each. We report the following key results from the review: in reports of new OLMs, almost 60% are based on a single type of data; 33% use behavioral metrics; 39% support input from the user; 37% have complex models; and just 6% involve multiple applications. Key associated themes include intelligent tutoring systems, learning analytics, and self-regulated learning. Notably, compared with LADs, OLM research is more likely to be interactive (81% of papers compared with 31% for LADs), report evaluations (76% versus 59%), use assessment data (100% versus 37%), provide a comparison standard for students (52% versus 38%), but less likely to use behavioral metrics, or resource use data (33% against 75% for LADs). In OLM work, there was a heightened focus on learner control and access to their own data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324 · cited 1×
“…strong evidence that having a student model can make a system more effective in helping students learn, by using the model to adapt to learner differences (e.g., cognitive mastery, which is a form of individualized problem selection based on modeling individual students’ skill mastery [18]).”
BackgroundCognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 1×
“, cognitive tutors [3, 34, 42]), meaning that each student gets an individualized problem sequence depending on their performance with the software, the student model (often displayed in the form of “skill bars” that capture the level of mastery of the targeted knowledge components) communicates progress more effectiv…”
BackgroundIdentifying significant indicators using LMS data to predict course achievement in online learning
You, J. W. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.11.003 · Cited by 388
Bodily, R., & Verbert, K. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2740172 · Cited by 306 · cited 3×
“Examples of such tools are student-facing learning analytics dashboards (LADs) [6, 51], early warning systems [2, 30, 37, 53, 56], and open learner models (OLMs) [10, 11, 12, 39].”
BackgroundSelf-citationEnhancing learning outcomes through self-regulated learning support with an Open Learner Model
Long, Y., & Aleven, V. (2017) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-016-9186-6 · Cited by 95
Self-citation
Cited by
The promise and challenges of generative AI in education
Giannakos, M., Azevedo, R., Brusilovsky, P., Cukurova, M., Dimitriadis, Y., Hernandez-Leo, D., Järvelä, S., Mavrikis, M., & Rienties, B. (2025) · Behaviour & Information Technology · doi:10.1080/0144929x.2024.2394886 · Cited by 543
Matcha, W., Uzir, N. A., Gasevic, D., & Pardo, A. (2020) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2019.2916802 · Cited by 399
Towards hybrid human‐AI learning technologies
Molenaar, I. (2022) · European Journal of Education · doi:10.1111/ejed.12527 · Cited by 348
Molenaar, I. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100070 · Cited by 217
Harnessing AI for education 4.0: Drivers of personalized learning.
Barrera Castro, G. P., Chiappe, A., Becerra Rodriguez, D. F., & Sepulveda, F. G. (2024) · Electronic Journal of e-Learning · doi:10.34190/ejel.22.5.3467 · Cited by 132
From Data to Insights: A Layered Storytelling Approach for Multimodal Learning Analytics
Martinez-Maldonado, R., Echeverria, V., Fernandez Nieto, G., & Buckingham Shum, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376148 · Cited by 123
“An explainable AI approach [96] would involve helping people understand what the system knows about them [6].”
BackgroundIncorporating AI and learning analytics to build trustworthy peer assessment systems
Darvishi, A., Khosravi, H., Sadiq, S., & Gašević, D. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13233 · Cited by 120
Learning analytics: state of the art
Hernández-de-Menéndez, M., Morales-Menendez, R., Escobar, C. A., & Ramírez Mendoza, R. A. (2022) · International Journal on Interactive Design and Manufacturing (IJIDeM) · doi:10.1007/s12008-022-00930-0 · Cited by 93
RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities
Khosravi, H., Kitto, K., & Williams, J. J. (2019) · arXiv · doi:10.48550/arxiv.1910.05522 · Cited by 81
Staying on target: A systematic literature review on learner‐facing learning analytics dashboards
Valle, N., Antonenko, P., Dawson, K., & Huggins‐Manley, A. C. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13089 · Cited by 79
Echeverria, V., Martinez-Maldonado, R., Buckingham Shum, S., Chiluiza, K., Granda, R., & Conati, C. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.6 · Cited by 70
“These visual representations of student data have gained considerable attention in the field of learning analytics (see recent reviews by Bodily et al., 2018; Bodily & Verbert, 2017; Schwendimann et al., 2017).”
Complementing educational recommender systems with open learner models
Abdi, S., Khosravi, H., Sadiq, S., & Gasevic, D. (2020) · Proceedings of the Tenth International Conference on Learning Analytics & Knowledge · doi:10.1145/3375462.3375520 · Cited by 68
The equalizing effect of teacher dashboards on feedback in K-12 classrooms
Knoop-van Campen, C. A. N., Wise, A., & Molenaar, I. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1931346 · Cited by 58
Personalisation methods in e-learning-A literature review
Mikić, V., Ilić, M., Kopanja, L., & Vesin, B. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22566 · Cited by 39
“In this regard, we have reviews focusing on the implementation of recommender systems (RSs) in e‐learning [109, 151, 155, 156, 159, 200, 235, 257], learning modelling and open learning models [49, 139], LA [36, 189, 250] and implementation of LA dashboards [49, 187], and reviews on various types of intelligent techniq…”
MethodIncluding Learning Analytics in the Loop of Self-Paced Online Course Learning Design
Yan, H., Lin, F., & Kinshuk (2021) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00225-z · Cited by 25
“In the learning analytics field, tools like dashboard or visualization of learning data and concepts like open learner model or student modelling have been explored for increasing the learning awareness (Bodily et al. 2018).”
BackgroundMethodInfluentialBergdahl, N., Nouri, J., Karunaratne, T., Afzaal, M., & Saqr, M. (2020) · International Journal of Learning Analytics and Artificial Intelligence for Education (iJAI) · doi:10.3991/ijai.v2i2.17887 · Cited by 18
“; open learner models [10] educational data mining [12] or apply a wider scope that explore national research ef-forts, policies, infrastructures and competence centres across several European countries [68].”
BackgroundMarquès, J. M., Calvet, L., Arguedas, M., Daradoumis, T., & Mor, E. (2022) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2021.1938400 · Cited by 14
Supporting Learners in a Crisis Context with Smart Self-Assessment
Papamitsiou, Z., Lunde, M., Westermoen, J., & Giannakos, M. N. (2021) · Lecture Notes in Educational Technology · doi:10.1007/978-981-15-7869-4_14 · Cited by 9
Metadata
- Authors
- Bodily, R., Kay, J., Aleven, V., Jivet, I., Davis, D., Xhakaj, F., & Verbert, K.
- Venue
- Proceedings of the 8th International Conference on Learning Analytics and Knowledge
- Publisher
- ACM
- Published
- 2018-03-07
- Pages
- 41-50
- OpenAlex
- W2781021131
- Cited by
- 154
- References
- 6
- FWCI
- 8.22
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.