Massive LMS log data analysis for the early prediction of course-agnostic student performance
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The early prediction of students’ performance is a valuable resource to improve their learning. If we are able to detect at-risk students in the initial stages of the course, we will have more time to improve their performance. Likewise, excellent students could be motivated with customized additional activities. This is why there are research works aimed to early detect students’ performance. Some of them try to achieve it with the analysis of LMS log files, which store information about student interaction with the LMS. Many works create predictive models with the log files generated for the whole course, but those models are not useful for early prediction because the actual log information used for predicting is different to the one used to train the models. Other works do create predictive models with the log information retrieved at the early stages of courses, but they are just focused on a particular type of course. In this work, we use machine learning to create models for the early prediction of students’ performance in solving LMS assignments, by just analyzing the LMS log files generated up to the moment of prediction. Moreover, our models are course agnostic, because the datasets are created with all the University of UniversityName 1 courses for one academic year. We predict students’ performance at 10%, 25%, 33% and 50% of the course length. Our objective is not to predict the exact student’s mark in LMS assignments, but to detect at-risk, fail and excellent students in the early stages of the course. That is why we create different classification models for each of those three student groups. Decision tree, nave Bayes, logistic regression, multilayer perceptron (MLP) neural network, and support vector machine models are created and evaluated. Accuracies of all the models grow as the moment of prediction increases. Although all the algorithms but nave Bayes show accuracy differences lower than 5%, MLP obtains the best performance: from 80.1% accuracy when 10% of the course has been delivered to 90.1% when half of it has taken place. We also discuss the LMS log entries that most influence the students’ performance. By using a clustering algorithm, we detect six different clusters of students regarding their interaction with the LMS. Analyzing the interaction patterns of each cluster, we find that those patterns are repeated in all the early stages of the course. Finally, we show how four out of those six student-LMS interaction patterns have a strong correlation with students’ performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Methods and techniques of adaptive hypermedia
Brusilovsky, P. (1996) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00143964 · Cited by 2,041
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835 · cited 1×
“…the mean substitution method, based on replacing null values with Table 7: Independent variables with the greatest Gini importance to classify at-risk, fail/pass and excellent students (respective mark thresholds 2.5, 5.0 and 8.5). the average value for that feature in the whole dataset [45, 46].”
MethodInfluentialMining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045
The Role of Hubness in Clustering High-Dimensional Data
Tomasev, N., Radovanovic, M., Mladenic, D., & Ivanovic, M. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.25 · Cited by 142 · cited 1×
“Since cluster algorithms work with distance methods to identify the clusters, they are not accurate for high dimensional spaces [47].”
BackgroundExploring the potential of LMS log data as a proxy measure of student engagement
Henrie, C. R., Bodily, R., Larsen, R., & Graham, C. R. (2018) · Journal of Computing in Higher Education · doi:10.1007/s12528-017-9161-1 · Cited by 92
Tuckman, B. W. (2005) · Psychological Reports · doi:10.2466/pr0.96.3c.1015-1021 · Cited by 74
Cited by
Choi, S., Jang, Y., & Kim, H. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2049145 · Cited by 294
“It can analyze students ’ cognitive states (Troussas et al., 2020) and learning styles (Wei et al., 2018), predict academic performance (Riestra-Gonz (cid:1) alez et al., 2021), and support customized learning based on their academic performance (Piech et al., 2015).”
BackgroundGenerative AI for Customizable Learning Experiences
Pesovski, I., Santos, R., Henriques, R., & Trajkovik, V. (2024) · Sustainability · doi:10.3390/su16073034 · Cited by 274
“…data collection functionalities that record all the interactions made by its users, which allows educators to not only keep tabs on the overall engagement of their students but to use those data to perform the early identifications of struggling students [37,38] and provide timely feedback [34,39].”
BackgroundPractical early prediction of students’ performance using machine learning and eXplainable AI
Jang, Y., Choi, S., Jung, H., & Kim, H. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11120-6 · Cited by 114
Manhica, R., Santos, A., & Cravino, J. (2022) · 2022 17th Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti54924.2022.9820205 · Cited by 26
Metadata
- Authors
- Riestra-González, M., Paule-Ruíz, M. D. P., & Ortin, F.
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2021-04
- Volume
- 163
- Pages
- 104108
- ISSN
- 0360-1315 (ISSN-L)
- OpenAlex
- W3113641224
- Cited by
- 178
- References
- 7
- FWCI
- 16.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Massive LMS log data analysis for the early prediction of course-agnostic student performance. https://app.cochat.ai/papers/10.1016/j.compedu.2020.104108
- The paper
- Riestra-González, M., Paule-Ruíz, M. D. P., & Ortin, F. (2021). Massive LMS log data analysis for the early prediction of course-agnostic student performance. Computers & Education. https://doi.org/10.1016/j.compedu.2020.104108
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.