The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Predicting Student Performance from LMS Data: A Comparison of 17 Blended Courses Using Moodle LMS
Open accessAbstract
With the adoption of Learning Management Systems (LMSs) in educational institutions, a lot of data has become available describing students' online behavior. Many researchers have used these data to predict student performance. This has led to a rather diverse set of findings, possibly related to the diversity in courses and predictor variables extracted from the LMS, which makes it hard to draw general conclusions about the mechanisms underlying student performance. We first provide an overview of the theoretical arguments used in learning analytics research and the typical predictors that have been used in recent studies. We then analyze 17 blended courses with 4,989 students in a single institution using Moodle LMS, in which we predict student performance from LMS predictor variables as used in the literature and from in-between assessment grades, using both multi-level and standard regressions. Our analyses show that the results of predictive modeling, notwithstanding the fact that they are collected within a single institution, strongly vary across courses. Thus, the portability of the prediction models across courses is low. In addition, we show that for the purpose of early intervention or when in-between assessment grades are taken into account, LMS data are of little (additional) value. We outline the implications of our findings and emphasize the need to include more specific theoretical argumentation and additional data sources other than just the LMS data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645 · cited 1×
“However, the match between these theories and the measurements used for learning analytics is not optimal and other theories such as situated learning [24] or”
BackgroundHattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
(2008) · Cited by 6,939
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance.
Nicholls, J. G. (1984) · Psychological Review · doi:10.1037/0033-295x.91.3.328 · Cited by 4,161
Richardson, M., Abraham, C., & Bond, R. (2012) · Psychological Bulletin · doi:10.1037/a0026838 · Cited by 3,646 · cited 3×
“important predictors of student success [15], [42].”
BackgroundHattie, J. (2008) · doi:10.4324/9780203887332 · Cited by 3,051
Editorial: Three types of interaction
Moore, M. G. (1989) · American Journal of Distance Education · doi:10.1080/08923648909526659 · Cited by 2,471
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
Studying as Self-Regulated Learning
(1998) · Metacognition in Educational Theory and Practice · doi:10.4324/9781410602350-19 · Cited by 1,589
(1996) · Cited by 1,549
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,359
1. Foundations of Educational Theory for Online Learning
Ally, M. (2008) · The Theory and Practice of Online Learning · doi:10.15215/aupress/9781897425084.003 · Cited by 1,088
Learning analytics and educational data mining: towards communication and collaboration
Siemens, G., & Baker, R. S. J. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330661 · Cited by 1,075
Mining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045
Big Five personality predictors of post-secondary academic performance
O’Connor, M. C., & Paunonen, S. V. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2007.03.017 · Cited by 1,029
Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.10.002 · Cited by 683
Coates, H. B., James, R. H., & Baldwin, G. (2005) · Tertiary Education and Management · doi:10.1007/s11233-004-3567-9 · Cited by 585
Performance in e‐learning: online participation and student grades
Davies, J., & Graff, M. (2005) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2005.00542.x · Cited by 525
Social learning analytics: five approaches
Ferguson, R., & Buckingham Shum, S. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330616 · Cited by 523
A metacognitive view of individual differences in self-regulated learning
Winne, P. H. (1996) · Learning and Individual Differences · doi:10.1016/s1041-6080(96)90022-9 · Cited by 486 · cited 1×
“They then carry out their plan and construct new information [22].”
BackgroundInforming Pedagogical Action: Aligning Learning Analytics With Learning Design
Lockyer, L., Heathcote, E., & Dawson, S. (2013) · American Behavioral Scientist · doi:10.1177/0002764213479367 · Cited by 471
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.038 · Cited by 449
An overview of learning analytics
Clow, D. (2013) · Teaching in Higher Education · doi:10.1080/13562517.2013.827653 · Cited by 431
Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á., & Hernández-García, Á. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.031 · Cited by 423
Tracking student behavior, persistence, and achievement in online courses
Morris, L. V., Finnegan, C., & Wu, S.-S. (2005) · The Internet and Higher Education · doi:10.1016/j.iheduc.2005.06.009 · Cited by 421
Early Alert of Academically At-Risk Students: An Open Source Analytics Initiative
Jayaprakash, S. M., Moody, E. W., Lauría, E. J. M., Regan, J. R., & Baron, J. D. (2014) · Journal of Learning Analytics · doi:10.18608/jla.2014.11.3 · Cited by 414
Shum, S. B., & Ferguson, R. (2012) · Cited by 398
Identifying significant indicators using LMS data to predict course achievement in online learning
You, J. W. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.11.003 · Cited by 388
Epistemic Network Analysis: A Prototype for 21st-Century Assessment of Learning
Shaffer, D. W., Hatfield, D., Svarovsky, G. N., Nash, P., Nulty, A., Bagley, E., Frank, K., Rupp, A. A., & Mislevy, R. (2009) · International Journal of Learning and Media · doi:10.1162/ijlm.2009.0013 · Cited by 386
Aptitude is not enough: How personality and behavior predict academic performance
Conard, M. A. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2004.10.003 · Cited by 385
A Blended Learning Approach to Course Design and Implementation
Hoic-Bozic, N., Mornar, V., & Boticki, I. (2009) · IEEE Transactions on Education · doi:10.1109/te.2007.914945 · Cited by 363
A multivariate approach to predicting student outcomes in web-enabled blended learning courses
Zacharis, N. Z. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.05.002 · Cited by 302
Developing early warning systems to predict students’ online learning performance
Hu, Y.-H., Lo, C.-L., & Shih, S.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.002 · Cited by 278
Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics
Buckingham Shum, S., & Crick, R. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330629 · Cited by 202
Park, Y., Yu, J. H., & Jo, I. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.11.001 · Cited by 172
Beer, C., Clark, K., & Jones, D. (2010) · ASCILITE Publications · doi:10.14742/apubs.2010.2044 · Cited by 169
Learning at distance: Effects of interaction traces on academic achievement
Joksimović, S., Gašević, D., Loughin, T. M., Kovanović, V., & Hatala, M. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.07.002 · Cited by 167
Penetrating the black box of time-on-task estimation
Kovanović, V., Gašević, D., Dawson, S., Joksimovíc, S., Baker, R. S., & Hatala, M. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723623 · Cited by 153
System, scholar or students? Which most influences online MBA course effectiveness?
Arbaugh, J. B. (2014) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12048 · Cited by 143
Shaw, R.-S. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.08.013 · Cited by 139
Superby, J.-F., Meskens, N., & Vandamme, J.-P. (2006) · Digital Access to Libraries · Cited by 137
Dollinger, S. J., Matyja, A. M., & Huber, J. L. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.11.007 · Cited by 126
Yu, T., & Jo, I. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567594 · Cited by 89
Iglesías-Pradas, S., Ruiz-de-Azcárate, C., & Agudo-Peregrina, Á. F. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.065 · Cited by 85
Teaching smarter: how mining ICT data can inform and improve learning and teaching practice
Dawson, S., McWilliam, E., & Tan, J. P.-L. (2008) · NIE Digital Repository (National Institute of Education, Nanyang Technological University) · Cited by 84
"Scaling up" learning design: impact of learning design activities on LMS behavior and performance
Rienties, B., Toetenel, L., & Bryan, A. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723600 · Cited by 80
(2002) · doi:10.1007/978-1-4615-0885-4_3 · Cited by 70
Mining academic data to improve college student retention
Lauría, E. J. M., Baron, J. D., Devireddy, M., Sundararaju, V., & Jayaprakash, S. M. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330637 · Cited by 70
Towards Networked Learning Analytics - A Concept and a Tool
Retalis, S., Papasalouros, A., Psaromiligkos, Y., Siscos, S., & Kargidis, T. (2006) · Proceedings of the International Conference on Networked Learning · doi:10.54337/nlc.v5.9471 · Cited by 62
Muñoz-Organero, M., Muñoz‐Merino, P. J., & Kloos, C. D. (2009) · IEEE Transactions on Education · doi:10.1109/te.2009.2027433 · Cited by 59
How active are students in online discussion forums
Nandi, D., Hamilton, M., Harland, J., & Warburton, G. (2011) · RMIT Research Repository (RMIT University Library) · Cited by 44
Distinguishing the learning approaches adopted by undergraduates in their use of online resources
Knight, J. (2010) · Active Learning in Higher Education · doi:10.1177/1469787409355873 · Cited by 43
Editorial: Conferences and changes
Moore, M. G. (1989) · American Journal of Distance Education · doi:10.1080/08923648909526674 · Cited by 35
An Overview of Learning Management Systems
Piña, A. A. (2010) · IGI Global eBooks · doi:10.4018/978-1-61520-853-1.ch001 · Cited by 35
Importance of Theory in Learning Analytics in Formal and Workplace Settings
Dawson, S., Mirriahi, N., & Gašević, D. (2015) · Journal of Learning Analytics · doi:10.18608/jla.2015.22.1 · Cited by 20
An Overview of Learning Management Systems
Piña, A. A. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-0011-9.ch103 · Cited by 16
Using Early Warning Signs to Predict Academic Risk in Interactive, Blended Teaching Environments
Schell, J. A., Lukoff, B., & Alvarado, C. G. (2014) · Internet learning · doi:10.18278/il.3.2.5 · Cited by 12
Early identification of students at risk of failing
Milne, J., Jeffrey, L. M., Suddaby, G., & Higgins, A. (2012) · ASCILITE Publications · doi:10.14742/apubs.2012.1621 · Cited by 12
Research works printed but not linked: 7
- 10.1080/13583883.2005.9967137 · doi:10.1080/13583883.2005.9967137 · Paper page
- rafaeli, 0, Online, web-based learning environment for an information systems course: Access logs, linearity and performance, Proc Inf Syst Educ Conf, 97, 92
- petropoulou, 0, Helping educators analyse interactions within networked learning communities: A framework and the AnalyticsTool system, Proc 6th Int Conf Netw Learn, 5
- rankine, 0, Benchmarking across universities: A framework for LMS analysis, Proc Ann Conf Australian Soc Computers in Learning in Tertiary Education, 815
- daniels, 2012, CROSSFOLD: Stata module to perform k-fold cross-validation, Statistical Software Components S457426
- campbell, 2007, Academic analytics, Educause, 42, 40
- long, 0, Announcing open course: Learning and knowledge analytics, Proc 1st Int Conf Learn Analytics Knowl
Cited by
Utilising learning analytics to support study success in higher education: a systematic review
Ifenthaler, D., & Yau, J. Y.-K. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09788-z · Cited by 659
Postdigital Education in Design and Practice
Fawns, T. (2019) · Postdigital Science and Education · doi:10.1007/s42438-018-0021-8 · Cited by 365
Predicting academic performance: a systematic literature review
Hellas, A., Ihantola, P., Petersen, A., Ajanovski, V. V., Gutica, M., Hynninen, T., Knutas, A., Leinonen, J., Messom, C., & Liao, S. N. (2018) · Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3293881.3295783 · Cited by 355
A systematic review on trends in using Moodle for teaching and learning
Gamage, S. H. P. W., Ayres, J. R., & Behrend, M. B. (2022) · International Journal of STEM Education · doi:10.1186/s40594-021-00323-x · Cited by 360
Azcona, D., Hsiao, I.-H., & Smeaton, A. F. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09234-7 · Cited by 114
Metadata
- Authors
- Conijn, R., Snijders, C., Kleingeld, A., & Matzat, U.
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2017-01-01
- Volume
- 10
- Issue
- 1
- Pages
- 17-29
- ISSN
- 1939-1382 (ISSN-L)
- OpenAlex
- W2531767846
- Cited by
- 371
- References
- 59
- FWCI
- 34.41
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Centre for Engineering Education (4TU)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.