The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Students' LMS interaction patterns and their relationship with achievement: A case study in higher education
Open accessAbstract
The use of Learning Management Systems has grown exponentially in the last several years and has come to have a strong effect on the teaching-learning process, particularly in higher education. The present study intends to examine students' asynchronous learning processes via an Educational Data Mining approach using data extracted from the Moodle logs of students who were grouped according to similar behaviors regarding effort, time spent working, and procrastination. The behaviors were then matched with different levels of achievement.First, the different patterns of students' involvement in the learning process in a Learning Management System were clustered. Second, the different variables selected from the Moodle records were studied to see if they were equally suitable for the configuration of student clusters. Third, the relationships between those patterns to students' final marks were examined.After analyzing the log data gathered from a Moodle 2.0 course in which 140 undergraduate students were enrolled, four different patterns of learning with different final marks were found. Additional results showed that there are variables more related to achievement and more suitable to group the students on the basis of which the different groups were characterized, namely, two Task Oriented Groups (socially or individually focused) and two Non Task Oriented Groups (procrastinators or non-procrastinators). These results have implications in the design of interventions for improving students' learning processes and achievement in LMSs. This work tends to broaden the knowledge about the learning process in LMSs from an EDM approach.We examine students' interactions with Moodle and their relationship with achievement.We studied the different interaction patterns of students with the LMS in an authentic learning context.We identify the variables from the Moodle's records more suitable to difference de students.We find out patterns of learning related to different achievement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Maximum likelihood estimation from incomplete data via the EM algorithm
Dempster, A. P. (1977) · Journal of the Royal Statistical Society Series A (Statistics in Society) · Cited by 4,543
Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq)
Pintrich, P. R., Smith, D. A. F., Garcia, T., & Mckeachie, W. J. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053003024 · Cited by 3,646
Multivariate Statistical Methods: A Primer.
RAJ, & Manly, B. F. J. (1996) · Journal of the American Statistical Association · doi:10.2307/2291702 · Cited by 2,451
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
Handbook of Self-Regulation of Learning and Performance
Schunk, D. H. (2011) · Routledge eBooks · doi:10.4324/9780203839010 · Cited by 2,122
Brusilovsky, P. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011143116306 · Cited by 2,057
Methods and techniques of adaptive hypermedia
Brusilovsky, P. (1996) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00143964 · Cited by 2,041
Handbook of Self-Regulation of Learning and Performance
(2017) · Routledge eBooks · doi:10.4324/9781315697048 · Cited by 1,816
Multivariate Statistical Methods: A Primer
Nemeth, M. A. (1997) · Technometrics · doi:10.1080/00401706.1997.10485166 · Cited by 1,294
Data mining in course management systems: Moodle case study and tutorial
Romero, C., Ventura, S., & García, E. (2008) · Computers & Education · doi:10.1016/j.compedu.2007.05.016 · Cited by 1,058
Mining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045
Course signals at Purdue: using learning analytics to increase student success
Arnold, K. E., & Pistilli, M. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330666 · Cited by 987
Individual differences in study processes and the Quality of Learning Outcomes
Biggs, J. (1979) · Higher Education · doi:10.1007/bf01680526 · Cited by 770
Weka: Practical machine learning tools and techniques with Java implementations
Witten, I. H., Frank, E., Trigg, L. E., Hall, M. A., Holmes, G., & Cunningham, S. J. (1999) · Research Commons (University of Waikato) · Cited by 629
Doing the things we do: a grounded theory of academic procrastination.
Schraw, G., Wadkins, T., & Olafson, L. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.1.12 · Cited by 597
Handbook of Educational Data Mining
(2010) · CRC Press eBooks · doi:10.1201/b10274 · Cited by 571
Context-Aware Recommender Systems for Learning: A Survey and Future Challenges
Verbert, K., Manouselis, N., Ochoa, X., Wolpers, M., Drachsler, H., Bosnic, I., & Duval, E. (2012) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2012.11 · Cited by 560
Predicting students' final performance from participation in on-line discussion forums
Romero, C., López, M.-I., Luna, J.-M., & Ventura, S. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.06.009 · Cited by 546
Performance in e‐learning: online participation and student grades
Davies, J., & Graff, M. (2005) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2005.00542.x · Cited by 525
Learning Style and Effectiveness of Online and Face-to-Face Instruction
Neuhauser, C. (2002) · American Journal of Distance Education · doi:10.1207/s15389286ajde1602_4 · Cited by 484
Procrastination: associations with achievement goal orientation and learning strategies.
Howell, A. J., & Watson, D. C. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2006.11.017 · Cited by 453
Using Moodle: Teaching with the Popular Open Source Course Management System
Cole, J., & Foster, H. (2007) · Cited by 430
Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á., & Hernández-García, Á. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.031 · Cited by 423
International Handbook of Metacognition and Learning Technologies
(2013) · Springer International Handbooks of Education · doi:10.1007/978-1-4419-5546-3 · Cited by 403
Plant, E. A., Ericsson, K. A., Hill, L., & Asberg, K. (2005) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2004.06.001 · Cited by 400
Procrastination, participation, and performance in online learning environments
Michinov, N., Brunot, S., Le Bohec, O., Juhel, J., & Delaval, M. (2011) · Computers & Education · doi:10.1016/j.compedu.2010.07.025 · Cited by 391
AHA! An open Adaptive Hypermedia Architecture
Bra, P. D., & Calvi, L. (1998) · New Review of Hypermedia and Multimedia · doi:10.1080/13614569808914698 · Cited by 378
Data Mining Algorithms to Classify Students
Romero, C., Ventura, S., Espejo, P. G., & Hervás‐Martínez, C. (2008) · Cited by 376
(2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-46027-6 · Cited by 346
Attention please!: learning analytics for visualization and recommendation
Duval, E. (2011) · Proceedings of the 1st International Conference on Learning Analytics and Knowledge · doi:10.1145/2090116.2090118 · Cited by 325
Adaptive Human Scaffolding Facilitates Adolescents’ Self-regulated Learning with Hypermedia
Azevedo, R., Cromley, J. G., Winters, F. I., Moos, D. C., & Greene, J. A. (2005) · Instructional Science · doi:10.1007/s11251-005-1273-8 · Cited by 306
Web usage mining for predicting final marks of students that use Moodle courses
Romero, C., Espejo, P. G., Zafra, A., Romero, J. R., & Ventura, S. (2013) · Computer Applications in Engineering Education · doi:10.1002/cae.20456 · Cited by 288
Numbers are not enough. Why e-learning analytics failed to inform an institutional strategic plan
Macfadyen, L. P., & Dawson, S. (2012) · Cited by 284
Using Web-based Pedagogical Tools as Scaffolds for Self-regulated Learning
Dabbagh, N., & Kitsantas, A. (2005) · Instructional Science · doi:10.1007/s11251-005-1278-3 · Cited by 263
Devolder, A., van Braak, J., & Tondeur, J. (2012) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2011.00476.x · Cited by 258
Procrastination and self-efficacy: tracing vicious and virtuous circles in self-regulated learning.
Wäschle, K., Allgaier, A., Lachner, A., Fink, S., & Nückles, M. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.09.005 · Cited by 252
Lehmann, T., Hähnlein, I., & Ifenthaler, D. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.07.051 · Cited by 250
A Cognitive and Metacognitive Analysis of Self-Regulated Learning
Winne, P. H. (2015) · Handbook of Self-Regulation of Learning and Performance · doi:10.4324/9780203839010.ch2 · Cited by 227
Una revisión actualizada del concepto de eLearning. Décimo Aniversario
García-Peñalvo, F. J., & Seoane Pardo, A. M. (2015) · Education in the Knowledge Society (EKS) · doi:10.14201/eks2015161119144 · Cited by 222
The student activity meter for awareness and self-reflection
Govaerts, S., Verbert, K., Duval, E., & Pardo, A. (2012) · CHI '12 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2212776.2212860 · Cited by 193
Automatic detection of learning styles for an e-learning system
Özpolat, E., & Akar, G. B. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.02.018 · Cited by 188
Applying Web usage mining for personalizing hyperlinks in Web-based adaptive educational systems
Romero, C., Ventura, S., Zafra, A., & Bra, P. D. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.05.003 · Cited by 168
Opening Learning Management Systems to Personal Learning Environments
García‐Peñalvo, F. J., Alier, M., Casany, M. J., & Conde, M. Á. (2011) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.3217/jucs-017-09-1222 · Cited by 161
Benefits and costs of adaptive user interfaces
Lavie, T., & Meyer, J. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.01.004 · Cited by 158
Monitoring student progress using virtual appliances: A case study
Romero-Zaldivar, V.-A., Pardo, A., Burgos, D., & Kloos, C. D. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.12.003 · Cited by 138
Hung, J.-L., & Zhang, K. (2008) · Scholar Works (Boise State University) · Cited by 138
Examining the Effect of Academic Procrastination on Achievement Using LMS Data in E-Learning.
You, J. W. (2015) · Educational Technology & Society · Cited by 132
Penetrating the black box of time-on-task estimation
Kovanović, V., Gašević, D., Dawson, S., Joksimovíc, S., Baker, R. S., & Hatala, M. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723623 · Cited by 131
Murphy, P. K., & Alexander, P. A. (2002) · The Journal of Experimental Education · doi:10.1080/00220970209599506 · Cited by 127
Núñez, J. C., Cerezo, R., Bernardo, A. B., Rosário, P. J. S. L. F., Valle, A., Fernández, E., & Suárez, N. (2011) · PubMed · Cited by 127
Self-citationStudent Interaction with Online Course Content: Build It and They Might Come
Murray, M. C., Pérez, J., Geist, D., & Hedrick, A. (2012) · Journal of Information Technology Education Research · doi:10.28945/1592 · Cited by 121
Aleven, V. A. W. M. M., Roll, I., McLaren, B. M., & Koedinger, K. R. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.517740 · Cited by 118
Agosti, M., Crivellari, F., & Nunzio, G. M. D. (2011) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-011-0228-8 · Cited by 118
Romero, C., González, P., Ventura, S., del Jesús, M. J., & Herrera, F. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.11.026 · Cited by 111
Modeling Domain Learning: Profiles From the Field of Special Education.
Alexander, P. A., Sperl, C. T., Buehl, M. M., Fives, H., & Chiu, S. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.3.545 · Cited by 109
Self‐regulation of learning with computer‐based learning environments
Greene, J. A., Moos, D. C., & Azevedo, R. (2011) · New Directions for Teaching and Learning · doi:10.1002/tl.449 · Cited by 103
Tap into visual analysis of customization of grouping of activities in eLearning
Aguilar, D. A. G., Hernández-García, Á., García‐Peñalvo, F. J., & Therón, R. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.11.001 · Cited by 100
Essa, A., & Ayad, H. G. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330641 · Cited by 98
Content Management Systems: Enriched learning opportunities for all?
Lust, G., Collazo, N. A. J., Elen, J., & Clarebout, G. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.12.009 · Cited by 95
Regulation of tool-use within a blended course: Student differences and performance effects
Lust, G., Elen, J., & Clarebout, G. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.09.001 · Cited by 95
Leony, D., Pardo, A., de‐la‐Fuente‐Valentín, L., de Castro, D. S., & Kloos, C. D. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330642 · Cited by 90
Tool-use in a blended undergraduate course: In Search of user profiles
Lust, G., Vandewaetere, M., Ceulemans, E., Elen, J., & Clarebout, G. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.05.010 · Cited by 90
Hrastinski, S. (2006) · The Internet and Higher Education · doi:10.1016/j.iheduc.2006.03.006 · Cited by 78
Tuckman, B. W. (2005) · Psychological Reports · doi:10.2466/pr0.96.3c.1015-1021 · Cited by 74
Adaptive course authoring: My Online Teacher
Cristea, A. I., & Mooij, A. D. (2003) · doi:10.1109/ictel.2003.1191699 · Cited by 72
Analítica visual en e-learning
Aguilar, D. A. G., García‐Peñalvo, F. J., & Therón, R. (2014) · El Profesional de la Informacion · doi:10.3145/epi.2014.may.03 · Cited by 69
Muñoz-Organero, M., Muñoz‐Merino, P. J., & Kloos, C. D. (2009) · IEEE Transactions on Education · doi:10.1109/te.2009.2027433 · Cited by 59
Analyzing Early At-Risk Factors in Higher Education E-Learning Courses.
Baker, R. S., Lindrum, D., Lindrum, M. J., & Perkowski, D. J. (2015) · Educational Data Mining · Cited by 56
New media for the promotion of self-regulated learning in higher education.
Cerezo, R., Núñez, J. C., Rosário, P. J. S. L. F., Valle, A., Rodríguez, S., & Bernardo, A. B. (2010) · PubMed · Cited by 50
Self-citationEffect of Quality and Quantity of Study on Student Grades
Dickinson, D. J., & O’Connell, D. Q. (1990) · The Journal of Educational Research · doi:10.1080/00220671.1990.10885960 · Cited by 46
Dysregulated Learning with Advanced Learning Technologies
Azevedo, R., & Feyzi-Behnagh, R. (2011) · Journal of e-Learning and Knowledge Society · doi:10.20368/1971-8829/517 · Cited by 43
Dabbagh, N. H., & Kitsantas, A. (2013) · Springer international handbooks of education · doi:10.1007/978-1-4419-5546-3_14 · Cited by 40
Towards a generic adaptive hypermedia platform : a conversion case study
Cristea, A. I., Smits, D., & Bra, P. P. D. (2007) · TU/e Research Portal · doi:10.82444/warw.33642937 · Cited by 36
Ge, X., & Hardré, P. L. (2009) · Learning Environments Research · doi:10.1007/s10984-009-9064-9 · Cited by 35
Learning or performance: Predicting drivers of student motivation
Dawson, S., Macfadyen, L. P., & Lockyer, L. (2009) · Research Online (University of Wollongong) · Cited by 33
Open Service-Oriented Platforms for Personal Learning Environments
Ros, S., Hernández, R., Robles-Gómez, A., Caminero, A. C., Tobarra, L., & Sancristobal, E. (2013) · IEEE Internet Computing · doi:10.1109/mic.2013.73 · Cited by 31
The Impact of Frequency on Achievement in Online Courses: A Study from a South Texas University.
Kupczynski, L., Gibson, A. M., Ice, P., Richardson, J. C., & Challoo, L. (2011) · Journal of interactive online learning · Cited by 28
García‐Peñalvo, F. J., Cruz-Benito, J., Maderuelo, C., Pérez‐Blanco, J. S., & Martín‐Suárez, A. (2014) · The Scientific World JOURNAL · doi:10.1155/2014/659364 · Cited by 24
López, M. I., Romero, C., Ventura, S., & Luna, J. M. (2012) · Educational Data Mining · Cited by 24
Using Rules Discovery for the Continuous Improvement of e-Learning Courses
Salcines, E. G., Romero, C., Ventura, S., & Lozano, C. D. C. (2006) · Lecture notes in computer science · doi:10.1007/11875581_106 · Cited by 21
The Procrastination Related Indicators in e-Learning Platforms
Pérez-Pérez, J. R., Ruiz, M. P. P., Sánchez‐Santillán, M., & Riestra-González, M. (2020) · Consultation of the Doctoral Thesis Database (TESEO) (Ministerio de Educación, Cultura y Deporte) · doi:10.3217/jucs-021-01-0007 · Cited by 21
Self-citationTuckman, B. W. (2005) · Psychological Reports · doi:10.2466/pr0.96.3.1015-1021 · Cited by 10
Erratum: International Handbook of Metacognition and Learning Technologies
Azevedo, R., & Aleven, V. (2013) · Springer International Handbooks of Education · doi:10.1007/978-1-4419-5546-3_47 · Cited by 8
Research works printed but not linked: 3
- Alstete, 2004, Performance indicators in online distance learning courses: a study of management education, Quality Assurance in Education, 12, 6, 10.1108/09684880410517397 · doi:10.1108/09684880410517397
- Conde, 2014, Implementation and design of a service-based framework to integrate personal and institutional learning environments, Science of Computer Programming, 88, 41, 10.1016/j.scico.2013.10.012 · doi:10.1016/j.scico.2013.10.012
- Graf, 2009, Supporting teachers in identifying students' learning styles in learning management systems: an automatic student modelling approach, Educational Technology & Society, 12, 3
Cited by
Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.01.007 · Cited by 564
Abu Saa, A., Al-Emran, M., & Shaalan, K. (2019) · Technology, Knowledge and Learning · doi:10.1007/s10758-019-09408-7 · Cited by 229
Effectiveness of Blended Learning in Nursing Education
Sáiz-Manzanares, M. C., Escolar-Llamazares, M.-C., & Arnaiz González, Á. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17051589 · Cited by 138
An early feedback prediction system for learners at-risk within a first-year higher education course
Baneres, D., Rodriguez, M. E., & Serra, M. (2019) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2019.2912167 · Cited by 128
DeepLMS: a deep learning predictive model for supporting online learning in the Covid-19 era
Dias, S. B., Hadjileontiadou, S. J., Diniz, J., & Hadjileontiadis, L. J. (2020) · Scientific Reports · doi:10.1038/s41598-020-76740-9 · Cited by 115
Metadata
- Authors
- Cerezo, R., Sánchez-Santillán, M., Paule-Ruiz, M. P., & Núñez, J. C.
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2016-05
- Volume
- 96
- Pages
- 42-54
- ISSN
- 0360-1315 (ISSN-L)
- OpenAlex
- W2533014371
- Cited by
- 321
- References
- 88
- FWCI
- 38.88
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Funders
- Department of Science and Innovation (Spain) (TIN2011-25978, EDU2014-57571-P)
- European Union
- Principality of Asturias (GRUPIN14-100, GRUPIN14-053)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.