Using clickstream data to measure, understand, and support self-regulated learning in online courses
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
The ability to regulate one's own learning is essential for success in online courses. Recent efforts have used clickstream data to create timely, fine-grained, and comprehensive measures of self-regulated learning (SRL) in online courses in an attempt to shed light on the process of SRL and to improve the identification of students who lack SRL skills and are at risk of low achievement. However, key questions remain: to what extent do these clickstream measures correspond to traditional self-reported measures about specific SRL constructs? Do these clickstream measures provide more information than existing self-reported measures in predicting course performance? This study used the clickstream data collected from a learning management system to measure two aspects of SRL: time management and effort regulation. We found that the clickstream measures were significantly associated with students' self-reported time management and effort regulation after the course. In addition, these clickstream measures significantly improved predictions of students' performance in the current and subsequent courses over predictions based on self-reported measures alone. These results provide evidence for the validity of the clickstream measures and guide the use of clickstream data to understand the process of SRL and identify students who might not be well served by taking classes online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Motivational and self-regulated learning components of classroom academic performance.
Pintrich, P. R., & De Groot, E. V. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.33 · Cited by 8,332
Zimmerman, B. J. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50031-7 · Cited by 6,069
The Role of Goal Orientation in Self-Regulated Learning
Pintrich, P. R. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50043-3 · Cited by 5,173
A Conceptual Framework for Assessing Motivation and Self-Regulated Learning in College Students
Pintrich, P. R. (2004) · Educational Psychology Review · doi:10.1007/s10648-004-0006-x · Cited by 3,269
Broadbent, J., & Poon, W. L. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.04.007 · Cited by 1,692
When More Pain Is Preferred to Less: Adding a Better End
Kahneman, D., Fredrickson, B. L., Schreiber, C. A., & Redelmeier, D. A. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00589.x · Cited by 1,502
Measuring Self-Regulated Learning
Winne, P. H., & Perry, N. E. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50045-7 · Cited by 1,383
Prospection: experiencing the future
Gilbert, D. T., & Wilson, T. D. (2007) · Science · doi:10.1126/science.1144161 · Cited by 1,238
Let’s not forget: Learning analytics are about learning
Gašević, D., Dawson, S., & Siemens, G. (2015) · TechTrends · doi:10.1007/s11528-014-0822-x · Cited by 1,049
Mining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045
Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.001 · Cited by 1,003
New Frontiers: Regulating Learning in CSCL
Järvelä, S., & Hadwin, A. F. (2013) · Educational Psychologist · doi:10.1080/00461520.2012.748006 · Cited by 722
Standards of validity and the validity of standards in performance asessment
Messick, S. (1995) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1995.tb00881.x · Cited by 697
A metacognitive view of individual differences in self-regulated learning
Winne, P. H. (1996) · Learning and Individual Differences · doi:10.1016/s1041-6080(96)90022-9 · Cited by 486
Virtual Classrooms: How Online College Courses Affect Student Success
Bettinger, E. P., Fox, L., Loeb, S., & Taylor, E. S. (2017) · American Economic Review · doi:10.1257/aer.20151193 · Cited by 441
Identifying significant indicators using LMS data to predict course achievement in online learning
You, J. W. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.11.003 · Cited by 388
Self-regulation in online learning
Cho, M.-H., & Shen, D. (2013) · Distance Education · doi:10.1080/01587919.2013.835770 · Cited by 380
Xu, D., & Jaggars, S. S. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.08.001 · Cited by 359
GREENE, J. A., & AZEVEDO, R. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.515935 · Cited by 267
Xu, D., & Jaggars, S. S. (2011) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711413814 · Cited by 239
Discriminating factors between completers of and dropouts from online learning courses
Lee, Y., Choi, J., & Kim, T. (2013) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2012.01306.x · Cited by 206
The Least Likely of Times: How Remembering the Past Biases Forecasts of the Future
Morewedge, C. K., Gilbert, D. T., & Wilson, T. D. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01585.x · Cited by 184
Measuring strategy use with self-report instruments: theoretical and empirical considerations
Schellings, G., & Van Hout-Wolters, B. (2011) · Metacognition and Learning · doi:10.1007/s11409-011-9081-9 · Cited by 143
Procrastination in a distance university setting
Klingsieck, K. B., Fries, S., Horz, C., & Hofer, M. (2012) · Distance Education · doi:10.1080/01587919.2012.723165 · Cited by 136
DiBenedetto, M. K., & Bembenutty, H. (2013) · Learning and Individual Differences · doi:10.1016/j.lindif.2012.09.015 · Cited by 94
Dang, N. V., Chiang, J. C., Brown, H. M., & McDonald, K. K. (2018) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v19i1.1324 · Cited by 47
Role Ambiguity in Online Courses: An Analysis of Student and Instructor Expectations
Bork, R. J. H., & Rucks-Ahidiana, Z. (2013) · Columbia University · doi:10.7916/d8c24tgv · Cited by 39
Cited by
Xu, Z., Zhao, Y., Liew, J., Zhou, X., & Kogut, A. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100510 · Cited by 290
Bird, K. A., Castleman, B. L., & Lohner, G. (2022) · AERA Open · doi:10.1177/23328584221081220 · Cited by 140
“One explanation is that higher-performing students typically have better self-regulatory behaviors, which are thought to be particularly important for success in an online learning environment (see Li et al., 2020, for a thorough review).”
BackgroundUsing trace data to enhance Students' self-regulation: A learning analytics perspective
Ye, D., & Pennisi, S. (2022) · The Internet and Higher Education · doi:10.1016/j.iheduc.2022.100855 · Cited by 69
Wang, Q., & Mousavi, A. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13282 · Cited by 38
Fischer, C., Baker, R., Li, Q., Orona, G. A., & Warschauer, M. (2022) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737211055768 · Cited by 32
Self-citation
Metadata
- Authors
- Li, Q., Baker, R., & Warschauer, M.
- Venue
- The Internet and Higher Education
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 45
- Pages
- 100727
- ISSN
- 1096-7516 (ISSN-L)
- OpenAlex
- W2999859704
- Cited by
- 133
- References
- 27
- FWCI
- 16.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.