The benefits and caveats of using clickstream data to understand student self-regulatory behaviors: opening the black box of learning processes
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Student clickstream data—time-stamped records of click events in online courses—can provide fine-grained information about student learning. Such data enable researchers and instructors to collect information at scale about how each student navigates through and interacts with online education resources, potentially enabling objective and rich insight into the learning experience beyond self-reports and intermittent assessments. Yet, analyses of these data often require advanced analytic techniques, as they only provide a partial and noisy record of students’ actions. Consequently, these data are not always accessible or useful for course instructors and administrators. In this paper, we provide an overview of the use of clickstream data to define and identify behavioral patterns that are related to student learning outcomes. Through discussions of four studies, we provide examples of the complexities and particular considerations of using these data to examine student self-regulated learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
RETRACTED: Procrastination, Deadlines, and Performance: Self-Control by Precommitment
Ariely, D., & Wertenbroch, K. (2002) · Psychological Science · doi:10.1111/1467-9280.00441 · Cited by 1,266
RetractedMotivational and self-regulated learning components of classroom academic performance.
Pintrich, P. R., & De Groot, E. V. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.33 · Cited by 8,332
Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq)
Pintrich, P. R., Smith, D. A. F., Garcia, T., & Mckeachie, W. J. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053003024 · Cited by 3,646
A Conceptual Framework for Assessing Motivation and Self-Regulated Learning in College Students
Pintrich, P. R. (2004) · Educational Psychology Review · doi:10.1007/s10648-004-0006-x · Cited by 3,269
Broadbent, J., & Poon, W. L. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.04.007 · Cited by 1,692
Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.001 · Cited by 1,003
College students' time management: Correlations with academic performance and stress.
Macan, T. H., Shahani, C., Dipboye, R. L., & Phillips, A. P. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.4.760 · Cited by 933
Does Training on Self-Regulated Learning Facilitate Students' Learning With Hypermedia?
Azevedo, R., & Cromley, J. G. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.3.523 · Cited by 859
Chun Chu, A. H., & Choi, J. N. (2005) · The Journal of Social Psychology · doi:10.3200/socp.145.3.245-264 · Cited by 765
Retention in Online Courses: Exploring Issues and Solutions—A Literature Review
Bawa, P. (2016) · Sage Open · doi:10.1177/2158244015621777 · Cited by 486
Cited by
Dobashi, K., Ho, C. P., Fulford, C. P., Grace Lin, M.-F., & Higa, C. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100105 · Cited by 35
Fischer, C., Baker, R., Li, Q., Orona, G. A., & Warschauer, M. (2022) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737211055768 · Cited by 32
Self-citationA Conceptual Framework to Integrate Research Programs on Self-Regulation in Education
Wortha, F., Gerjets, P., Azevedo, R., Bernacki, M., Brucker, B., Bühler, B., Ehlis, A.-C., Kasneci, E., Miyake, A., Murayama, K., et al. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10196-7
“…barrier to advancing self-regulatory research in education is the structural measurement gap separating retrospective self-reports from the dynamic, real-time regulatory processes they are intended to capture (Arizmendi et al., 2023; Baker et al., 2020; Du et al., 2023; Roth et al., 2016).”
Metadata
- Authors
- Baker, R., Xu, D., Park, J., Yu, R., Li, Q., Cung, B., Fischer, C., Rodriguez, F., Warschauer, M., & Smyth, P.
- Venue
- International Journal of Educational Technology in Higher Education
- Published
- 2020-04-14
- Volume
- 17
- Issue
- 1
- ISSN
- 2365-9440 (ISSN-L)
- OpenAlex
- W3030235465
- Cited by
- 107
- References
- 20
- FWCI
- 11.60
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The benefits and caveats of using clickstream data to understand student self-regulatory behaviors: opening the black box of learning processes. https://app.cochat.ai/papers/10.1186/s41239-020-00187-1
- The paper
- Baker, R., Xu, D., Park, J., Yu, R., Li, Q., Cung, B., Fischer, C., Rodriguez, F., Warschauer, M., & Smyth, P. (2020). The benefits and caveats of using clickstream data to understand student self-regulatory behaviors: opening the black box of learning processes. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-020-00187-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.