Towards a fuller picture: Triangulation and integration of the measurement of self‐regulated learning based on trace and think aloud data
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Background: Many learners struggle to productively self‐regulate their learning. To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL. To measure these processes, contemporary SRL researchers have largely utilized think aloud or trace data, however, not without challenges. Objectives: In this paper, we present the findings of a study that investigated how concurrent analysis and integration of think aloud and trace data could advance the measurement of SRL and assist in better understanding the mechanisms of SRL processes, especially those details that remain obscured by observing each data channel individually. Methods: We concurrently collected think aloud and trace data generated by 44 university students in a laboratory setting and analysed those data relative to the same timeline. Results: We found that the two data channels could be interchangeably used to measure SRL processes for only 17.18% of all the time segments identified in a learning task. Moreover, SRL processes for around 45% of all the time segments could be detected via either trace data or think aloud data. For another 27.17% of all the time segments, different SRL processes were detected in both data channels. Conclusions: Our results largely suggest that the two data collection methods can be used to complement each other in measuring SRL. In particular, we found that think aloud and trace data could provide different perspectives on SRL. The integration of the two methods further allowed us to reveal a more complex and more comprehensive temporal associations among SRL processes compared to using a single data collection method. In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Zimmerman, B. J. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50031-7 · Cited by 6,069
The Role of Goal Orientation in Self-Regulated Learning
Pintrich, P. R. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50043-3 · Cited by 5,173
A Review of Self-regulated Learning: Six Models and Four Directions for Research
Panadero, E. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00422 · Cited by 2,915
Broadbent, J., & Poon, W. L. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.04.007 · Cited by 1,692
Self-Regulated Learning: Beliefs, Techniques, and Illusions
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143823 · Cited by 1,468
Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.001 · Cited by 1,003
Self-regulated learning: the educational legacy of Paul R. Pintrich.
Schunk, D. H. (2005) · Educational Psychologist · doi:10.1207/s15326985ep4002_3 · Cited by 678
Azevedo, R., & Gašević, D. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.03.025 · Cited by 345
Self-citationThe mechanisms of working memory capacity: Primary memory, secondary memory, and attention control
Shipstead, Z., Lindsey, D. R. B., Marshall, R. L., & Engle, R. W. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.01.004 · Cited by 330
Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning
Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107547 · Cited by 198
Self-citationBannert, M., & Mengelkamp, C. (2008) · Metacognition and Learning · doi:10.1007/s11409-007-9009-6 · Cited by 198
Self-citationWhat multimodal data can tell us about the students’ regulation of their learning process?
Järvelä, S., Malmberg, J., Haataja, E., Sobocinski, M., & Kirschner, P. A. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.004 · Cited by 163
Analytics of time management strategies in a flipped classroom
Ahmad Uzir, N., Gašević, D., Matcha, W., Jovanović, J., & Pardo, A. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12392 · Cited by 129
Self-citationTowards investigating the validity of measurement of self-regulated learning based on trace data
Fan, Y., van der Graaf, J., Lim, L., Raković, M., Singh, S., Kilgour, J., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09291-1 · Cited by 101
Self-citationWinne, P. H., Hadwin, A. F., & Gress, C. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2007.09.009 · Cited by 83
Do Instrumentation Tools Capture Self-Regulated Learning?
van der Graaf, J., Lim, L., Fan, Y., Kilgour, J., Moore, J., Bannert, M., Gasevic, D., & Molenaar, I. (2021) · LAK21: 11th International Learning Analytics and Knowledge Conference · doi:10.1145/3448139.3448181 · Cited by 44
Self-citationUsing Learner Trace Data to Understand Metacognitive Processes in Writing from Multiple Sources
Rakovic, M., Fan, Y., van der Graaf, J., Singh, S., Kilgour, J., Lim, L., Moore, J., Bannert, M., Molenaar, I., & Gasevic, D. (2022) · LAK22: 12th International Learning Analytics and Knowledge Conference · doi:10.1145/3506860.3506876 · Cited by 27
Self-citation
Cited by
Adapting Self-Regulated Learning in an Age of Generative Artificial Intelligence Chatbots
Lai, J. W. (2024) · Future Internet · doi:10.3390/fi16060218 · Cited by 51
Evidence-centered Assessment for Writing with Generative AI
Cheng, Y., Lyons, K., Chen, G., Gašević, D., & Swiecki, Z. (2024) · Proceedings of the 14th Learning Analytics and Knowledge Conference · doi:10.1145/3636555.3636866 · Cited by 29
Self-citationOn the role of engagement in automated feedback effectiveness: Insights from keystroke logging
Schiller, R., Fleckenstein, J., Höft, L., Horbach, A., & Meyer, J. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105386 · Cited by 14
Metadata
- Authors
- Fan, Y., Rakovic, M., van der Graaf, J., Lim, L., Singh, S., Moore, J., Molenaar, I., Bannert, M., & Gašević, D.
- Venue
- Journal of Computer Assisted Learning
- Publisher
- Wiley
- Published
- 2023-03-05
- Volume
- 39
- Issue
- 4
- Pages
- 1303-1324
- ISSN
- 0266-4909 (ISSN-L)
- 1365-2729
- OpenAlex
- W4323317316
- Cited by
- 59
- References
- 17
- FWCI
- 28.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.