Penetrating the black box of time-on-task estimation
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
All forms of learning take time. There is a large body of research suggesting that the amount of time spent on learning can improve the quality of learning, as represented by academic performance. The wide-spread adoption of learning technologies such as learning management systems (LMSs), has resulted in large amounts of data about student learning being readily accessible to educational researchers. One common use of this data is to measure time that students have spent on different learning tasks (i.e., time-on-task). Given that LMS systems typically only capture times when students executed various actions, time-on-task measures are estimated based on the recorded trace data. LMS trace data has been extensively used in many studies in the field of learning analytics, yet the problem of time-on-task estimation is rarely described in detail and the consequences that it entails are not fully examined.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education
Garrison, D. R., Anderson, T., & Archer, W. (1999) · The Internet and Higher Education · doi:10.1016/s1096-7516(00)00016-6 · Cited by 6,619 · cited 1×
“Using a specifically designed tracing application that was installed on computers of 1,249 participants, Judd [29] found that Facebook users spent almost 10% of their study time on Facebook rather than studying [29].”
MethodCritical thinking, cognitive presence, and computer conferencing in distance education
Garrison, D. R., Anderson, T., & Archer, W. (2001) · American Journal of Distance Education · doi:10.1080/08923640109527071 · Cited by 3,044 · cited 1×
“In addition to the previously mentioned work drawing on research from Web mining, there are also more recent studies from the fields of learning analytics (LA) and educational data mining (EDM) that adopt novel strategies to address the issues of time-on-task estimation.”
BackgroundEducational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
Carroll, J. B. (1963) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146816306400801 · Cited by 1,408
Mining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045
Self-citationCharacterizing browsing strategies in the World-Wide web
Catledge, L. D., & Pitkow, J. E. (1995) · Computer Networks and ISDN Systems · doi:10.1016/0169-7552(95)00043-7 · Cited by 937 · cited 1×
“5 minutes to be an average duration of Web session [10].”
BackgroundFacebook and texting made me do it: Media-induced task-switching while studying
Rosen, L. D., Mark Carrier, L., & Cheever, N. A. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.12.001 · Cited by 875 · cited 3×
“Despite prior warnings by Karweit and Slavin [31] regarding time on task estimation, recent empirical studies [8, 29, 53] continue to illustrate the complexities and possible inaccuracies linked to time estimation in the digital age that is characterized with high levels of student distraction and multi-tasking.”
BackgroundWhat else do college students “do” while studying? An investigation of multitasking
Calderwood, C., Ackerman, P. L., & Conklin, E. M. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.02.004 · Cited by 201 · cited 3×
“Despite prior warnings by Karweit and Slavin [31] regarding time on task estimation, recent empirical studies [8, 29, 53] continue to illustrate the complexities and possible inaccuracies linked to time estimation in the digital age that is characterized with high levels of student distraction and multi-tasking.”
BackgroundMaking sense of multitasking: The role of Facebook
Judd, T. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.08.013 · Cited by 135
Quality of e-learners’ time and learning performance beyond quantitative time-on-task
Romero, M., & Barberà, E. (2011) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v12i5.999 · Cited by 96 · cited 1×
“Some studies also used self-reported data on the amount of time students spent using the system [e.g., 52, 27, 18], and this approach raises an additional set of reliability challenges [56].”
Method
Cited by
The current landscape of learning analytics in higher education
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.027 · Cited by 766
Predicting Student Performance from LMS Data: A Comparison of 17 Blended Courses Using Moodle LMS
Conijn, R., Snijders, C., Kleingeld, A., & Matzat, U. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2616312 · Cited by 371
Cerezo, R., Sánchez-Santillán, M., Paule-Ruiz, M. P., & Núñez, J. C. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.02.006 · Cited by 321
Maldonado-Mahauad, J., Pérez-Sanagustín, M., Kizilcec, R. F., Morales, N., & Munoz-Gama, J. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.11.011 · Cited by 299
How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C. (2018) · Review of Educational Research · doi:10.3102/0034654317740335 · Cited by 182
Self-citation
Metadata
- Authors
- Kovanović, V., Gašević, D., Dawson, S., Joksimović, S., Baker, R. S., & Hatala, M.
- Venue
- Proceedings of the Fifth International Conference on Learning Analytics And Knowledge
- Publisher
- ACM
- Published
- 2015-03-16
- Pages
- 184-193
- OpenAlex
- W2090861833
- Cited by
- 120
- References
- 10
- FWCI
- 9.57
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Penetrating the black box of time-on-task estimation. https://app.cochat.ai/papers/10.1145/2723576.2723623
- The paper
- Kovanović, V., Gašević, D., Dawson, S., Joksimović, S., Baker, R. S., & Hatala, M. (2015). Penetrating the black box of time-on-task estimation. Proceedings of the Fifth International Conference on Learning Analytics And Knowledge. https://doi.org/10.1145/2723576.2723623
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.