Cited by 12Online Learning and AnalyticsMobile Learning in EducationOnline and Blended Learning

When Do Learners Study?

Open access
Sher, Varshita, Hatala, Marek, Gašević, Dragan·2022·Journal of Learning Analytics

Abstract

Recent advances in smart devices and online technologies have facilitated the emergence of ubiquitous learning environments for participating in different learning activities. This poses an interesting question about modality access, i.e., what students are using each platform for and at what time of day. In this paper, we present a log-based exploratory study on learning management system (LMS) use comparing three different modalities—computer, mobile, and tablet—based on the aspect of time. Our objective is to better understand how and to what extent learning sessions via mobiles and tablets occur at different times throughout the day compared to computer sessions. The complexity of the question is further intensified because learners rarely use a single modality for their learning activities but rather prefer a combination of two or more. Thus, we check the associations between patterns of modality usage and time of day as opposed to the counts of modality usage and time of day. The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns. For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night. On comparison of these time-of-day preferences with respect to modalities on weekdays and weekends, they were found consistent for computer-dominant and limited-computer learners only. We demonstrate the implication of this research for enhancing contextual profiling and subsequently improving the personalization of learning systems such that personalized notification systems can be integrated with LMSs to deliver notifications to students at appropriate times.

AI snapshot

Written from the paper’s full text.

TL;DR

This exploratory log study examines when learners use computers, mobiles, and tablets in a blended LMS context, focusing on time-of-day and weekday/weekend patterns. It finds significant modality–time associations, with mobile sessions more frequent in the afternoon and short-computer sessions more frequent at night, though patterns differ by learner modality profile and weekday/weekend.

Key findings

  • Across 18,895 sessions from 120 students, session modality profile was significantly associated with time of day: χ²(9) = 374.90, p < .001. The association held within each student cluster: computer-dominant χ²(9) = 124.76, limited-computer χ²(9) = 153.51, and intensive χ²(9) = 150.13, all p < .001.
  • Mobile-oriented sessions were more frequent in the afternoon, while short-computer sessions were more frequent at night. For computer-dominant learners, mobile sessions were 7.5% of afternoon sessions vs. 2.7% of night sessions, and short-computer sessions were 59.1% of night sessions vs. 49.3% of afternoon sessions. For limited-computer learners, mobile sessions were 25.3% of afternoon vs. 9.8% of night sessions, and short-computer sessions were 56.6% of night vs. 41.3% of afternoon sessions. For intensive learners, mobile sessions were 49.3% of afternoon vs. 30.4% of night sessions, and short-computer sessions were 40.5% of night vs. 27.0% of afternoon sessions.
  • Weekday/weekend associations were significant for computer-dominant (χ²(3) = 87.48, p < .001), limited-computer (χ²(3) = 36.84, p < .001), and intensive learners (χ²(3) = 63.57, p < .001). Weekdays had significantly more afternoon and evening sessions, while weekends had significantly more morning and night sessions.
  • The four sequence clusters were Diverse (N = 1,498, 7.9%), Mobile Oriented (N = 2,684, 14.2%), Short-Computer Oriented (N = 9,571, 50.6%), and Computer Oriented (N = 5,142, 27.2%). Student clusters were Computer-Dominant (N = 47, 39.16%), Limited-Computer (N = 52, 43.33%), and Intensive (N = 21, 17.5%); median final grades were 68.38, 54.91, and 62.6, respectively, with limited-computer learners performing significantly lower than computer-dominant (p = .008) and intensive learners (p = .002).

Methods

  • Log-based exploratory study of LMS trace data from second- and third-year undergraduates in two programming-oriented blended courses at a Canadian university, collected over Fall 2017 and Spring 2018 from students in the same time zone. Enrollment was 121 students (83 + 38); after removing one outlier, 120 students and 18,895 study sessions were analyzed.
  • Actions were grouped into sessions using a >30-minute gap. Modality was derived from user-agent fields (computer, mobile, tablet, unknown). Time of day was categorized as morning (5 a.m.–noon), afternoon (noon–6 p.m.), evening (6–9 p.m.), and night (9 p.m.–5 a.m.), with each session assigned to the TOD where most time was spent.
  • Sequence clustering with TraMineR and Ward’s method produced four technological-modality profiles (TMPs) and three student clusters. Chi-square tests of independence, Bonferroni corrections, adjusted standardized residuals, and column proportion z-tests assessed TMP–TOD and TMP–weekday/weekend associations.

Limitations

  • The paper states that TOD definitions may depend on personal lifestyle and culture, so replication is needed across cultures and diverse cohorts such as distance, lifelong, mature, and e-learners. It also notes the programming-course context may limit generalizability, and that sessions were aggregated across the semester; low median session counts suggest students may not have worked daily, so future work should examine whether session distribution was uniform or clustered into intensive and keep-in-touch days.
  • The paper also states methodological limitations: single-action sessions were eliminated, the clustering methodology may have been overly complex, and a simpler future approach could group sessions by modality and session length into six TMPs.
  • Evident from the text: time-on-task assumes all time between logged events was spent on learning, the last event in a session was capped at 15 minutes because the LMS does not record explicit logout, and the study is exploratory and does not establish causal effects of timing or notifications.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.18608/jla.2022.6697

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

6 of 54 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured

  • Premisecitation
    § 4.2 Implications for Research and Practice · p. 17

    Stockwell (2010) found no instances of learners acting on activities within a six-hour period after receiving an email notification.

    “The author found no instances of learners acting on the activities within a six-hour period after receiving the email notification from the server.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Stockwell, 2010 source

      The Data Collection and Analysis section says the server logs recorded activity start and completion times, but does not report responses to email notifications. Implications for Further Research proposes sending email reminders as a future option. Searches for a six-hour period and server email notifications found no passage reporting the claimed finding. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Premisereasoning
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    The problem experienced in the Stockwell (2010) study is a common occurrence in distance and e-learning.

    “The problem experienced in the Stockwell (2010) study is a common occurrence in distance and e-learning”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Stockwell (2010) source

      The Conclusion (page unavailable) identifies problems in the study, including learners’ reluctance to try mobile technology and the longer time activities could take on phones. It does not establish that any of these problems is a common occurrence in distance and e-learning generally; the citing sentence also does not specify which problem it means. (LLM, conf=0.79)

      Experimental — accuracy not yet measured
  • Findingown data
    § Abstract · p. 1

    Intensive learners show completely different patterns in their session-time distribution compared to computer-dominant and limited-computer learners.

    “The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
  • Findingown data
    § Abstract · p. 1

    For all students, sessions on mobile devices are more frequent in the afternoon.

    “For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
  • Findingown data
    § Notes for Practice · p. 1

    The modality-TOD associations were similar on weekdays and weekends for computer-dominant and limited-computer learners.

    “The modality-TOD associations were similar on weekdays and weekends for computer-dominant and limited-computer learners, two groups that are strikingly different in terms of their academic performance.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
  • Classified as probably not a substantial claim. 41
  • May combine two claims. 38
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 1. Introduction · p. 2

    For adult e-learners, evening time-slot is closely related to better academic performance in collaborative activities (r = 0.6).

    “Romero and Barber` a (2011) observed the time spent by adult e-learners on learning activities and reported a close relationship between evening time-slot and better academic performance ( r = 0 . 6) in collaborative activities, whereas both morning ( r = 0 . 9) and evening ( r = 0 . 8) were closely related to academic performance for individual activities.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Romero and Barber` a (2011) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 1. Introduction · p. 2

    For adult e-learners, both morning (r = 0.9) and evening (r = 0.8) are closely related to academic performance for individual activities.

    “Romero and Barber` a (2011) observed the time spent by adult e-learners on learning activities and reported a close relationship between evening time-slot and better academic performance ( r = 0 . 6) in collaborative activities, whereas both morning ( r = 0 . 9) and evening ( r = 0 . 8) were closely related to academic performance for individual activities.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Romero and Barber` a (2011) source
  • Classified as probably not a substantial claim.

    Premisecitation
    § 4.1 Time of Day and Academic Performance · p. 17

    Romero and Barberà (2011) found adult e-learners' academic performance more strongly related to morning and evening.

    “This is in contrast to the observation by Romero and Barber` a (2011), where adult e-learners' academic performance was more strongly related to morning and evening.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Romero & Barberà, 2011 source
  • May combine two claims.

    Premisecitation
    § 4.2 Implications for Research and Practice · p. 17

    Notifications are typically sent at random times or hard-coded times in the LMS app, which might not be based on theoretical/empirical reasoning and might result in undesirable learning impacts.

    “Typically, notifications are sent at a random time of day or whatever time has been hard-coded in the LMS app-which might not be based on theoretical/empirical reasoning, both of which might result in undesirable learning impacts (Tabuenca et al., 2015; Stockwell, 2010).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Tabuenca et al., 2015 source
    • cites Stockwell, 2010 source

      The 'Mobile Phones and Vocabulary Learning' section says teachers controlled the timing and frequency of messages in two studies, and some learners found the messages too frequent. It does not say that LMS notifications are typically random or hard-coded, lack a theoretical or empirical basis, or cause undesirable learning outcomes. The supplied passages give no page number. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingown data
    § JOURNAL OF LEARNING ANALYTICS · p. 10

    For intensive learners, the proportion of mobile-oriented sessions in the afternoon and evening was significantly greater than expected by chance and significantly lower than expected in the morning and at night.

    “For intensive learners, the proportion of mobile-oriented sessions in the afternoon and evening was significantly greater than expected by chance and significantly lower than expected in the morning and at night.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For computer-dominant weekday, limited-computer weekday, limited-computer weekend, and intensive weekday, there were highly significant associations between TMPs and time of day.

    “The tests revealed high statistical significance for four of these tests-computer-dominant weekday ( c 2 ( 9 ) = 117 . 99, p &lt; 0 . 001), limited-computer weekday ( c 2 ( 9 ) = 120 . 30, p &lt; 0 . 001), limited-computer weekend ( c 2 ( 9 ) = 42 . 08, p &lt; 0 . 001), and intensive weekday ( c 2 ( 9 ) = 135 . 26, p &lt; 0 . 001)”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § JOURNAL OF LEARNING ANALYTICS · p. 10

    For computer-dominant students, a higher than expected number of diverse sessions occurred in the afternoon and evening, and a significantly lower than expected number occurred at night.

    “As can be seen from the highlighted cells in Table 2, a higher than expected number of diverse sessions from the computer-dominant students were carried out in the afternoon and evening, while a significantly lower than expected number of diverse sessions took place at night.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing), S4 (based).

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For computer-dominant learners, mobile-oriented sessions afternoon > morning/evening/night on both weekdays and weekends.

    “For mobile-oriented sessions on both weekdays and weekends, the proportion in the afternoon was higher than that in the morning, in the evening, and at night, all three of which were indistinguishable from each other.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For computer-dominant learners, diverse sessions on weekdays afternoon/evening > morning/night; not on weekend.

    “For diverse sessions on weekdays, the proportion of afternoon and evening sessions was greater than that of morning and night sessions, but these results did not hold on the weekend.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § JOURNAL OF LEARNING ANALYTICS · p. 15

    For intensive learners, mobile-oriented sessions afternoon > morning/night on weekdays but not weekends.

    “An interesting observation for the mobile-oriented learning sessions was that the proportion of these types of sessions taking place in the afternoon was significantly greater than those occurring in the morning and at night only on weekdays but not on weekends.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § JOURNAL OF LEARNING ANALYTICS · p. 10

    For computer-dominant students, a lower than expected number of short-computer sessions occurred in the afternoon and evening, and a significantly higher than expected number occurred at night.

    “These patterns were entirely reversed for short-computer sessions in that a lower than expected number of short-computer sessions from the computer-dominant students were carried out in the afternoon and evening, while a significantly higher than expected number of short-computer sessions took place at night.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For limited-computer learners, short-computer sessions night comparable to morning but greater than afternoon and evening on weekdays and weekends.

    “The proportions of short-computer sessions at night on weekdays and weekends were comparable to that of the morning sessions but greater than the proportions of sessions in the afternoon and evening.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 12

    For all strategies, the distribution of learning sessions across times of day on weekends was nearly the same as on weekdays, with maximum activity at night and minimum in the afternoon.

    “Visual inspection reveals that the distribution of sessions across different times during the day on weekends was nearly the same as on weekdays for all the strategies, with the maximum activity taking place at night and the minimum in the afternoon.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For limited-computer learners, diverse sessions: on weekends morning and evening similar; on weekdays evening > morning.

    “Further, the proportions of diverse sessions in the morning and evening on weekends were similar (subscript b common in both), whereas on weekdays, the latter was significantly greater than the former.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.2 Associations between TMPs and Time of Day · p. 8

    For the majority of TMPs in each of the three modality choices, night was the dominant time of day for learning activities, while afternoon registered the lowest traffic.

    “The figure indicates that for the majority of the TMPs in each of the three modality choices, night was the dominant time of day for learning activities to take place, while afternoon registered the lowest traffic.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For computer-dominant learners, computer session proportions across morning, afternoon, evening, and night were indistinguishable on weekends; constant throughout the day.

    “The proportions of computer-dominant learners' computer sessions across morning, afternoon, evening, and night were indistinguishable on weekends (all subscripts are a ). In other words, on weekends, the proportion of computer sessions remained constant throughout the day.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.2 Associations between TMPs and Time of Day · p. 8

    The preferences for time of day were consistent across all three modality choices, and the ratio of morning:afternoon:evening:night sessions was maintained.

    “The figure shows that not only were the preferences consistent across all three modality choices, but the ratio of morning:afternoon:evening:night sessions was also maintained.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 14

    For limited-computer students, mobile-oriented sessions on weekends numbered 29 in the morning and 51 at night, while on weekdays they numbered 94 in the morning and 216 at night.

    “Similarly, for limited-computer students on weekends, the numbers of mobile-oriented sessions in the morning and at night were 29 and 51, respectively, whereas a noticeably larger difference between the two times of day was observed on weekdays (numbers of sessions = 94 and 216, respectively).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.2 Associations between TMPs and Time of Day · p. 8

    Across all learners, there was a preference for night for learning activities, with morning and evening proportions almost comparable, and the fewest sessions in the afternoon.

    “The figure reveals a preference for night for carrying out learning-related activities, while the proportions of sessions during the morning and evening hours were almost comparable. The fewest learning sessions were observed in the afternoon.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 12

    For computer-dominant and limited-computer learners, computer sessions were the next most common TMP after short-computer; for intensive learners, mobile-oriented sessions were next.

    “followed by computer for computer-dominant and limited-computer users, or mobile-oriented sessions for intensive learners.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § JOURNAL OF LEARNING ANALYTICS · p. 20

    Preferences on weekdays were found to be different from those on weekends for all students and depended on the session's modality profiles and learners' modality choice, among other contextual factors.

    “preferences on weekdays were found to be different from those on weekends for all students and instead depended on the session's modality profiles and learners' modality choice, among other contextual factors.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingreasoning
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    Longer study time happens in the evening on weekdays and weekends.

    “when the learner is likely to engage in longer study time, which happens in the evening on weekdays and weekends.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premiseown data
    § 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 7

    TMP4 (Computer Oriented) cluster contained 5,142 sequences, representing 27.2% of all sequences.

    “TMP4 ClusterComputer Oriented ( N = 5 , 142, 27.2%): This cluster was also predominantly focused on actions performed using the computer modality.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 1. Introduction · p. 2

    Individual differences exist with respect to the time of day learners prefer to work.

    “There also exists a considerable body of literature that suggests that individual differences exist with respect to the time of day learners prefer to work.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Loureiro & Garcia-Marques, 2015 source
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisereasoning
    § 1.2 Time and Modality Flexibility in Learning · p. 3

    Associations between modality use and time of day need to be investigated further in blended learning environments.

    “While much has been revealed from the aforementioned studies, associations between modality use and time of day need to be investigated further in blended learning environments.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § 2.1 Study Context · p. 4

    On comparison of the features and functionalities offered by the web-browser and mobile app versions of the LMS, no apparent differences were revealed.

    “On comparison of the features and functionalities offered by the two versions, no apparent differences were revealed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisereasoning
    § 1.4 Significance of the Study · p. 4

    A crucial precursor to creating contextual profiling systems is understanding how learning in the presence of various modalities is apportioned across a day.

    “A crucial precursor to creating such systems is understanding how learning in the presence of various modalities is apportioned across a day.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning
    § 2.3.4 Statistical Analyses · p. 6

    Bonferroni corrections were used to account for possible inflation of Type 1 error from multiple comparisons.

    “To further highlight how these associations changed depending on the technological-modality choices adopted by the student (i.e., student clusters), three separate chi-square tests of independence were carried out for each of the three student clusters identified, after using Bonferroni corrections to account for possible inflation of Type 1 error from multiple comparisons.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premiseown data
    § 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6

    TMP1 (Diverse) cluster contained 1,498 sequences, representing 7.9% of all sequences.

    “TMP1 ClusterDiverse ( N = 1 , 498, 7.9%): This cluster constituted the smallest number of sequences.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 2.2 Learning Traces and Study Sessions · p. 5

    The study sessions were filtered to remove outliers, resulting in 18,895 study sessions across 120 students.

    “Once the study sessions were extracted from the events data (see Sher and colleagues (2019) for details on the extraction process), they were filtered to remove any outliers, which resulted in 18,895 study sessions across 120 students (one student was deemed as an outlier; this student registered an excessively high number of study sessions (506 sessions, compared to a median of 206)).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation
    § 1.2 Time and Modality Flexibility in Learning · p. 3

    Only a limited number of papers have looked at the associations between time flexibility and modality usage from the learner's perspective, and only in very specific application domains.

    “While many researchers have examined the concept of time flexibility from instructional and organization viewpoints (Arneberg et al., 2007; McGorry, 2003), only a limited number of papers have looked at the associations between time flexibility and modality usage from the learner's perspective, and only in very specific application domains.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Arneberg et al., 2007

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites McGorry, 2003 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 1.1 Temporal Study Patterns · p. 3

    Temporal patterns of student activity have helped in the multifaceted analysis of student learning behaviour.

    “Temporal patterns of student activity, e.g., the sequence and timing of student activity (Barbera et al., 2015), have helped in the multifaceted analysis of student learning behaviour.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Barbera et al., 2015 source
  • May combine two claims.

    Premiseown data
    § 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7

    Student Cluster 1 predominantly used the computer modality, with high attachment to TMP3 (short-computer) and TMP4 (computer).

    “This group of students predominantly used the computer modality, which could be demonstrated by a high attachment to profiles TMP3 (short-computer) and TMP4 (computer).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisereasoning
    § 1.2 Time and Modality Flexibility in Learning · p. 3

    Associations between modality use and time of day need to be investigated at the level of sessions (sequence of actions) as opposed to individual actions.

    “Moreover, the associations need to be investigated at the level of sessions (sequence of actions) as opposed to individual actions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 1. Introduction · p. 2

    Individual differences exist with respect to the technological modality learners prefer to use for their learning.

    “Existing research suggests that individual differences exist with respect to the technological modality learners prefer to use for their learning.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Sher, Hatala, & Gaˇ sevi´ c, 2019

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Stockwell, 2010, 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premiseown data
    § 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7

    Student Cluster 2 predominantly used TMP3, then TMP4, and sparingly TMP1 and TMP2.

    “This group of students predominantly used technology in a way consistent with TMP3 (short-computer), then TMP4 (computer), and sparingly the other two profiles (TMP1 and 2).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premiseown data
    § 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7

    Student Cluster 3 generated the most sequences, whose sequences fell into all modality profiles, with TMP2 (mobile) and TMP3 (short-computer) most prominent and used almost equally.

    “It represents those who generated the most sequences, whose sequences fell into all modality profiles, among which TMP2 (mobile) and TMP3 (short-computer) were the most prominent and used almost equally.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premiseown data
    § 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6

    TMP3 (Short-Computer Oriented) cluster contained 9,571 sequences, representing 50.6% of all sequences.

    “TMP3 ClusterShort-Computer Oriented ( N = 9 , 571, 50.6%): This cluster was predominantly focused on actions from the computer modality. It was the biggest of the four TMP clusters, containing more than half of all learning sequences.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premiseown data
    § 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 7

    TMP3 sessions tended to be short, with a median of 3 actions, and the longest session had 22 actions.

    “The learning sessions (and, thus, sequences) in this cluster tended to be short (median = 3 actions in one learning session), with the longest session composed of only 22 actions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductnone given
    § 2.3.4 Statistical Analyses · p. 6

    The columns proportion test uses z-tests to compare column proportions for each TMP after adjusting for multiple comparisons using Bonferroni corrections.

    “The test uses z-tests to compare column (i.e., TOD) proportions for each TMP after adjusting for multiple comparisons using Bonferroni corrections.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S1 (asserted).

    Premisecitation
    § 4. Discussion · p. 16

    Mobile phone sessions are assumed to be more spontaneous and for small actions only.

    “which one would assume to be more spontaneous and for small actions only (Casany Guerrero et al., 2012)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Casany Guerrero et al., 2012

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 12

    The observed weekday/weekend time-of-day preferences are explained by participants being full-time students in daytime classroom learning during the five-day work week, which leaves little room for morning or night learning.

    “These preferences are not surprising since the participants were full-time students engaging in classroom learning during the day throughout the five-day work week, leaving little room for morning learning sessions when getting ready for classes or at night when they are tired.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7

    The clusters differentiated final grade at e2=0.12 power and discussion participation at h2=0.68.

    “These clusters were able to differentiate between students' final grade at e 2 = 0 . 12 power and discussion participation at h 2 = 0 . 68 (Sher et al., 2019).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sher et al., 2019 source
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning
    § 4. Discussion · p. 16

    Intensive learners do not rely entirely on computers for all their learning needs and therefore were successful in reserving a specific modality for a specific time-frame during the day.

    “A possible rationale for this finding could be that unlike computer-dominant and limited-computer learners, intensive learners do not rely entirely on computers for all their learning needs and therefore were successful in reserving the use of a specific modality for a specific time-frame during the day.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premiseown data
    § 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7

    Student Cluster 3 had a lower median grade than the computer-dominant group, but the difference was non-significant.

    “In terms of overall course grade, even though a lower median percentage than the high-performing computer-dominant group was recorded, the differences were non-significant.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Premisecitation
    § 4. Discussion · p. 16

    Previous studies found mobile phone usage restricted to late-night hours between 8 p.m. and midnight.

    “much like the results reported by Song and colleagues (2013) and Casany Guerrero and colleagues (2012), who found that mobile phone usage was restricted to late-night hours between 8 p.m. and midnight”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Song and colleagues (2013)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Casany Guerrero and colleagues (2012)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § 3.3 Associations between TMPs and Weekdays/Weekends · p. 12

    Learning behaviour may depend not only on time of day but also on day of the week, and more specifically on type of day (weekday or weekend).

    “Since the literature supports claims that learning behaviour may depend not only on time of day but also on day of the week, and more specifically type of day (weekday or weekend), we studied the hypothesis separately for weekdays and weekends.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Duck, Rutt, Hoy, & Strejc, 1991 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 4. Discussion · p. 16

    Tabuenca et al. (2015) found students most active on mobile phones from 9 a.m. to 3 p.m.

    “This finding is also partially supported by Tabuenca, Kalz, Drachsler, and Specht (2015), who found that students were most active on their mobile phones from 9 a.m. to 3 p.m.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tabuenca, Kalz, Drachsler, and Specht (2015) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 4. Discussion · p. 16

    Computer-dominant and limited-computer learners are strikingly different in academic performance.

    “two groups that are strikingly different in terms of their academic performance, as reported by Sher and colleagues (2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sher and colleagues (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § Declaration of Conflicting Interest · p. 20

    The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

    “The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning
    § 4.3 Limitations and Future Work · p. 19

    There can be ambiguities in the study's time periods/day slots depending on how they were defined, which usually depends on personal lifestyle and culture.

    “However, there can be some ambiguities depending on how these time periods/day slots were defined, i.e., morning (5 a.m. to noon), afternoon (noon to 6 p.m.), evening (6 p.m. to 9 p.m.), and night (9 p.m. to 5 a.m.), which usually depends on personal lifestyle and culture.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § JOURNAL OF LEARNING ANALYTICS · p. 19

    Goodyear (2011) emphasized the need to understand how learning activities are distributed across different contexts.

    “Goodyear (2011) emphasized the need to understand how learning activities are distributed across different contexts”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Goodyear (2011) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning
    § 4.3 Limitations and Future Work · p. 19

    The study's methodology involves tracking user interaction with the LMS within a programming course, which may raise a concern about the extent to which the results depended on the learning context.

    “since our methodology involves tracking user interaction with the LMS within a programming course, this may raise a concern about the extent to which our results depended on the learning context.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Study design and conductown data
    § 4.3 Limitations and Future Work · p. 19

    The clustering methodology may have been overly complex.

    “after observing the results, we see that the methodology may have been overly complex.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning
    § 4.2 Implications for Research and Practice · p. 17

    Given knowledge of high-quality learning times, students would be able to organize and regulate their activities asynchronously, leading to greater productivity.

    “given the knowledge of high-quality learning times, students would be able to organize and regulate their activities asynchronously, leading to greater productivity.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 4.1 Time of Day and Academic Performance · p. 17

    The contrast with Romero and Barberà is explained by contextual differences: their study was fully online social sciences with written assignments, while our participants were full-time programming students using specific software on computers.

    “A possible explanation might be the contextual differences introduced by the course settings. Their study looked at fully online learners engaging in a social sciences course, graded based on written assignments. By contrast, the participants in our study were full-time students in programming-oriented courses that required them to spend a fair amount of time working on their programming”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given
    § 4.2 Implications for Research and Practice · p. 17

    A typical recommender system cannot aptly judge both the amount and the quality of the time a learner has to engage in a task, wasting learner time and modality as a knowledge asset.

    “As of now, a typical recommender system cannot aptly judge both the amount and the quality of the time a learner has to engage in a task, thereby wasting both learner time and modality as a true knowledge asset.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § Statement on Ethics · p. 20

    Informed consent was obtained from all study participants.

    “Informed consent was obtained from all study participants.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    Students preferred fixed-time mobile notifications over random-time notifications because fixed times allow them to plan their day.

    “Tabuenca and colleagues (2015) studied learner perceptions regarding whether mobile notifications should be sent at random or fixed times and found that students preferred the latter over the former, given that it allows them to plan their day.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tabuenca and colleagues (2015)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning
    § 4.3 Limitations and Future Work · p. 19

    Single actions originate from one modality and thus don't tell us much about whether continued use of a modality was observed for other activities too.

    “Single actions originate from one modality and thus don't tell us much about whether continued use of a modality was observed for other activities too, after a student completed one activity on a particular modality.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning
    § 4.2 Implications for Research and Practice · p. 17

    Knowledge of students' preferred time of day can be leveraged for sending notifications, reminders on preferred modality, or feedback on academic submissions.

    “knowledge of their preferred time of day can be leveraged for sending them notifications, reminders on their preferred modality type, or even feedback regarding their academic submissions.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    Fixed-time notifications, unless modality is considered, entail sending notifications at pre-fixed times on all modalities without capitalizing on the unique capabilities of each modality.

    “Unless modality is taken into consideration, 'fixed' time entails sending notifications, at any level of required effort or urgency, to learners at pre-fixed times on all modalities without capitalizing on the unique capabilities that each modality provides.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § 4.3 Limitations and Future Work · p. 19

    The clustering methodology was set upfront before the authors knew what the results would look like.

    “We set the clustering methodology upfront before we knew what the results would look like”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § Statement on Ethics · p. 20

    All collected data was treated confidentially.

    “All collected data was treated confidentially.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning
    § 4.2 Implications for Research and Practice · p. 17

    Personalized delivery of learning-related recommendations for each individual learner is possible and promising.

    “personalized delivery of learning-related recommendations for each individual learner is possible and also promising.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    Intensive learners would benefit from such notifications if they were sent in the morning on weekdays or weekends.

    “This group would benefit from such notifications if they were sent in the morning on weekdays or weekends.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    The ability to share and distribute information to learners via learning systems is important for extending learning outside the formal classroom.

    “The ability to share and distribute information to learners via learning systems is important for extending learning outside the formal classroom (Cheon, Lee, Crooks, &amp; Song, 2012).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cheon, Lee, Crooks, &amp; Song, 2012 source
  • May combine two claims.

    Interpretationreasoning
    § 4.1 Time of Day and Academic Performance · p. 17

    Evening (and late night) emerged as the preferred time of day for computer-oriented sessions because participants were in class for most of their day.

    “By virtue of our participants being in class for most of their day, evening (and late night) undoubtedly emerged as the preferred time of day for computer-oriented sessions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § Statement on Ethics · p. 20

    This research has been approved by the university ethics board (2014s0127).

    “This research has been approved by the university ethics board (2014s0127).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § JOURNAL OF LEARNING ANALYTICS · p. 18

    Learners might receive instructional content at an inappropriate time, such as late evening when tired or while commuting, which results in ineffective learning.

    “there is a fair possibility that they might receive it at an inappropriate time, say late evening when they are tired (Grundspenkis, Lavendels, Novitsky, &amp; Sitikovs, 2006) or while commuting (Srinivasan, Koehler, &amp; Jin, 2018), which in turn results in ineffective learning.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Grundspenkis, Lavendels, Novitsky, &amp; Sitikovs, 2006

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Srinivasan, Koehler, &amp; Jin, 2018 source
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given
    § 4.1 Time of Day and Academic Performance · p. 17

    Judging one's performance relative to effort is difficult for many university students, mainly because they do not know how much time other students devote to the course.

    “Judging one's performance, especially as it relates to the effort exerted, is difficult for many university students. The challenge mainly originates from not knowing how much time other students devote to working on the course.”
    Quote in the paperNot a substantial claim
71 of 71
  • The authors state this as an assumption.

    The entirety of the time between two logged events was spent on a particular learning activity.

    “with the underlying assumption that the entirety of the time between two logged events was spent on a particular learning activity.”
  • The paper relies on this without support.

    Online learning management systems are regarded as usable anywhere and anytime.

    “the online (learning management) system is regarded as one that can be used anywhere and anytime”
  • The paper relies on this without support.

    Instructional content is delivered without considering whether learners have sufficient time to act on it.

    “the instructional content is delivered without considering whether learners have sufficient time to act on it.”
  • The paper relies on this without support.

    Grade release, informal feedback, and generic tips on planning for SRL require less strain on mental capacities.

    “grade release, informal feedback, and generic tips on planning for self-regulated learning (SRL) require less strain on mental capacities”
  • The paper relies on this without support.

    Prompts concerning the performance phase in SRL or process-level feedback require longer uninterrupted learning sessions.

    “prompts concerning the performance phase in SRL or any feedback at the 'process level' (Hattie &amp; Timperley, 2007), for instance, where competency assessments must be completed (assignments, exams, quizzes) or prepared for (review resources relevant to the upcoming course assignments), require longer uninterrupted learning sessions.”
  • The paper relies on this without support.

    A shorter time span is sufficient for monitoring activities in the LMS.

    “Given that a shorter time span is sufficient for such activities”
  • The paper relies on this without support.

    LMS notifications are predominantly initiated by an educator through their actions.

    “In the context of the LMS, the notifications are predominantly initiated by an educator through their actions”
  • The paper relies on this without support.

    Educators are working according to their own schedules.

    “As educators are working according to their own schedules”
  • The paper relies on this without support.

    There is a gap in current understanding of the temporal frameworks at play when interpreting students' learning activities.

    “there is a gap in our current understanding of the temporal frameworks that are at play when interpreting students' learning activities.”
9 of 9

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Night time slot is called nine hours long

    Minor

    The defined night slot runs from 9 p.m. to 5 a.m., an eight-hour interval, not nine hours.

  • Weekday summary names mobile instead of short-computer sessions

    Minor

    The summary says morning and night had significantly more mobile sessions on weekdays, but Table 4 shows the higher weekday mobile proportions in the afternoon. Its morning-and-night pattern applies to short-computer sessions.

2 of 2

Cites

Flagged first, then by citations

2 of the 60 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. Arneberg, P., Guardia, L., Keegan, D., L˜ ossenko, J., M´ az´ ar, I., Michels, P., &amp; Rekkedal, T. (2007). Analyses of European megaproviders of E-learning. Megatrends Project . https://www.researchgate.net/publication/ 264871599 Analyses of European Megaproviders of E-learning
  2. Grundspenkis, J., Lavendels, J., Novitsky, L., &amp; Sitikovs, V. (2006). Compatibility of the principles of computer-based and classical teachings. In Proceeding of IADIS International Conference Web Based Communities 2006, 26-28 February 2006, San Sebastian, Spain (pp. 335-339).

Cited by

Sorted by citations

Authors
Sher, V., Hatala, M., & Gašević, D.
Affiliations
  • Simon Fraser University (CA)
  • Monash University (AU)
Venue
Journal of Learning Analytics
Published
2022-05-26
Volume
9
Issue
2
Pages
1-23
ISSN
1929-7750 (ISSN-L)
OpenAlex
W4281737179
Cited by
12
References
60
Citations by year
2026: 3 · 2024: 4 · 2023: 3 · 2022: 2
FWCI
1.74
Type
journal article
Language
en
Open access
Locations
  • Journal of Learning Analytics (publishedVersion, cc-by-nc-nd)
  • Monash University Research Portal (Monash University) (submittedVersion, cc-by-nc-nd)
Funders
  • Natural Sciences and Engineering Research Council of Canada
  • Social Sciences and Humanities Research Council of Canada
  • Engineering and Physical Sciences Research Council (EP/L016427/1)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
  • Social Sciences › Education › Online and Blended Learning
Keywords
mobile learning, computer-assisted instruction, time of day, ubiquitous learning, personalized learning systems, personalized notifications, weekday and weekend differences

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review