When Do Learners Study?
Open accessAbstract
Recent advances in smart devices and online technologies have facilitated the emergence of ubiquitous learning environments for participating in different learning activities. This poses an interesting question about modality access, i.e., what students are using each platform for and at what time of day. In this paper, we present a log-based exploratory study on learning management system (LMS) use comparing three different modalities—computer, mobile, and tablet—based on the aspect of time. Our objective is to better understand how and to what extent learning sessions via mobiles and tablets occur at different times throughout the day compared to computer sessions. The complexity of the question is further intensified because learners rarely use a single modality for their learning activities but rather prefer a combination of two or more. Thus, we check the associations between patterns of modality usage and time of day as opposed to the counts of modality usage and time of day. The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns. For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night. On comparison of these time-of-day preferences with respect to modalities on weekdays and weekends, they were found consistent for computer-dominant and limited-computer learners only. We demonstrate the implication of this research for enhancing contextual profiling and subsequently improving the personalization of learning systems such that personalized notification systems can be integrated with LMSs to deliver notifications to students at appropriate times.
AI snapshot
Written from the paper’s full text.
TL;DR
This exploratory log study examines when learners use computers, mobiles, and tablets in a blended LMS context, focusing on time-of-day and weekday/weekend patterns. It finds significant modality–time associations, with mobile sessions more frequent in the afternoon and short-computer sessions more frequent at night, though patterns differ by learner modality profile and weekday/weekend.
Key findings
- Across 18,895 sessions from 120 students, session modality profile was significantly associated with time of day: χ²(9) = 374.90, p < .001. The association held within each student cluster: computer-dominant χ²(9) = 124.76, limited-computer χ²(9) = 153.51, and intensive χ²(9) = 150.13, all p < .001.
- Mobile-oriented sessions were more frequent in the afternoon, while short-computer sessions were more frequent at night. For computer-dominant learners, mobile sessions were 7.5% of afternoon sessions vs. 2.7% of night sessions, and short-computer sessions were 59.1% of night sessions vs. 49.3% of afternoon sessions. For limited-computer learners, mobile sessions were 25.3% of afternoon vs. 9.8% of night sessions, and short-computer sessions were 56.6% of night vs. 41.3% of afternoon sessions. For intensive learners, mobile sessions were 49.3% of afternoon vs. 30.4% of night sessions, and short-computer sessions were 40.5% of night vs. 27.0% of afternoon sessions.
- Weekday/weekend associations were significant for computer-dominant (χ²(3) = 87.48, p < .001), limited-computer (χ²(3) = 36.84, p < .001), and intensive learners (χ²(3) = 63.57, p < .001). Weekdays had significantly more afternoon and evening sessions, while weekends had significantly more morning and night sessions.
- The four sequence clusters were Diverse (N = 1,498, 7.9%), Mobile Oriented (N = 2,684, 14.2%), Short-Computer Oriented (N = 9,571, 50.6%), and Computer Oriented (N = 5,142, 27.2%). Student clusters were Computer-Dominant (N = 47, 39.16%), Limited-Computer (N = 52, 43.33%), and Intensive (N = 21, 17.5%); median final grades were 68.38, 54.91, and 62.6, respectively, with limited-computer learners performing significantly lower than computer-dominant (p = .008) and intensive learners (p = .002).
Methods
- Log-based exploratory study of LMS trace data from second- and third-year undergraduates in two programming-oriented blended courses at a Canadian university, collected over Fall 2017 and Spring 2018 from students in the same time zone. Enrollment was 121 students (83 + 38); after removing one outlier, 120 students and 18,895 study sessions were analyzed.
- Actions were grouped into sessions using a >30-minute gap. Modality was derived from user-agent fields (computer, mobile, tablet, unknown). Time of day was categorized as morning (5 a.m.–noon), afternoon (noon–6 p.m.), evening (6–9 p.m.), and night (9 p.m.–5 a.m.), with each session assigned to the TOD where most time was spent.
- Sequence clustering with TraMineR and Ward’s method produced four technological-modality profiles (TMPs) and three student clusters. Chi-square tests of independence, Bonferroni corrections, adjusted standardized residuals, and column proportion z-tests assessed TMP–TOD and TMP–weekday/weekend associations.
Limitations
- The paper states that TOD definitions may depend on personal lifestyle and culture, so replication is needed across cultures and diverse cohorts such as distance, lifelong, mature, and e-learners. It also notes the programming-course context may limit generalizability, and that sessions were aggregated across the semester; low median session counts suggest students may not have worked daily, so future work should examine whether session distribution was uniform or clustered into intensive and keep-in-touch days.
- The paper also states methodological limitations: single-action sessions were eliminated, the clustering methodology may have been overly complex, and a simpler future approach could group sessions by modality and session length into six TMPs.
- Evident from the text: time-on-task assumes all time between logged events was spent on learning, the last event in a session was capped at 15 minutes because the LMS does not record explicit logout, and the study is exploratory and does not establish causal effects of timing or notifications.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
6 of 54 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured
- Premisecitation§ 4.2 Implications for Research and Practice · p. 17
Stockwell (2010) found no instances of learners acting on activities within a six-hour period after receiving an email notification.
“The author found no instances of learners acting on the activities within a six-hour period after receiving the email notification from the server.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Stockwell, 2010 source
The Data Collection and Analysis section says the server logs recorded activity start and completion times, but does not report responses to email notifications. Implications for Further Research proposes sending email reminders as a future option. Searches for a six-hour period and server email notifications found no passage reporting the claimed finding. (LLM, conf=0.76)
Experimental — accuracy not yet measured
- Premisereasoning§ JOURNAL OF LEARNING ANALYTICS · p. 18
The problem experienced in the Stockwell (2010) study is a common occurrence in distance and e-learning.
“The problem experienced in the Stockwell (2010) study is a common occurrence in distance and e-learning”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Stockwell (2010) source
The Conclusion (page unavailable) identifies problems in the study, including learners’ reluctance to try mobile technology and the longer time activities could take on phones. It does not establish that any of these problems is a common occurrence in distance and e-learning generally; the citing sentence also does not specify which problem it means. (LLM, conf=0.79)
Experimental — accuracy not yet measured
- Findingown data§ Abstract · p. 1
Intensive learners show completely different patterns in their session-time distribution compared to computer-dominant and limited-computer learners.
“The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ Abstract · p. 1
For all students, sessions on mobile devices are more frequent in the afternoon.
“For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ Notes for Practice · p. 1
The modality-TOD associations were similar on weekdays and weekends for computer-dominant and limited-computer learners.
“The modality-TOD associations were similar on weekdays and weekends for computer-dominant and limited-computer learners, two groups that are strikingly different in terms of their academic performance.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ Notes for Practice · p. 1
Short-computer sessions were more frequent at night.
“Overall, mobile were found to be more frequent in the afternoon and short-computer sessions at night.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ Abstract · p. 1
The proportion of computer sessions was higher at night.
“For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 6
The sequence-clustering algorithm produced four clusters, i.e., technological-modality profiles (TMPs).
“The sequence-clustering algorithm produced four clusters, i.e., technological-modality profiles (TMPs).”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
Computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution.
“The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ Notes for Practice · p. 1
Overall, mobile sessions were more frequent in the afternoon.
“Overall, mobile were found to be more frequent in the afternoon and short-computer sessions at night.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingown data§ Notes for Practice · p. 1
Learning sessions from various modalities are significantly associated with the time of day and day of the week (weekday or weekend) for computer-dominant, intensive, and limited-computer learners.
“Our results suggest that learning sessions from various modalities are significantly associated with the time of day and day of the week (weekday or weekend), and this holds true for students who made extensive use of different modalities to complete their learning activities (computer-dominant and intensive learners) and those who sparingly used them (limited-computer learners).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The entirety of the time between two logged events was spent on a particular learning activity.
- Findingreasoning§ 4. Discussion · p. 16
Long computer sessions were more consistently dispersed throughout the day for all learners except intensive learners, who preferred night-time.
“Engagement in long computer sessions was somewhat more consistently dispersed throughout the day for all learners except intensive learners, who demonstrated a preference for night-time.”
Quote in the paperSubstantial claim - Findingnone given§ JOURNAL OF LEARNING ANALYTICS · p. 17
For both computer-dominant and limited-computer learners, evening registered lower-intensity mobile learning sessions than morning, afternoon, and night.
“In fact, for both computer-dominant and limited-computer learners, evening registered lower-intensity mobile learning sessions than morning, afternoon, and night.”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For limited-computer students, a significantly smaller proportion of diverse and mobile-oriented learning sessions occurred at night than in the evening and afternoon.
“For the limited-computer students, a significantly smaller proportion of the diverse and mobile-oriented learning sessions occurred at night than in the evening and afternoon, but a larger proportion of the short-computer learning sessions occurred at night.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For intensive learners' mobile-oriented sessions on weekends, the number of morning sessions (76) was larger than the number of afternoon sessions (26).
“on weekends, the number of morning sessions (number of sessions = 76) was larger than the number of afternoon sessions (number of sessions = 26).”
Quote in the paperNot a substantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For limited-computer learners, mobile-oriented sessions afternoon > morning/evening/night on both weekdays and weekends.
“The proportion of mobile-oriented sessions that were conducted in the afternoons was significantly greater than those in the morning, in the evening, or at night on both weekdays and weekends.”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For computer-dominant students, no consistent preference for time of day was visible across computer-oriented sessions.
“Further, no consistent preference for time of day was visible across the computer-oriented sessions (all subscript a ).”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
Learners frequently opted to use the mobile modality in the afternoons during class times.
“Instead, we found that they frequently opted to use the mobile modality in the afternoons during class times.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
For limited-computer learners, there was a statistically significant association between day of week (weekday vs weekend) and time of day of learning sessions (χ2(3)=36.84, p<0.001), after multiple comparison adjustments.
“limited-computer ( c 2 ( 3 ) = 36 . 84, p < 0 . 001)”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For intensive learners, diverse sessions did not display any consistent preference for any particular time of day.
“However, much like the computer sessions from the computer-dominant and limited-computer users, the intensive learners' diverse sessions did not display any consistent preference for any particular time of day.”
Quote in the paperNot a substantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For computer-dominant learners on weekdays, computer session proportions were constant across time of day.
“However, these trends were replicated across weekdays only for computer sessions”
Quote in the paperNot a substantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 15
For intensive learners, diverse sessions constant across time of day on both weekdays and weekends.
“On the contrary, the proportion of diverse learning sessions remained constant throughout the day on both weekdays and weekends.”
Quote in the paperSubstantial claim - Findingown data§ 4.1 Time of Day and Academic Performance · p. 17
Learning sessions from computer-dominant and intensive learners were performed mostly at night.
“As Figure 2 suggests, the learning sessions from two of the main high-performing groups-computer-dominant and intensive-were performed mostly at night.”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
The associations were similar on weekdays and weekends for computer-dominant and limited-computer learners.
“We also revealed that the associations were similar on weekdays and weekends for computer-dominant and limited-computer learners, two groups that are strikingly different in terms of their academic performance, as reported by Sher and colleagues (2019).”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For limited-computer students, mobile-oriented sessions morning vs night proportions did not differ on weekdays or weekends.
“Similarly, the proportion of limited-computer students' mobile-oriented learning sessions in the morning and at night could not be differentiated from each other on both weekdays and weekends.”
Quote in the paperNot a substantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 15
For intensive learners, computer and short-computer sessions constant across time of day on weekends.
“The proportions of intensive learners' computer and short-computer sessions in the morning, in the afternoon, in the evening, and at night were indistinguishable on weekends (all subscripts are a ). In other words, the proportion of computer-oriented sessions on weekends remained constant throughout the day.”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
Learners with varied modality choices gravitated toward certain times of day, mostly nights, to engage in computer learning sessions.
“we saw that learners with varied modality choices gravitated toward certain times of day, mostly nights, in order to be able to engage in learning sessions on their computers.”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 15
For intensive learners on weekdays, short-computer and computer sessions morning/night > afternoon/evening.
“However, these trends were not replicated on weekdays; i.e., the proportions of morning and night sessions for the short-computer and computer TMPs were significantly greater than those of the afternoon and evening sessions on weekdays.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
Across all modality choices, weekdays had significantly greater afternoon and evening learning sessions than weekends.
“On closer inspection, it was revealed that weekdays witnessed significantly greater afternoon and evening learning sessions, whereas weekends saw a significant surge in morning and night learning sessions, regardless of the learners' modality choice.”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
The associations held true for students with varying technological modality choices (computer-dominant, intensive, limited-computer).
“More interestingly, the associations held true for students with varying technological modality choices, i.e., who made extensive use of different modalities to complete their learning activities (computer-dominant and intensive learners), and those who sparingly used them (limited-computer learners).”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
Learning sessions from various modalities were significantly associated with time of day.
“Our results revealed that learning sessions from various modalities were significantly associated with the time of day these sessions were carried out.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For intensive learners' mobile-oriented sessions on weekends, morning and afternoon proportions did not differ significantly.
“On the contrary, on weekends, the two proportions could not be differentiated.”
Quote in the paperNot a substantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
Across all modality choices, weekends had significantly greater morning and night learning sessions than weekdays.
“whereas weekends saw a significant surge in morning and night learning sessions, regardless of the learners' modality choice.”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
Significantly higher use of mobile phones in the afternoon was prevalent on weekends too.
“However, we found that a significantly higher use of mobile phones in the afternoon was prevalent on weekends too when the learners may not be experiencing any modality restrictions.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For limited-computer learners, computer sessions constant across time of day on both weekdays and weekends.
“The proportions of limited-computer learners' computer sessions across morning, afternoon, evening, and night were indistinguishable on weekdays and weekends (all subscripts are a ). In other words, the proportion of computer sessions on both weekdays and weekends remained constant throughout the day.”
Quote in the paperNot a substantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For intensive learners, for mobile-oriented sessions, the proportion of night sessions was significantly smaller than that of evening and afternoon.
“On the contrary, for the mobile-oriented sessions, the proportion of night sessions was significantly smaller than that of evening and afternoon.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For computer-dominant learners on weekdays, short-computer session proportions in morning and night were significantly greater than in afternoon and evening.
“whereas for short-computer sessions, the proportion of morning and night sessions was significantly greater than that of afternoon and evening sessions.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
On both weekdays and weekends, short-computer learning sessions were the predominant TMP regardless of modality choice.
“The figure indicates that on both weekdays and weekends, short-computer learning sessions were the predominant TMP, regardless of the modality choices adopted by the learner, followed by computer for computer-dominant and limited-computer users, or mobile-oriented sessions for intensive learners.”
Quote in the paperNot a substantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For limited-computer students, a larger proportion of short-computer learning sessions occurred at night.
“For the limited-computer students, a significantly smaller proportion of the diverse and mobile-oriented learning sessions occurred at night than in the evening and afternoon, but a larger proportion of the short-computer learning sessions occurred at night.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
For computer-dominant learners, there was a statistically significant association between day of week (weekday vs weekend) and time of day of learning sessions (χ2(3)=87.48, p<0.001), after multiple comparison adjustments.
“significant associations for computer-dominant ( c 2 ( 3 ) = 87 . 48, p < 0 . 001)”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For limited-computer students, no consistent preference for TOD was displayed for computer-oriented sessions.
“Similar to computer-dominant students, limited-computer students displayed no consistent preference for TOD for computer-oriented sessions.”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
Mobile phone learning sessions took place mostly in the afternoon (and relatively less at night) across all learners, regardless of modality choice.
“Learning sessions on the mobile phone, on the other hand, which one would assume to be more spontaneous and for small actions only (Casany Guerrero et al., 2012), were found to take place mostly in the afternoon (and relatively less at night) across all learners, regardless of their modality choice.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For intensive learners' mobile-oriented sessions on weekdays, the proportion in the afternoon was significantly greater than in the morning.
“Instead, the column proportion tests indicated that the proportion of mobile-oriented sessions in the afternoon was significantly greater than the proportion of mobile-oriented sessions in the morning.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
For intensive learners, there was a statistically significant association between day of week (weekday vs weekend) and time of day of learning sessions (χ2(3)=63.57, p<0.001), after multiple comparison adjustments.
“intensive ( c 2 ( 3 ) = 63 . 57, p < 0 . 001) learners, even after adjustments were made for multiple comparisons.”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
For intensive learners, for short-computer and computer sessions, the proportion of night sessions was significantly greater than the proportion of evening and afternoon sessions.
“For intensive learners, for short-computer and computer sessions, the proportion of night sessions was significantly greater than the proportion of evening and afternoon sessions.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For computer-dominant learners, short-computer sessions on weekends also had constant proportions across time of day.
“Similar trends were observed for short-computer sessions on weekends.”
Quote in the paperNot a substantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14
For computer-dominant weekend and intensive weekend, there were only marginally significant associations between TMPs and time of day.
“but only marginally significant results for the remaining two-computer-dominant weekend ( c 2 ( 9 ) = 26 . 80, p = 0 . 002) and intensive weekend ( c 2 ( 9 ) = 23 . 15, p = 0 . 006).”
Quote in the paperNot a substantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 10
There was a significant association between TMP cluster allocation and time of day for all sessions (n=18,895 from 120 students), χ2(9)=374.90, p<0.001.
“The chi-square test revealed a significant association between the cluster allocation for a session and the time of day the session was carried out ( c 2 ( 9 ) = 374 . 90, p < 0 . 001).”
Quote in the paperSubstantial claim - Findingown data§ 4. Discussion · p. 16
Concrete temporal patterns were visible only for short computer sessions.
“However, such concrete temporal patterns were visible only for short computer sessions.”
Quote in the paperSubstantial claim - Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
For limited-computer students, evening session proportions were similar on weekdays and weekends.
“except for evening sessions for the limited-computer students, wherein similar proportions on weekdays and weekends were observed.”
Quote in the paperNot a substantial claim - Findingown data§ 4.3 Limitations and Future Work · p. 19
The median number of total sessions was low for all three student groups.
“the rather low median number of total sessions, for all three student groups”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 18
The authors found recurrent temporal patterns for learners with varying TMPs.
“we found some recurrent temporal patterns for learners with varying TMPs”
Quote in the paperSubstantial claim - Findingown data§ 4.2 Implications for Research and Practice · p. 17
There were commonalities across all TMP strategies, such as afternoon for mobile sessions and evening for computer sessions.
“there were also some commonalities across all TMP strategies that can be adapted for practical purposes (such as afternoon for mobile sessions and evening for computer sessions).”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 18
Afternoon is the more favourable time for mobile-oriented learning sessions.
“our results report afternoon as the more favourable time for mobile-oriented learning sessions.”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 20
Short computer sessions were observed to be more prominent at night (9 p.m. to 5 a.m.) than at other times during the day.
“short computer sessions were observed to be more prominent at night (9 p.m. to 5 a.m.) than at other times during the day”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 20
Learners typically selected different times of day to engage with the LMS depending on whether the activity required them to use computers or mobiles or whether the session was long or short.
“Learners typically selected different times of day to engage with the LMS depending on whether the activity required them to use computers or mobiles or whether the session was long or short.”
Quote in the paperSubstantial claim - Findingown data§ 4.3 Limitations and Future Work · p. 19
Learners undertake learning activities at a range of times.
“the observation from the current study is that learners undertake these activities at a range of times.”
Quote in the paperNot a substantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 18
Significantly different learning patterns emerged based on time of day and modality.
“significantly different learning patterns emerged based on time of day and modality”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 20
Mobile sessions were significantly higher in number in the afternoon (noon to 6 p.m.) than during the rest of the day.
“mobile sessions were significantly higher in number in the afternoon (noon to 6 p.m.) than during the rest of the day.”
Quote in the paperSubstantial claim - Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 20
The results from the study revealed patterns of use indicating that there are quite significant differences in how learners undertake learning using multiple modalities.
“The results from the study revealed patterns of use indicating that there are quite significant differences in how learners undertake learning using multiple modalities.”
Quote in the paperSubstantial claim - Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 7
TMP4 was predominantly focused on actions performed using the computer modality.
“This cluster was also predominantly focused on actions performed using the computer modality.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6
TMP1 sequences were composed of actions from a wide range of modalities (computers, mobiles, tablets, and unknown).
“The grouping comprised learning sequences composed of actions from a wide range of modalities (computers, mobiles, tablets, and unknown).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
Student Cluster 1 was limited in its use of multiple technological modalities.
“Hence, from the modality use perspective, this group was limited in its use of multiple technological modalities.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
Student Cluster 1 was the highest-performing group in terms of final course grade.
“It was the highest-performing group in terms of the final course grade.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6
TMP1 sequences were relatively short, with a median of 3 actions per learning session.
“This strategy cluster contained relatively short learning sequences (median = 3 actions in one learning session).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
Student Cluster 2 (Limited-Computer) had 52 students (43.33%).
“Student Cluster 2Limited-Computer Users ( N = 52, 43.33%): This group of students predominantly used technology in a way consistent with TMP3 (short-computer), then TMP4 (computer), and sparingly the other two profiles (TMP1 and 2).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
Student Cluster 3 (Intensive) had 21 students (17.5%).
“Student Cluster 3Intensive Users ( N = 21, 17.5%): This cluster constitutes the smallest group of students.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6
TMP3 was predominantly focused on actions from the computer modality.
“This cluster was predominantly focused on actions from the computer modality.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6
TMP2 had the greatest number of learning actions per session, with a median of 16 actions.
“This profile contained the greatest number of learning actions in a session (median = 16 actions in one learning session).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductcitation§ JOURNAL OF LEARNING ANALYTICS · p. 10
An alpha value of 0.05/16 = 0.003 was used to assess significance, resulting in a threshold value for adjusted residual of 2.96 (Sharpe, 2015).
“However, in our case, given the multiple comparisons within each strategy (four levels of TMP profiles × four levels of TOD categories = 16 comparisons), we used an alpha value of 0.05/16 = 0.003 to assess significance, resulting in a threshold value for adjusted residual of 2.96 (Sharpe, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sharpe, 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
A three-cluster solution was optimal for student clustering based on inspection of the dendrogram and silhouette method.
“A three-cluster solution was concluded to be the optimal choice after inspection of the dendrogram and using the silhouette method (see Sher and colleagues (2019) for details on student clustering).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6
TMP2 (Mobile Oriented) cluster contained 2,684 sequences, representing 14.2% of all sequences.
“TMP2 ClusterMobile Oriented ( N = 2 , 684, 14.2%): Almost twice as many sequences were in this cluster than in the Diverse strategy cluster.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
Student Cluster 2 had the lowest overall number of learning sequences.
“The overall number of learning sequences was by far the lowest of the three student clusters.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 7
TMP4 contained relatively longer learning sessions, with a median of 9 actions.
“However, unlike TMP3, this cluster contained relatively longer learning sessions (median = 9 actions in one learning session).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6
In TMP2, mobile was the most dominant modality for the majority of actions.
“Mobile was the most dominant modality for the majority of actions in the sequences belonging to this cluster.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
Limited-computer learners performed significantly lower than computer-dominant (p=0.008) and intensive (p=0.002) learners on final grade, even after Benjamini-Hochberg adjustment.
“The pairwise comparison of clusters with respect to the final grade (i.e., percentage score) revealed that limited-computer learners performed significantly lower than computer-dominant ( p = 0 . 008) and intensive ( p = 0 . 002) learners, even after adjustments to the p -values using the Benjamini-Hochberg procedure.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher et al., 2019 source
- Interpretationown data§ 4. Discussion · p. 16
The afternoon time slot is the preferred time for mobile learning sessions.
“This further solidifies our finding that the afternoon time slot is indeed the preferred time for mobile learning sessions.”
Quote in the paperSubstantial claim - Interpretationown data§ 3.4 Summary of Results · p. 15
Computer-dominant and limited-computer learners were consistent in their temporal patterns.
“On the other hand, computer-dominant and limited-computer learners were quite consistent in their temporal patterns such that (1) on both weekdays and weekends, significantly greater mobile sessions took place in the afternoon, and (2) on both weekdays and weekends, the proportion of computer sessions remained constant throughout the day, except for short-computer sessions, whose proportion was”
Quote in the paperSubstantial claim - Interpretationown data§ JOURNAL OF LEARNING ANALYTICS · p. 11
Depending on the type of learning session (TMP), different times of day might be more preferable based on a learner's modality choice.
“These results indicate that depending on the type of learning session (TMP), different times of day might be more preferable based on a learner's modality choice.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3.4 Summary of Results · p. 15
Different dynamics are at play depending on whether learning sessions took place on weekend or weekday.
“In other words, different dynamics are at play depending on whether the learning sessions took place on the weekend or on a weekday, and, thus, there is a potential for personalization of feedback pertaining to the specific TMPs, based not only on time of day but also on day of the week.”
Quote in the paperSubstantial claim - Interpretationreasoning§ JOURNAL OF LEARNING ANALYTICS · p. 11
Some preferences overlap based on the learners' modality choices.
“Even though the results indicate no clear 'winner' (in terms of preference or adoption) among the TOD categories, the results indicate that some preferences overlap based on the learners' modality choices.”
Quote in the paperSubstantial claim - Interpretationreasoning§ 3.4 Summary of Results · p. 15
Intensive learners who use multiple modalities exhibit differing temporal patterns on weekdays than on weekends.
“These observations led us to conclude, in a nutshell, that intensive learners who make use of multiple modalities to augment their learning exhibit differing temporal patterns on weekdays than on weekends.”
Quote in the paperSubstantial claim - Premisecitation§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7
The difference in final grade between computer-dominant and intensive learners was not statistically significant.
“However, the difference between the two high-performing groups, i.e., computer-dominant and intensive, was not statistically significant (Sher et al., 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher et al., 2019 source
- Premisecitation§ 4. Discussion · p. 16
Learning on a computer tends to be far more meticulously planned than mobile and tablet counterparts.
“For instance, learning on a computer usually tends to be far more meticulously planned (Stockwell, 2013) than for its mobile and tablet counterparts”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Stockwell, 2013 source
- Interpretationreasoning§ 3.4 Summary of Results · p. 15
There is potential for personalization of feedback pertaining to specific TMPs based on time of day and day of week.
“there is a potential for personalization of feedback pertaining to the specific TMPs, based not only on time of day but also on day of the week.”
Quote in the paperSubstantial claim - Interpretationown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12
Students were in tandem regarding their preferred time of day for learning activities depending on whether it was a weekday or weekend.
“These results indicate that students were in tandem regarding what time of day they would preferably engage with learning activities, based on whether the learning was scheduled to take place on weekdays or on weekends.”
Quote in the paperSubstantial claim - Premisecitation§ JOURNAL OF LEARNING ANALYTICS · p. 18
Notifications that foster participation in studying will be acted on the moment learners receive them.
“Tabuenca and colleagues (2015) noted that notifications that foster participation in studying will be acted on the moment learners receive them.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Tabuenca and colleagues (2015)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data§ JOURNAL OF LEARNING ANALYTICS · p. 20
These differences go beyond simple preferences for one type of modality over the other.
“These differences go beyond simple preferences for one type of modality over the other.”
Quote in the paperSubstantial claim - Interpretationown data§ 4.3 Limitations and Future Work · p. 19
Students may have been working seriously on the course only a couple of days a week, not every day.
“indicates that students may have been working seriously on the course only couple of days a week, not every day.”
Quote in the paperNot a substantial claim - Premisecitation§ 4.1 Time of Day and Academic Performance · p. 17
Limited-computer users are the lowest-performing group.
“students in the lowest-performing group, i.e., limited-computer users”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher et al., 2019 source
- Classified as probably not a substantial claim. 41
- May combine two claims. 38
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 1. Introduction · p. 2For adult e-learners, evening time-slot is closely related to better academic performance in collaborative activities (r = 0.6).
“Romero and Barber` a (2011) observed the time spent by adult e-learners on learning activities and reported a close relationship between evening time-slot and better academic performance ( r = 0 . 6) in collaborative activities, whereas both morning ( r = 0 . 9) and evening ( r = 0 . 8) were closely related to academic performance for individual activities.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Romero and Barber` a (2011) source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 1. Introduction · p. 2For adult e-learners, both morning (r = 0.9) and evening (r = 0.8) are closely related to academic performance for individual activities.
“Romero and Barber` a (2011) observed the time spent by adult e-learners on learning activities and reported a close relationship between evening time-slot and better academic performance ( r = 0 . 6) in collaborative activities, whereas both morning ( r = 0 . 9) and evening ( r = 0 . 8) were closely related to academic performance for individual activities.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Romero and Barber` a (2011) source
Classified as probably not a substantial claim.
Premisecitation§ 4.1 Time of Day and Academic Performance · p. 17Romero and Barberà (2011) found adult e-learners' academic performance more strongly related to morning and evening.
“This is in contrast to the observation by Romero and Barber` a (2011), where adult e-learners' academic performance was more strongly related to morning and evening.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Romero & Barberà, 2011 source
May combine two claims.
Premisecitation§ 4.2 Implications for Research and Practice · p. 17Notifications are typically sent at random times or hard-coded times in the LMS app, which might not be based on theoretical/empirical reasoning and might result in undesirable learning impacts.
“Typically, notifications are sent at a random time of day or whatever time has been hard-coded in the LMS app-which might not be based on theoretical/empirical reasoning, both of which might result in undesirable learning impacts (Tabuenca et al., 2015; Stockwell, 2010).”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Tabuenca et al., 2015 source
- cites Stockwell, 2010 source
The 'Mobile Phones and Vocabulary Learning' section says teachers controlled the timing and frequency of messages in two studies, and some learners found the messages too frequent. It does not say that LMS notifications are typically random or hard-coded, lack a theoretical or empirical basis, or cause undesirable learning outcomes. The supplied passages give no page number. (LLM, conf=0.78)
Experimental — accuracy not yet measured
May combine two claims.
Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 10For intensive learners, the proportion of mobile-oriented sessions in the afternoon and evening was significantly greater than expected by chance and significantly lower than expected in the morning and at night.
“For intensive learners, the proportion of mobile-oriented sessions in the afternoon and evening was significantly greater than expected by chance and significantly lower than expected in the morning and at night.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For computer-dominant weekday, limited-computer weekday, limited-computer weekend, and intensive weekday, there were highly significant associations between TMPs and time of day.
“The tests revealed high statistical significance for four of these tests-computer-dominant weekday ( c 2 ( 9 ) = 117 . 99, p < 0 . 001), limited-computer weekday ( c 2 ( 9 ) = 120 . 30, p < 0 . 001), limited-computer weekend ( c 2 ( 9 ) = 42 . 08, p < 0 . 001), and intensive weekday ( c 2 ( 9 ) = 135 . 26, p < 0 . 001)”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 10For computer-dominant students, a higher than expected number of diverse sessions occurred in the afternoon and evening, and a significantly lower than expected number occurred at night.
“As can be seen from the highlighted cells in Table 2, a higher than expected number of diverse sessions from the computer-dominant students were carried out in the afternoon and evening, while a significantly lower than expected number of diverse sessions took place at night.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing), S4 (based).
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For computer-dominant learners, mobile-oriented sessions afternoon > morning/evening/night on both weekdays and weekends.
“For mobile-oriented sessions on both weekdays and weekends, the proportion in the afternoon was higher than that in the morning, in the evening, and at night, all three of which were indistinguishable from each other.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For computer-dominant learners, diverse sessions on weekdays afternoon/evening > morning/night; not on weekend.
“For diverse sessions on weekdays, the proportion of afternoon and evening sessions was greater than that of morning and night sessions, but these results did not hold on the weekend.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 15For intensive learners, mobile-oriented sessions afternoon > morning/night on weekdays but not weekends.
“An interesting observation for the mobile-oriented learning sessions was that the proportion of these types of sessions taking place in the afternoon was significantly greater than those occurring in the morning and at night only on weekdays but not on weekends.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 10For computer-dominant students, a lower than expected number of short-computer sessions occurred in the afternoon and evening, and a significantly higher than expected number occurred at night.
“These patterns were entirely reversed for short-computer sessions in that a lower than expected number of short-computer sessions from the computer-dominant students were carried out in the afternoon and evening, while a significantly higher than expected number of short-computer sessions took place at night.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For limited-computer learners, short-computer sessions night comparable to morning but greater than afternoon and evening on weekdays and weekends.
“The proportions of short-computer sessions at night on weekdays and weekends were comparable to that of the morning sessions but greater than the proportions of sessions in the afternoon and evening.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12For all strategies, the distribution of learning sessions across times of day on weekends was nearly the same as on weekdays, with maximum activity at night and minimum in the afternoon.
“Visual inspection reveals that the distribution of sessions across different times during the day on weekends was nearly the same as on weekdays for all the strategies, with the maximum activity taking place at night and the minimum in the afternoon.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For limited-computer learners, diverse sessions: on weekends morning and evening similar; on weekdays evening > morning.
“Further, the proportions of diverse sessions in the morning and evening on weekends were similar (subscript b common in both), whereas on weekdays, the latter was significantly greater than the former.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.2 Associations between TMPs and Time of Day · p. 8For the majority of TMPs in each of the three modality choices, night was the dominant time of day for learning activities, while afternoon registered the lowest traffic.
“The figure indicates that for the majority of the TMPs in each of the three modality choices, night was the dominant time of day for learning activities to take place, while afternoon registered the lowest traffic.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For computer-dominant learners, computer session proportions across morning, afternoon, evening, and night were indistinguishable on weekends; constant throughout the day.
“The proportions of computer-dominant learners' computer sessions across morning, afternoon, evening, and night were indistinguishable on weekends (all subscripts are a ). In other words, on weekends, the proportion of computer sessions remained constant throughout the day.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 3.2 Associations between TMPs and Time of Day · p. 8The preferences for time of day were consistent across all three modality choices, and the ratio of morning:afternoon:evening:night sessions was maintained.
“The figure shows that not only were the preferences consistent across all three modality choices, but the ratio of morning:afternoon:evening:night sessions was also maintained.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 14For limited-computer students, mobile-oriented sessions on weekends numbered 29 in the morning and 51 at night, while on weekdays they numbered 94 in the morning and 216 at night.
“Similarly, for limited-computer students on weekends, the numbers of mobile-oriented sessions in the morning and at night were 29 and 51, respectively, whereas a noticeably larger difference between the two times of day was observed on weekdays (numbers of sessions = 94 and 216, respectively).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.2 Associations between TMPs and Time of Day · p. 8Across all learners, there was a preference for night for learning activities, with morning and evening proportions almost comparable, and the fewest sessions in the afternoon.
“The figure reveals a preference for night for carrying out learning-related activities, while the proportions of sessions during the morning and evening hours were almost comparable. The fewest learning sessions were observed in the afternoon.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12For computer-dominant and limited-computer learners, computer sessions were the next most common TMP after short-computer; for intensive learners, mobile-oriented sessions were next.
“followed by computer for computer-dominant and limited-computer users, or mobile-oriented sessions for intensive learners.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ JOURNAL OF LEARNING ANALYTICS · p. 20Preferences on weekdays were found to be different from those on weekends for all students and depended on the session's modality profiles and learners' modality choice, among other contextual factors.
“preferences on weekdays were found to be different from those on weekends for all students and instead depended on the session's modality profiles and learners' modality choice, among other contextual factors.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingreasoning§ JOURNAL OF LEARNING ANALYTICS · p. 18Longer study time happens in the evening on weekdays and weekends.
“when the learner is likely to engage in longer study time, which happens in the evening on weekdays and weekends.”
Quote in the paperNot a substantial claimMay combine two claims.
Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 7TMP4 (Computer Oriented) cluster contained 5,142 sequences, representing 27.2% of all sequences.
“TMP4 ClusterComputer Oriented ( N = 5 , 142, 27.2%): This cluster was also predominantly focused on actions performed using the computer modality.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 1. Introduction · p. 2Individual differences exist with respect to the time of day learners prefer to work.
“There also exists a considerable body of literature that suggests that individual differences exist with respect to the time of day learners prefer to work.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Loureiro & Garcia-Marques, 2015 source
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
Premisereasoning§ 1.2 Time and Modality Flexibility in Learning · p. 3Associations between modality use and time of day need to be investigated further in blended learning environments.
“While much has been revealed from the aforementioned studies, associations between modality use and time of day need to be investigated further in blended learning environments.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ 2.1 Study Context · p. 4On comparison of the features and functionalities offered by the web-browser and mobile app versions of the LMS, no apparent differences were revealed.
“On comparison of the features and functionalities offered by the two versions, no apparent differences were revealed.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Premisereasoning§ 1.4 Significance of the Study · p. 4A crucial precursor to creating contextual profiling systems is understanding how learning in the presence of various modalities is apportioned across a day.
“A crucial precursor to creating such systems is understanding how learning in the presence of various modalities is apportioned across a day.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoning§ 2.3.4 Statistical Analyses · p. 6Bonferroni corrections were used to account for possible inflation of Type 1 error from multiple comparisons.
“To further highlight how these associations changed depending on the technological-modality choices adopted by the student (i.e., student clusters), three separate chi-square tests of independence were carried out for each of the three student clusters identified, after using Bonferroni corrections to account for possible inflation of Type 1 error from multiple comparisons.”
Quote in the paperNot a substantial claimMay combine two claims.
Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6TMP1 (Diverse) cluster contained 1,498 sequences, representing 7.9% of all sequences.
“TMP1 ClusterDiverse ( N = 1 , 498, 7.9%): This cluster constituted the smallest number of sequences.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown data§ 2.2 Learning Traces and Study Sessions · p. 5The study sessions were filtered to remove outliers, resulting in 18,895 study sessions across 120 students.
“Once the study sessions were extracted from the events data (see Sher and colleagues (2019) for details on the extraction process), they were filtered to remove any outliers, which resulted in 18,895 study sessions across 120 students (one student was deemed as an outlier; this student registered an excessively high number of study sessions (506 sessions, compared to a median of 206)).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premisecitation§ 1.2 Time and Modality Flexibility in Learning · p. 3Only a limited number of papers have looked at the associations between time flexibility and modality usage from the learner's perspective, and only in very specific application domains.
“While many researchers have examined the concept of time flexibility from instructional and organization viewpoints (Arneberg et al., 2007; McGorry, 2003), only a limited number of papers have looked at the associations between time flexibility and modality usage from the learner's perspective, and only in very specific application domains.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Arneberg et al., 2007
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites McGorry, 2003 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 1.1 Temporal Study Patterns · p. 3Temporal patterns of student activity have helped in the multifaceted analysis of student learning behaviour.
“Temporal patterns of student activity, e.g., the sequence and timing of student activity (Barbera et al., 2015), have helped in the multifaceted analysis of student learning behaviour.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Barbera et al., 2015 source
May combine two claims.
Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7Student Cluster 1 predominantly used the computer modality, with high attachment to TMP3 (short-computer) and TMP4 (computer).
“This group of students predominantly used the computer modality, which could be demonstrated by a high attachment to profiles TMP3 (short-computer) and TMP4 (computer).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable).
Premisereasoning§ 1.2 Time and Modality Flexibility in Learning · p. 3Associations between modality use and time of day need to be investigated at the level of sessions (sequence of actions) as opposed to individual actions.
“Moreover, the associations need to be investigated at the level of sessions (sequence of actions) as opposed to individual actions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 1. Introduction · p. 2Individual differences exist with respect to the technological modality learners prefer to use for their learning.
“Existing research suggests that individual differences exist with respect to the technological modality learners prefer to use for their learning.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Sher, Hatala, & Gaˇ sevi´ c, 2019
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Stockwell, 2010, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7Student Cluster 2 predominantly used TMP3, then TMP4, and sparingly TMP1 and TMP2.
“This group of students predominantly used technology in a way consistent with TMP3 (short-computer), then TMP4 (computer), and sparingly the other two profiles (TMP1 and 2).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7Student Cluster 3 generated the most sequences, whose sequences fell into all modality profiles, with TMP2 (mobile) and TMP3 (short-computer) most prominent and used almost equally.
“It represents those who generated the most sequences, whose sequences fell into all modality profiles, among which TMP2 (mobile) and TMP3 (short-computer) were the most prominent and used almost equally.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 6TMP3 (Short-Computer Oriented) cluster contained 9,571 sequences, representing 50.6% of all sequences.
“TMP3 ClusterShort-Computer Oriented ( N = 9 , 571, 50.6%): This cluster was predominantly focused on actions from the computer modality. It was the biggest of the four TMP clusters, containing more than half of all learning sequences.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premiseown data§ 3.1.1 Clustering of Sequences as Manifestations of Students' TMPs · p. 7TMP3 sessions tended to be short, with a median of 3 actions, and the longest session had 22 actions.
“The learning sessions (and, thus, sequences) in this cluster tended to be short (median = 3 actions in one learning session), with the longest session composed of only 22 actions.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Study design and conductnone given§ 2.3.4 Statistical Analyses · p. 6The columns proportion test uses z-tests to compare column proportions for each TMP after adjusting for multiple comparisons using Bonferroni corrections.
“The test uses z-tests to compare column (i.e., TOD) proportions for each TMP after adjusting for multiple comparisons using Bonferroni corrections.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S1 (asserted).
Premisecitation§ 4. Discussion · p. 16Mobile phone sessions are assumed to be more spontaneous and for small actions only.
“which one would assume to be more spontaneous and for small actions only (Casany Guerrero et al., 2012)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Casany Guerrero et al., 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12The observed weekday/weekend time-of-day preferences are explained by participants being full-time students in daytime classroom learning during the five-day work week, which leaves little room for morning or night learning.
“These preferences are not surprising since the participants were full-time students engaging in classroom learning during the day throughout the five-day work week, leaving little room for morning learning sessions when getting ready for classes or at night when they are tired.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisecitation§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7The clusters differentiated final grade at e2=0.12 power and discussion participation at h2=0.68.
“These clusters were able to differentiate between students' final grade at e 2 = 0 . 12 power and discussion participation at h 2 = 0 . 68 (Sher et al., 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sher et al., 2019 source
Classified as probably not a substantial claim. May combine two claims.
Interpretationreasoning§ 4. Discussion · p. 16Intensive learners do not rely entirely on computers for all their learning needs and therefore were successful in reserving a specific modality for a specific time-frame during the day.
“A possible rationale for this finding could be that unlike computer-dominant and limited-computer learners, intensive learners do not rely entirely on computers for all their learning needs and therefore were successful in reserving the use of a specific modality for a specific time-frame during the day.”
Quote in the paperSubstantial claimMay combine two claims.
Premiseown data§ 3.1.2 Clusters of Students Based on the Adopted TMPs · p. 7Student Cluster 3 had a lower median grade than the computer-dominant group, but the difference was non-significant.
“In terms of overall course grade, even though a lower median percentage than the high-performing computer-dominant group was recorded, the differences were non-significant.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Premisecitation§ 4. Discussion · p. 16Previous studies found mobile phone usage restricted to late-night hours between 8 p.m. and midnight.
“much like the results reported by Song and colleagues (2013) and Casany Guerrero and colleagues (2012), who found that mobile phone usage was restricted to late-night hours between 8 p.m. and midnight”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Song and colleagues (2013)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Casany Guerrero and colleagues (2012)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
Premisecitation§ 3.3 Associations between TMPs and Weekdays/Weekends · p. 12Learning behaviour may depend not only on time of day but also on day of the week, and more specifically on type of day (weekday or weekend).
“Since the literature supports claims that learning behaviour may depend not only on time of day but also on day of the week, and more specifically type of day (weekday or weekend), we studied the hypothesis separately for weekdays and weekends.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Duck, Rutt, Hoy, & Strejc, 1991 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 4. Discussion · p. 16Tabuenca et al. (2015) found students most active on mobile phones from 9 a.m. to 3 p.m.
“This finding is also partially supported by Tabuenca, Kalz, Drachsler, and Specht (2015), who found that students were most active on their mobile phones from 9 a.m. to 3 p.m.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tabuenca, Kalz, Drachsler, and Specht (2015) source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 4. Discussion · p. 16Computer-dominant and limited-computer learners are strikingly different in academic performance.
“two groups that are strikingly different in terms of their academic performance, as reported by Sher and colleagues (2019).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sher and colleagues (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ Declaration of Conflicting Interest · p. 20The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
“The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoning§ 4.3 Limitations and Future Work · p. 19There can be ambiguities in the study's time periods/day slots depending on how they were defined, which usually depends on personal lifestyle and culture.
“However, there can be some ambiguities depending on how these time periods/day slots were defined, i.e., morning (5 a.m. to noon), afternoon (noon to 6 p.m.), evening (6 p.m. to 9 p.m.), and night (9 p.m. to 5 a.m.), which usually depends on personal lifestyle and culture.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Premisecitation§ JOURNAL OF LEARNING ANALYTICS · p. 19Goodyear (2011) emphasized the need to understand how learning activities are distributed across different contexts.
“Goodyear (2011) emphasized the need to understand how learning activities are distributed across different contexts”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Goodyear (2011) source
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoning§ 4.3 Limitations and Future Work · p. 19The study's methodology involves tracking user interaction with the LMS within a programming course, which may raise a concern about the extent to which the results depended on the learning context.
“since our methodology involves tracking user interaction with the LMS within a programming course, this may raise a concern about the extent to which our results depended on the learning context.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Study design and conductown data§ 4.3 Limitations and Future Work · p. 19The clustering methodology may have been overly complex.
“after observing the results, we see that the methodology may have been overly complex.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationreasoning§ 4.2 Implications for Research and Practice · p. 17Given knowledge of high-quality learning times, students would be able to organize and regulate their activities asynchronously, leading to greater productivity.
“given the knowledge of high-quality learning times, students would be able to organize and regulate their activities asynchronously, leading to greater productivity.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationreasoning§ 4.1 Time of Day and Academic Performance · p. 17The contrast with Romero and Barberà is explained by contextual differences: their study was fully online social sciences with written assignments, while our participants were full-time programming students using specific software on computers.
“A possible explanation might be the contextual differences introduced by the course settings. Their study looked at fully online learners engaging in a social sciences course, graded based on written assignments. By contrast, the participants in our study were full-time students in programming-oriented courses that required them to spend a fair amount of time working on their programming”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone given§ 4.2 Implications for Research and Practice · p. 17A typical recommender system cannot aptly judge both the amount and the quality of the time a learner has to engage in a task, wasting learner time and modality as a knowledge asset.
“As of now, a typical recommender system cannot aptly judge both the amount and the quality of the time a learner has to engage in a task, thereby wasting both learner time and modality as a true knowledge asset.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ Statement on Ethics · p. 20Informed consent was obtained from all study participants.
“Informed consent was obtained from all study participants.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ JOURNAL OF LEARNING ANALYTICS · p. 18Students preferred fixed-time mobile notifications over random-time notifications because fixed times allow them to plan their day.
“Tabuenca and colleagues (2015) studied learner perceptions regarding whether mobile notifications should be sent at random or fixed times and found that students preferred the latter over the former, given that it allows them to plan their day.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tabuenca and colleagues (2015)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Interpretationreasoning§ 4.3 Limitations and Future Work · p. 19Single actions originate from one modality and thus don't tell us much about whether continued use of a modality was observed for other activities too.
“Single actions originate from one modality and thus don't tell us much about whether continued use of a modality was observed for other activities too, after a student completed one activity on a particular modality.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
Interpretationreasoning§ 4.2 Implications for Research and Practice · p. 17Knowledge of students' preferred time of day can be leveraged for sending notifications, reminders on preferred modality, or feedback on academic submissions.
“knowledge of their preferred time of day can be leveraged for sending them notifications, reminders on their preferred modality type, or even feedback regarding their academic submissions.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationreasoning§ JOURNAL OF LEARNING ANALYTICS · p. 18Fixed-time notifications, unless modality is considered, entail sending notifications at pre-fixed times on all modalities without capitalizing on the unique capabilities of each modality.
“Unless modality is taken into consideration, 'fixed' time entails sending notifications, at any level of required effort or urgency, to learners at pre-fixed times on all modalities without capitalizing on the unique capabilities that each modality provides.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ 4.3 Limitations and Future Work · p. 19The clustering methodology was set upfront before the authors knew what the results would look like.
“We set the clustering methodology upfront before we knew what the results would look like”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ Statement on Ethics · p. 20All collected data was treated confidentially.
“All collected data was treated confidentially.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
Interpretationreasoning§ 4.2 Implications for Research and Practice · p. 17Personalized delivery of learning-related recommendations for each individual learner is possible and promising.
“personalized delivery of learning-related recommendations for each individual learner is possible and also promising.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Interpretationreasoning§ JOURNAL OF LEARNING ANALYTICS · p. 18Intensive learners would benefit from such notifications if they were sent in the morning on weekdays or weekends.
“This group would benefit from such notifications if they were sent in the morning on weekdays or weekends.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Premisecitation§ JOURNAL OF LEARNING ANALYTICS · p. 18The ability to share and distribute information to learners via learning systems is important for extending learning outside the formal classroom.
“The ability to share and distribute information to learners via learning systems is important for extending learning outside the formal classroom (Cheon, Lee, Crooks, & Song, 2012).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Cheon, Lee, Crooks, & Song, 2012 source
May combine two claims.
Interpretationreasoning§ 4.1 Time of Day and Academic Performance · p. 17Evening (and late night) emerged as the preferred time of day for computer-oriented sessions because participants were in class for most of their day.
“By virtue of our participants being in class for most of their day, evening (and late night) undoubtedly emerged as the preferred time of day for computer-oriented sessions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ Statement on Ethics · p. 20This research has been approved by the university ethics board (2014s0127).
“This research has been approved by the university ethics board (2014s0127).”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationcitation§ JOURNAL OF LEARNING ANALYTICS · p. 18Learners might receive instructional content at an inappropriate time, such as late evening when tired or while commuting, which results in ineffective learning.
“there is a fair possibility that they might receive it at an inappropriate time, say late evening when they are tired (Grundspenkis, Lavendels, Novitsky, & Sitikovs, 2006) or while commuting (Srinivasan, Koehler, & Jin, 2018), which in turn results in ineffective learning.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Grundspenkis, Lavendels, Novitsky, & Sitikovs, 2006
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Srinivasan, Koehler, & Jin, 2018 source
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone given§ 4.1 Time of Day and Academic Performance · p. 17Judging one's performance relative to effort is difficult for many university students, mainly because they do not know how much time other students devote to the course.
“Judging one's performance, especially as it relates to the effort exerted, is difficult for many university students. The challenge mainly originates from not knowing how much time other students devote to working on the course.”
Quote in the paperNot a substantial claim
The authors state this as an assumption.
The entirety of the time between two logged events was spent on a particular learning activity.
“with the underlying assumption that the entirety of the time between two logged events was spent on a particular learning activity.”
The paper relies on this without support.
Online learning management systems are regarded as usable anywhere and anytime.
“the online (learning management) system is regarded as one that can be used anywhere and anytime”
The paper relies on this without support.
Instructional content is delivered without considering whether learners have sufficient time to act on it.
“the instructional content is delivered without considering whether learners have sufficient time to act on it.”
The paper relies on this without support.
Grade release, informal feedback, and generic tips on planning for SRL require less strain on mental capacities.
“grade release, informal feedback, and generic tips on planning for self-regulated learning (SRL) require less strain on mental capacities”
The paper relies on this without support.
Prompts concerning the performance phase in SRL or process-level feedback require longer uninterrupted learning sessions.
“prompts concerning the performance phase in SRL or any feedback at the 'process level' (Hattie & Timperley, 2007), for instance, where competency assessments must be completed (assignments, exams, quizzes) or prepared for (review resources relevant to the upcoming course assignments), require longer uninterrupted learning sessions.”
The paper relies on this without support.
A shorter time span is sufficient for monitoring activities in the LMS.
“Given that a shorter time span is sufficient for such activities”
The paper relies on this without support.
LMS notifications are predominantly initiated by an educator through their actions.
“In the context of the LMS, the notifications are predominantly initiated by an educator through their actions”
The paper relies on this without support.
Educators are working according to their own schedules.
“As educators are working according to their own schedules”
The paper relies on this without support.
There is a gap in current understanding of the temporal frameworks at play when interpreting students' learning activities.
“there is a gap in our current understanding of the temporal frameworks that are at play when interpreting students' learning activities.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Night time slot is called nine hours long
MinorThe defined night slot runs from 9 p.m. to 5 a.m., an eight-hour interval, not nine hours.
“the night TOD category encompasses a larger part of the day (nine hours from 9 p.m. to 5 a.m.)”
“night (9 p.m. to 5 a.m.)”
Weekday summary names mobile instead of short-computer sessions
MinorThe summary says morning and night had significantly more mobile sessions on weekdays, but Table 4 shows the higher weekday mobile proportions in the afternoon. Its morning-and-night pattern applies to short-computer sessions.
“but on weekdays, morning and night witnessed significantly more mobile sessions.”
“| Mobile | 2 . 5% b | 7 . 2% a | 3 . 2% b | 2 . 5% b |”
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970 · see citing works
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · see citing works
Chapter 12: What does the Anthropocene hold for citizenship?
(2019) · edoc (University of Basel) · doi:10.1007/978-3 · Cited by 11,533 · see citing works
Analyzing and Visualizing State Sequences in R with TraMineR
Gabadinho, A., Ritschard, G., Müller, N. S., & Studer, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i04 · Cited by 1,364 · see citing works
Cheon, J., Lee, S., Crooks, S. M., & Song, J. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.04.015 · Cited by 1,057 · see citing works
Mining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045 · cited 1× · see citing works
“This is a common technique used previously in many studies (Kovanović, Gašević, Joksimović, Hatala, & Adesope, 2015; Macfadyen & Dawson, 2010; Lust, Elen, & Clarebout, 2013), with the underlying assumption that the entirety of the time between two logged events was spent on a particular…”
MethodBeasley, T. M., & Schumacker, R. E. (1995) · The Journal of Experimental Education · doi:10.1080/00220973.1995.9943797 · Cited by 748 · cited 1× · see citing works
“We compared the standardized residuals as suggested by Beasley and Schumacker (1995) given that they are known to maintain Type 1 error (due to multiple comparisons) at a satisfactory level (MacDonald & Gardner, 2000).”
MethodType I Error Rate Comparisons of Post Hoc Procedures for I j Chi-Square Tables
MacDonald, P. L., & Gardner, R. C. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970871 · Cited by 459 · cited 1× · see citing works
“We compared the standardized residuals as suggested by Beasley and Schumacker (1995) given that they are known to maintain Type 1 error (due to multiple comparisons) at a satisfactory level (MacDonald & Gardner, 2000).”
MethodUsing mobile phones for vocabulary activities: Examining the effect of platform
Stockwell, G. (2010) · Language Learning & Technology · doi:10.64152/10125/44216 · Cited by 455 · cited 7× · see citing works
“We used trace data to determine contextual TOD preferences from usage logs, as opposed to the current paradigm of surveys and questionnaires (Romero & Barberà, 2011; Stockwell, 2010; Luo, Pan, Choi, & Strobel, 2018; Davidson & Ritchie, 2016).”
BackgroundMethodInfluentialChi-Square Test is Statistically Significant: Now What?
Sharpe, D. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/tbfa-x148 · Cited by 368 · see citing works
DUCK, S., RUTT, D. J., HOY, M., & STREJC, H. H. (1991) · Human Communication Research · doi:10.1111/j.1468-2958.1991.tb00545.x · Cited by 252 · see citing works
Time will tell: The role of mobile learning analytics in self-regulated learning
Tabuenca, B., Kalz, M., Drachsler, H., & Specht, M. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.08.004 · Cited by 242 · cited 2× · see citing works
“Typically, notifications are sent at a random time of day or whatever time has been hard-coded in the LMS app—which might not be based on theoretical/empirical reasoning, both of which might result in undesirable learning impacts (Tabuenca et al., 2015; Stockwell, 2010).”
BackgroundMalmberg, J., Järvelä, S., & Järvenoja, H. (2017) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2017.01.009 · Cited by 241 · cited 1× · see citing works
“While most of these aforementioned studies investigated temporal patterns within an individual learning setup, Malmberg, Järvelä, and Järvenoja (2017) used temporal analysis to examine when the different processes of regulated learning (i.e., co-regulated, self-regulated, and socially shared…”
BackgroundInvestigation of morning–evening orientation in six countries using the preferences scale
Smith, C. S., Folkard, S., Schmieder, R. A., Parra, L. F., Spelten, E. R., Almirall, H., Sen, R. N., Sahu, S., Pérez, L. M., & Tisak, J. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(01)00098-8 · Cited by 207 · cited 2× · see citing works
“The problem experienced in the Stockwell (2010) study is a common occurrence in distance and e-learning, mainly because the online (learning management) system is regarded as one that can be used anywhere and anytime, and where the instructional content is delivered without considering whether learners have sufficient…”
BackgroundKovanović, V., Gašević, D., Joksimovíc, S., Hatala, M., & Adesope, O. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.06.002 · Cited by 203 · see citing works
Self-citationGromada, A., & Shewbridge, C. (2016) · OECD education working papers · doi:10.1787/5jm409kqqkjh-en · Cited by 188 · see citing works
Measuring quality in online programs
McGorry, S. Y. (2003) · The Internet and Higher Education · doi:10.1016/s1096-7516(03)00022-8 · Cited by 185 · cited 2× · see citing works
“While many researchers have examined the concept of time flexibility from instructional and organization viewpoints (Arneberg et al., 2007; McGorry, 2003), only a limited number of papers have looked at the associations between time flexibility and modality usage from the learner’s perspective, and only in very specif…”
BackgroundMorrison, L. G., Hargood, C., Pejovic, V., Geraghty, A. W. A., Lloyd, S., Goodman, N., Michaelides, D. T., Weston, A., Musolesi, M., Weal, M. J., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169162 · Cited by 162 · cited 1× · see citing works
“A prominent ongoing debate, in relation to the process of tailoring notification delivery in the aforementioned personalized learning systems, concerns the effects of timing of push notifications—random versus fixed (Fischer et al., 2010; Tabuenca et al., 2015; Morrison et al., 2017).”
BackgroundEffects of content and time of delivery on receptivity to mobile interruptions
Fischer, J. E., Yee, N., Bellotti, V. M. E., Good, N., Benford, S., & Greenhalgh, C. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851620 · Cited by 148 · cited 1× · see citing works
“A prominent ongoing debate, in relation to the process of tailoring notification delivery in the aforementioned personalized learning systems, concerns the effects of timing of push notifications—random versus fixed (Fischer et al., 2010; Tabuenca et al., 2015; Morrison et al., 2017).”
BackgroundTime for Change: Why Learning Analytics Needs Temporal Analysis
Knight, S., Friend Wise, A., & Chen, B. (2017) · Journal of Learning Analytics · doi:10.18608/jla.2017.43.2 · Cited by 135 · see citing works
Relationship between Circadian Rhythm of Body Temperature and Introversion–Extraversion
BLAKE, M. J. F. (1967) · Nature · doi:10.1038/215896a0 · Cited by 132 · cited 9× · see citing works
“The problem experienced in the Stockwell (2010) study is a common occurrence in distance and e-learning, mainly because the online (learning management) system is regarded as one that can be used anywhere and anytime, and where the instructional content is delivered without considering whether learners have sufficient…”
BackgroundMethodResultInfluentialEnhancing learning: a study of how mobile devices can facilitate sensemaking
Rogers, Y., Connelly, K. H., Hazlewood, W. R., et al. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-009-0250-7 · Cited by 129 · see citing works
Analytics of time management strategies in a flipped classroom
Ahmad Uzir, N., Gašević, D., Matcha, W., Jovanović, J., & Pardo, A. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12392 · Cited by 129 · see citing works
Self-citationCorrelation between morningness – eveningness and final school leaving exams
Randler, C., & Frech, D. (2006) · Biological Rhythm Research · doi:10.1080/09291010600645780 · Cited by 127 · cited 1× · see citing works
“Moreover, we also found evidence in the literature suggesting significant associations between the learner’s chronotype score and their academic achievements (Randler & Frech, 2006; Itzek-Greulich, Randler, & Vollmer, 2016).”
ResultSong, Y., Ma, H., Wang, H., & Wang, K. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2488388.2488493 · Cited by 115 · see citing works
Comparing the Self-Report and Measured Smartphone Usage of College Students: A Pilot Study
Lee, H., Ahn, H., Nguyen, T. G., Choi, S.-W., & Kim, D. J. (2017) · Psychiatry Investigation · doi:10.4306/pi.2017.14.2.198 · Cited by 114 · see citing works
Quality of e-learners’ time and learning performance beyond quantitative time-on-task
Romero, M., & Barberà, E. (2011) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v12i5.999 · Cited by 96 · cited 5× · see citing works
“This is in contrast to the observation by Romero and Barberà (2011), where adult e-learners’ academic performance was more strongly related to morning and evening.”
BackgroundMethodResultInfluentialRegulation of tool-use within a blended course: Student differences and performance effects
Lust, G., Elen, J., & Clarebout, G. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.09.001 · Cited by 91 · see citing works
Methodological Choice and Design
Markauskaitė, L., Freebody, P. R., & Irwin, J. (2010) · Springer eBooks · doi:10.1007/978-90-481-8933-5 · Cited by 82 · see citing works
The future of mobile learning and implications for education and training
Parsons, D. (2016) · doi:10.4324/9781315621586-26 · Cited by 79 · cited 1× · see citing works
“…contextual profiling (i.e., context-aware recommendations) within fields akin to mobile learning (Lima, El-Bishouty, & Graf, 2013; Tortorella & Graf, 2012; Parsons, 2016; Xu, Zhu, Zhang, & Gu, 2008) to allow for a more authentic learning experience aimed at providing adaptivity and personalization.”
BackgroundTracking Learner Usage of Mobile Phones for Language Learning Outside of the Classroom
Stockwell, G. (2013) · CALICO Journal · doi:10.1558/cj.v30i0.118-136 · Cited by 72 · cited 4× · see citing works
“For instance, learning on a computer usually tends to be far more meticulously planned (Stockwell, 2013) than for its mobile and tablet counterparts, or for an activity (such as assignments) that might require lesser distraction, which some might say can be introduced by the opportunistic use of mobile phones and tabl…”
BackgroundInfluentialECAR Study of Faculty and Information Technology, 2015.
Brooks, D. (2015) · Cited by 58 · see citing works
Discovery and temporal analysis of latent study patterns in MOOC interaction sequences
Boroujeni, M. S., & Dillenbourg, P. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170388 · Cited by 53 · see citing works
Learning needs time and effort: a time-use study of engineering students
Kolari, S., Savander-Ranne, C., & Viskari, E.-L. (2008) · European Journal of Engineering Education · doi:10.1080/03043790802564046 · Cited by 49 · see citing works
Morning or Evening person? Which type are you? Self-assessment of chronotype
Loureiro, F., & Garcia-Marques, T. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.06.022 · Cited by 48 · cited 1× · see citing works
“That is, learners may have a unique chronotype, such as morningness-eveningness preference (Loureiro & Garcia-Marques, 2015), and these time preferences might even vary depending on the country one resides in (Smith et al., 2002).”
BackgroundParadox of time in research on educational technology
Barbera, E., Gros, B., & Kirschner, P. (2015) · Time & Society · doi:10.1177/0961463x14522178 · Cited by 46 · cited 6× · see citing works
“This is because while the former can be useful for answering research questions that assess relationships among variables, it is only the latter that can “answer research questions pertaining to changes and processes” (Barbera et al., 2015, p.12).”
BackgroundInfluentialItzek‐Greulich, H., Randler, C., & Vollmer, C. (2016) · Learning and Individual Differences · doi:10.1016/j.lindif.2016.09.013 · Cited by 41 · see citing works
Critical Issues in Designing and Implementing Temporal Analytics
Chen, B., Knight, S., & Wise, A. F. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.1 · Cited by 41 · see citing works
Transforming Education in the Gulf Region
Alshahrani, K. (2016) · Routledge eBooks · doi:10.4324/9781315621586 · Cited by 40 · see citing works
Cheng, H. N. H., Liu, Z., Sun, J., Liu, S., & Yang, Z. (2017) · Interactive Learning Environments · doi:10.1080/10494820.2016.1276082 · Cited by 38 · see citing works
Saqr, M., Fors, U., & Nouri, J. (2019) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2019.10020597 · Cited by 30 · see citing works
van Leeuwen, A., Bos, N., van Ravenswaaij, H., & van Oostenrijk, J. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12616 · Cited by 29 · see citing works
Context-aware content filtering & presentation for pervasive & mobile information systems
Xu, K., Zhu, M., Zhang, D., et al. (2008) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 25 · see citing works
Emerging Methodological Challenges for Educational Research
Goodyear, P. (2011) · Methodological Choice and Design · doi:10.1007/978-90-481-8933-5_22 · Cited by 24 · see citing works
RuleSelector: Selecting Conditional Action Rules from User Behavior Patterns
Srinivasan, V., Koehler, C., & Jin, H. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191767 · Cited by 23 · see citing works
Personalized Mobile Learning via an Adaptive Engine
Tortorella, R. A. W., & Graf, S. (2012) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2012.112 · Cited by 22 · cited 1× · see citing works
“…growing interest in contextual profiling (i.e., context-aware recommendations) within fields akin to mobile learning (Lima, El-Bishouty, & Graf, 2013; Tortorella & Graf, 2012; Parsons, 2016; Xu, Zhu, Zhang, & Gu, 2008) to allow for a more authentic learning experience aimed at providing adaptivity…”
BackgroundThe Benefits of Exploratory Time.
Wolk, S. (2001) · Educational leadership · Cited by 21 · see citing works
Blended Learning. Education in a Smart Learning Environment
(2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51968-1 · Cited by 16 · see citing works
Effects of Chronotypes on Students’ Choice, Participation, and Performance in Online Learning
Luo, Y., Pan, R., Choi, J. H., & Ströbel, J. (2017) · Journal of Educational Computing Research · doi:10.1177/0735633117697729 · Cited by 15 · see citing works
Sher, V., Hatala, M., & Gašević, D. (2019) · Proceedings of the 9th International Conference on Learning Analytics & Knowledge · doi:10.1145/3303772.3303790 · Cited by 13 · cited 2× · see citing works
“However, the difference between the two high-performing groups, i.e., computer-dominant and intensive, was not statistically significant (Sher et al., 2019).”
BackgroundInfluentialSelf-citationAnalyzing Moodle/LMS Logs to Measure Mobile Access
Casany, M. J., Alier, M., Galanis, N., et al. (2012) · Ubiquitous Computing Systems · Cited by 11 · see citing works
Some critical reflections on the special issue: Current innovations in computer-based assessments
Greiff, S., Scherer, R., & Kirschner, P. A. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.08.019 · Cited by 11 · see citing works
Smart Learning Environments: A Bibliometric Analysis
Chen, X., Zou, D., Xie, H., & Wang, F. L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51968-1_29 · Cited by 11 · see citing works
Where Is My Time? Identifying Productive Time of Lifelong Learners for Effective Feedback Services
Tabuenca, B., Kalz, M., Börner, D., Ternier, S., & Specht, M. M. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-08657-6_15 · Cited by 10 · see citing works
Lima, R. H. P., El-Bishouty, M. M., & Graf, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39146-0_14 · Cited by 7 · see citing works
Davidson, A., & Ritchie, K. (2016) · Cited by 7 · see citing works
Computer Assisted Assessment. Research into E-Assessment
Kalz, M., & Ras, E. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-08657-6 · Cited by 6 · see citing works
Lifelong Learners and Teachers’ Time-Management Competency in E-learning
Roméro, M., & Barberà, E. (2015) · doi:10.4324/9781315760902.ch13 · Cited by 2 · cited 2× · see citing works
“First, “learners are perpetually in a context” (Sharples, 2015), and there has been growing interest in contextual profiling (i.e., context-aware recommendations) within fields akin to mobile learning (Lima, El-Bishouty, & Graf, 2013; Tortorella & Graf, 2012; Parsons, 2016; Xu, Zhu, Zhang, & Gu, 2008) to allow for a m…”
Method
Flagged first, then by citations
2 of the 60 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Arneberg, P., Guardia, L., Keegan, D., L˜ ossenko, J., M´ az´ ar, I., Michels, P., & Rekkedal, T. (2007). Analyses of European megaproviders of E-learning. Megatrends Project . https://www.researchgate.net/publication/ 264871599 Analyses of European Megaproviders of E-learning
- Grundspenkis, J., Lavendels, J., Novitsky, L., & Sitikovs, V. (2006). Compatibility of the principles of computer-based and classical teachings. In Proceeding of IADIS International Conference Web Based Communities 2006, 26-28 February 2006, San Sebastian, Spain (pp. 335-339).
Cited by
Sorted by citations
Gumasing, M. J. J., Ong, A. K. S., & Bare, M. A. D. (2022) · Sustainability · doi:10.3390/su141912346 · Cited by 20 · see citing works
Uncovering Engagement Profiles of Young Learners in K–8 Education through Learning Analytics
Er, E., Silik, S., & Cansiz, S. (2024) · Journal of Learning Analytics · doi:10.18608/jla.2024.8133 · Cited by 14 · see citing works
“Although the literature has been very informative in revealing distinct profiles of learners based on their engagement in online environments, most of the studies were conducted in higher education or MOOC contexts (Ferguson & Clow, 2015; Kizilcec et al., 2013; Sher et al., 2022).”
BackgroundInnovative Teacher Leadership in Curriculum Construction
Luo, Z., & Wang, Y. (2024) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.348333 · Cited by 6 · see citing works
Session-Based Time-Window Identification in Virtual Learning Environments
Maslennikova, A., Rotelli, D., & Monreale, A. (2023) · Journal of Learning Analytics · doi:10.18608/jla.2023.7911 · Cited by 3 · see citing works
Learning Analytics Dashboard to Support Instructors: A Literature Review
Padakanti, D., & Moraes, M. C. (2023) · International Conference on Higher Education Advances (HEAd) · doi:10.4995/head23.2023.16119 · Cited by 2 · see citing works
“Among the several uses of LA, including supporting learners self-regulated process (Winne et al., 2019), prediction of students’ success (Chen et al., 2020), and analysis of students study behaviors (Sher et al., 2022), there are works on Learning Analytics Dashboards (LADs).”
BackgroundHsu, C.-Y., Horikoshi, I., Li, H., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72315-5_12 · Cited by 1 · see citing works
Temporal Modeling of LMS Logs and Zero-Shot LLM Prediction: A Multi-Course Study in Moodle
Shehada, W., Ashqar, H. I., Ewais, A., & Hatzilygeroudis, I. (2026) · Applied Sciences · doi:10.3390/app16062707 · Cited by 1 · see citing works
Not All Students Engage Alike: Multi-Institution Patterns in GenAI Tutor Use
Chen, Y., Shi, X., Liu, X., Wang, S., Liu, T. X., & Gašević, D. (2026) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3774398.3811610 · Cited by 3 · see citing works
Self-citationVisual Analytics for Session-based Time-Windows Identification in Virtual Learning Environments
Maslennikova, A., Rotelli, D., & Monreale, A. (2022) · International Conference Information Visualisation (IV) · doi:10.1109/iv56949.2022.00050 · Cited by 1 · see citing works
“One way to approach this problem is to designate time periods intuitively [8] or depending on personal experience and perspectives [9].”
BackgroundInvestigating Patterns in Mobile Phone Usage: An Empirical Exploration Using Multiple TechniquesPreprint
Homocianu, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4707473 · Cited by 1 · see citing works
Understanding online peer-assisted learning with forums in the “digital era”
Barile, L., & Ghosh, A. (2026) · The Journal of Economic Education · doi:10.1080/00220485.2026.2704640
- Authors
- Sher, V., Hatala, M., & Gašević, D.
- Affiliations
- Simon Fraser University (CA)
- Monash University (AU)
- Venue
- Journal of Learning Analytics
- Published
- 2022-05-26
- Volume
- 9
- Issue
- 2
- Pages
- 1-23
- ISSN
- 1929-7750 (ISSN-L)
- OpenAlex
- W4281737179
- Semantic Scholar
- 090b2c09a1fb840d44b02fb520e0883eafdb3a58
- Cited by
- 12
- References
- 60
- Citations by year
- 2026: 3 · 2024: 4 · 2023: 3 · 2022: 2
- FWCI
- 1.74
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Journal of Learning Analytics (publishedVersion, cc-by-nc-nd)
- Monash University Research Portal (Monash University) (submittedVersion, cc-by-nc-nd)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Social Sciences and Humanities Research Council of Canada
- Engineering and Physical Sciences Research Council (EP/L016427/1)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Social Sciences › Education › Online and Blended Learning
- Keywords
- mobile learning, computer-assisted instruction, time of day, ubiquitous learning, personalized learning systems, personalized notifications, weekday and weekend differences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review