The effects of online peer-facilitated learning and distributed pair programming on students’ learning
Open accessAbstract
The COVID-19 pandemic has forced universities and schools around the world to adopt online learning. Teachers may wonder if their students can attain satisfactory learning performance in an online learning environment without teachers' on-the-spot attention. In order to develop students' skills in programming, promote their enjoyment of learning and intention to learn to program, the researchers integrated two innovative teaching approaches, using online peer-facilitated learning and distributed pair programming, and investigated the effects of these on students' online learning performance. This study conducted an experiment that included 128 undergraduates from four class sections of Department of Finance. Thus, the experimental design in this research was a 2 (Peer-facilitated learning vs. non-peer-facilitated learning) × 2 (Distributed pair programming vs. non-distributed pair programming) factorial pretest/post-test design. The participants in this research mainly consisted of four classes of students from a non-computer or information department who took a compulsory course on programming design.’ Both quantitative and qualitative data were collected in this study. According to the results, the peer-facilitated learning group exhibited significantly better development of programming skills, enjoyment of learning, and intention to learn, than the non-peer-facilitated learning group. However, expected effects of enhancing the learning of the students in this study who received the distributed pair programming were not found. The design of online pedagogy can be a reference for online educators. The implications of applying online peer-facilitated learning and distributed pair programming to support students’ learning and the design of online programming courses are discussed.
AI snapshot
Written from the paper’s full text.
TL;DR
This study tested online peer-facilitated learning and distributed pair programming in a 2×2 quasi-experiment with 128 non-computing undergraduates in an online VBA programming course. Peer-facilitated learning improved programming skills, enjoyment, and intention to learn, while distributed pair programming did not show expected benefits and was associated with lower programming skills.
Key findings
- Peer-facilitated learning group (G1+G2, n=66) significantly outperformed the non-peer-facilitated group (G3+G4, n=62) on programming skills (M=78.379 vs 72.275, p=.001), enjoyment of learning (M=3.283 vs 2.952, p=.029), and intention to learn (M=4.652 vs 4.075, p=.018).
- Distributed pair programming group (G1+G3, n=60) did not outperform the non-distributed group (G2+G4, n=68); programming skills were significantly lower in the distributed pair group (M=71.634 vs 78.765, p=.000), with no significant differences for enjoyment (p=.273) or intention (p=.162).
- The combined intervention group G1 did not significantly outperform other groups. G3 (distributed pair programming only) had significantly lower programming skills than G2 (peer-facilitated only, p=.000) and G4 (control, p=.020).
- Qualitative interviews were mixed: some students valued peer collaboration and immediate paired assistance, while others reported that paired groups followed the teacher without discussion, had conflicts, or paid little attention to the paired group.
Methods
- Design: 2 (peer-facilitated vs. non-peer-facilitated) × 2 (distributed pair programming vs. non-distributed pair programming) factorial pretest/post-test quasi-experiment. Participants were 128 first-year undergraduates from four class sections of a compulsory “Programming Design” course in a Taiwanese university; mean age 19.25. Group sizes: G1 n=25, G2 n=41, G3 n=35, G4 n=27.
- Course/interventions: 17-week online course using Visual Basic for Applications (VBA). Peer-facilitated learning used teams of six and a seven-phase peer coaching process; distributed pair programming used pairs working remotely via Microsoft Teams, TeamViewer, or LINE/Facebook outside class. The control group received traditional lectures without either intervention.
- Measures/analysis: programming skills were graded from student VBA projects using six DeLone & McLean IS success dimensions; enjoyment of learning used three AEQ items on a 5-point Likert scale; intention to learn used three items on a 7-point Likert scale. Analysis included CFA, Levene’s test, independent-sample t-tests, one-way ANOVA, and content analysis of semi-structured interviews with 20 students (5 per group).
Limitations
- The paper states possible Hawthorne effect, disturbance from the COVID-19 outbreak and students’ health situations, and threats from the quasi-experimental design that may limit firm conclusions.
- Evident from the text: groups were intact class sections rather than randomly assigned; some groups were small (e.g., G1 n=25, G4 n=27); enjoyment and intention were self-reported; and distributed pair programming implementation issues (students imitating the teacher, conflicts, limited discussion) may have affected the results.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
1 of 25 cited sources checked · 1 supported · 0 flagged
- Premisecitation§ 2.4. Enjoyment of learning · p. 5
Learners in pair programming enjoy programming collaboratively.
“In addition, it is revealed that learners in pair programming enjoy programming collaboratively (Bowm an et al., 2020; Faja, 2011).”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Bowm an et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Faja, 2011 source
- Findingown data§ A B S T R A C T · p. 2
The expected effects of distributed pair programming on enhancing students' learning were not found in this study.
“However, expected effects of enhancing the learning of the students in this study who received the distributed pair programming were not found.”
Quote in the paperSubstantial claim - Findingown data§ 4.3. The effect of distributed pair programming · p. 10
There was no significant difference in intention to learn between the distributed pair programming group and the non-distributed pair programming group (p>.05).
“Table 3 reveals no significant difference ( p > .05) in students ' enjoyment of learning and intention to learn.”
Quote in the paperSubstantial claim - Findingown data§ 4.3. The effect of distributed pair programming · p. 10
There was no significant difference in enjoyment of learning between the distributed pair programming group and the non-distributed pair programming group (p>.05).
“Table 3 reveals no significant difference ( p > .05) in students ' enjoyment of learning and intention to learn.”
Quote in the paperSubstantial claim - Findingown data§ 4.2. The effect of peer-facilitated learning · p. 10
In the posttest, the peer-facilitated learning group (n=66) had a mean intention to learn score of 4.652, significantly higher than the non-peer-facilitated learning group (n=62, mean=4.075), t=2.386, p=.018.
“Intention to learn | 66 | 4.652 | 1.309 | 7.000 | 1.000 | 62 | 4.075 | 1.422 | 7.000 | 1.000 | 2.386 | 126 | .018*”
Quote in the paperSubstantial claim
- Findingown data§ 5.2. The effect of distributed pair programming · p. 12
Some students indicated in interviews that distributed pair programming worked in their tasks (e.g., reaching a quick consensus due to fewer opinions).
“Although the distributed pair programming did not reach its estimated benefits in this study, nevertheless, some students indicated in the interviews that distributed pair programming worked in their tasks (e.g. reaching a quick consensus due to fewer opinions).”
Quote in the paperNot a substantial claim - Findingown data§ 4.4. The combined effect of peer-facilitated learning and distributed pair programming · p. 11
Students in G3 had significantly lower programming skills than G4 (p=.020).
“it was found that students in G3 (receiving distributed pair programming treatment) had significantly lower programming skills than G2 (receiving peerfacilitated learning) and G4 (the control group), with a significance of p = .000 < 0.05 and p = .020 < 0.05, respectively.”
Quote in the paperSubstantial claim - Findingnone given§ 6. Conclusions · p. 13
Students who simultaneously received both online peer-facilitated learning and distributed pair programming did not show better development than students in the other groups.
“With regard to the third research question about the effects of combined intervention of online peer-facilitated learning and distributed pair program ming, students who simultaneously received peer-facilitated learning and distributed pair programming did not have better devel opment than other groups.”
Quote in the paperSubstantial claim - Findingown data§ 5.2. The effect of distributed pair programming · p. 12
Students in the distributed pair programming group noted that members might have different levels of understanding that might result in obstacles to their interaction.
“Moreover, students in the distributed pair programming group noted that members might have different levels of understanding that might result in obstacles to their inter action.”
Quote in the paperSubstantial claim - Findingown data§ 4.4. The combined effect of peer-facilitated learning and distributed pair programming · p. 11
Students in G3 had significantly lower programming skills than G2 (p=.000).
“it was found that students in G3 (receiving distributed pair programming treatment) had significantly lower programming skills than G2 (receiving peerfacilitated learning) and G4 (the control group), with a significance of p = .000 < 0.05 and p = .020 < 0.05, respectively.”
Quote in the paperSubstantial claim - Premisecitation§ 1.2. Adoption of distributed pair programming · p. 3
Students' enjoyment of learning is regarded as one of the critical factors in programming courses.
“In addition, as students ' enjoyment of learning is recently regarded as one of the critical factors in programming courses (e.g. Luik et al., 2019), it is very important to help students engage in and improve their enjoyment of learning.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Luik et al., 2019 source
- Premisecitation§ 5.2. The effect of distributed pair programming · p. 12
Students who applied distributed pair programming had to spend more time communicating and interacting with their partners to complete the task.
“First, students who applied distributed pair programming had to spend more time in communicating and interacting with their partners to complete the task (da Silva Est ´ acio & Prikladnicki, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites da Silva Estácio & Prikladnicki, 2015 source
- Premisecitation§ 5.2. The effect of distributed pair programming · p. 12
Conflicts might occur during the coordination process of paired groups, such as task load, differing opinions, and divergent goals.
“Thirdly, conflicts might occur during the coordination process of the paired groups, such as task load, differing opinions, and divergent goals (da Silva Est ´ acio & Prikladnicki, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites da Silva Estácio & Prikladnicki, 2015 source
- Interpretationown data§ 4.2. The effect of peer-facilitated learning · p. 9
Online peer-facilitated learning promotes students' intention to learn.
“The results in Table 2 indicate that the treatment of online peer-facilitated learning could promote students ' pro gramming skills, enjoyment of learning, and intention to learn.”
- Also stated in: § 6. Conclusions · p. 12 · boosted
“Based on the analysis for the first research question about the effects of online peer-facilitated learning, it is found that the peerfacilitated learning significantly contributed to students ' programming skills and promoted their enjoyment of learning and intention to learn.”
Quote in the paperSubstantial claim - Also stated in: § 6. Conclusions · p. 12 · boosted
- Interpretationown data§ 4.3. The effect of distributed pair programming · p. 10
Distributed pair programming did not positively affect students' enjoyment of learning.
“These results, shown in Table 3, indicate the distributed pair programming teaching strategy did not positively affect students ' development of programming skills, enjoyment of learning, or intention to learn.”
- Also stated in: § 6. Conclusions · p. 12 · plain
“As for the second research question about the effects of online distributed pair programming, this approach did not show the expected effect on students ' programming skills, enjoyment of learning, or intention to learn.”
Quote in the paperSubstantial claim - Also stated in: § 6. Conclusions · p. 12 · plain
- Interpretationown data§ 4.3. The effect of distributed pair programming · p. 10
Distributed pair programming did not positively affect students' programming skills.
“These results, shown in Table 3, indicate the distributed pair programming teaching strategy did not positively affect students ' development of programming skills, enjoyment of learning, or intention to learn.”
- Also stated in: § 6. Conclusions · p. 12 · plain
“As for the second research question about the effects of online distributed pair programming, this approach did not show the expected effect on students ' programming skills, enjoyment of learning, or intention to learn.”
Quote in the paperSubstantial claim - Also stated in: § 6. Conclusions · p. 12 · plain
- Study design and conductown data§ 3.4.4. Data analysis · p. 8
The convergent validity and reliability of enjoyment of learning and intention to learn were verified with item loadings, AVE, CR, and Cronbach's alpha.
“We analyzed the data obtained in the post-test through the use of Confirmatory Factor Analysis (CFA), and verified the convergent validity and reliability of the two variables of enjoyment of learning and intention to learn with Item Loadings, Average Variance Extracted (AVE), Composite Reliability (CR) and Cronbach ' s α (Huang et al., 2012).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Huang et al., 2012 source
- Interpretationown data§ 4.2. The effect of peer-facilitated learning · p. 9
Online peer-facilitated learning promotes students' enjoyment of learning.
“The results in Table 2 indicate that the treatment of online peer-facilitated learning could promote students ' pro gramming skills, enjoyment of learning, and intention to learn.”
- Also stated in: § 6. Conclusions · p. 12 · boosted
“Based on the analysis for the first research question about the effects of online peer-facilitated learning, it is found that the peerfacilitated learning significantly contributed to students ' programming skills and promoted their enjoyment of learning and intention to learn.”
Quote in the paperSubstantial claim - Also stated in: § 6. Conclusions · p. 12 · boosted
- Study design and conductown data§ 3.4.1. Programming skills · p. 8
None of the students reported having learned VBA or had experience in programming before this course.
“Thus, in the first week of the semester, all participants from the four groups were asked if they had learned VBA or had experience in programming before this course. None of the students reported having done so.”
Quote in the paperSubstantial claim - Interpretationown data§ 4.3. The effect of distributed pair programming · p. 10
The distributed pair programming strategy in this study did not reach the expected benefits, especially for students' programming skills.
“According to Table 3, the distributed pair programming strategy in this study did not reach the expected benefits, especially for students ' programming skills.”
Quote in the paperSubstantial claim - Interpretationown data§ 4.2. The effect of peer-facilitated learning · p. 9
Online peer-facilitated learning promotes students' programming skills.
“The results in Table 2 indicate that the treatment of online peer-facilitated learning could promote students ' pro gramming skills, enjoyment of learning, and intention to learn.”
- Also stated in: § 6. Conclusions · p. 12 · boosted
“Based on the analysis for the first research question about the effects of online peer-facilitated learning, it is found that the peerfacilitated learning significantly contributed to students ' programming skills and promoted their enjoyment of learning and intention to learn.”
Quote in the paperSubstantial claim - Also stated in: § 6. Conclusions · p. 12 · boosted
- Interpretationown data§ 4.3. The effect of distributed pair programming · p. 10
Distributed pair programming did not positively affect students' intention to learn.
“These results, shown in Table 3, indicate the distributed pair programming teaching strategy did not positively affect students ' development of programming skills, enjoyment of learning, or intention to learn.”
- Also stated in: § 6. Conclusions · p. 12 · plain
“As for the second research question about the effects of online distributed pair programming, this approach did not show the expected effect on students ' programming skills, enjoyment of learning, or intention to learn.”
Quote in the paperSubstantial claim - Also stated in: § 6. Conclusions · p. 12 · plain
- Study design and conductreasoning§ 3.4.1. Programming skills · p. 8
Students from the four groups had similar levels of programming skills prior to receiving the interventions.
“Thus, it is believed that students from the four groups had similar levels of programming skills prior to them receiving the intervention of peer-facilitated learning and/or distributed pair programming.”
Quote in the paperSubstantial claim - Interpretationown data§ 4.2. The effect of peer-facilitated learning · p. 9
Students can coordinate with each other in the peer-facilitated learning environment.
“From the quantitative and qualitative data, it is believed that students can coordinate with each other in the peer-facilitated learning environment.”
Quote in the paperSubstantial claim - Premisecitation§ 3.3.2. Distributed pair programming intervention (for G1 and G3) · p. 7
Microsoft Teams provides the typical and main features of distributed pair programming systems.
“Microsoft Teams provides the typical and main features of distributed pair programming systems, such as: a shared editor, support for the roles of the driver and navigator and their role changing, a chat tool for communication, and remote code highlighting (Satratzemi et al.).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Satratzemi et al.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- May combine two claims. 17
- The quote only partly states this claim. 1
- Classified as probably not a substantial claim. 17
May combine two claims. The quote only partly states this claim.
Findingown data§ 4.1. Validity and reliability · p. 9Cronbach's alpha values for enjoyment of learning and intention to learn are 0.890 and 0.917, both greater than 0.7.
“In addition, Cronbach ' s α values are 0.890 and 0.917, both greater than 0.7.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.1. Validity and reliability · p. 9The composite reliability values for enjoyment of learning and intention to learn are 0.909 and 0.958, both greater than 0.7.
“The values of composite reliability for both the variables are greater than 0.7, at 0.909 and 0.958.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.2. The effect of peer-facilitated learning · p. 10In the posttest, the peer-facilitated learning group (n=66) had a mean programming skills score of 78.379, significantly higher than the non-peer-facilitated learning group (n=62, mean=72.275), t=3.433, p=.001.
“Programming skills | 66 | 78.379 | 9.635 | 98.000 | 60.000 | 62 | 72.275 | 10.480 | 90.000 | 30.000 | 3.433 | 126 | .001*”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.4. The combined effect of peer-facilitated learning and distributed pair programming · p. 10The distributed pair programming group (n=60) had a mean programming skills score of 71.634, significantly lower than the non-distributed pair programming group (n=68, mean=78.765), t=4.074, p=.000.
“Programming skills | 60 | 71.634 | 10.892 | 88.000 | 30.000 | 68 | 78.765 | 8.898 | 98.000 | 66.000 | 4.074 | 126 | .000*”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.1. Validity and reliability · p. 9All observation items had loading values between 0.83 and 0.97, greater than 0.7.
“The results found that all observation items had a loading value between 0.83 and 0.97 and were greater than 0.7.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ 4.1. Validity and reliability · p. 9The AVE values for enjoyment of learning and intention to learn are 0.770 and 0.884, both greater than 0.5.
“The AVE values for enjoyment of learning and intention to learn are 0.770 and 0.884 respectively, both greater than 0.5.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ 4.2. The effect of peer-facilitated learning · p. 10In the posttest, the peer-facilitated learning group (n=66) had a mean enjoyment of learning score of 3.283, significantly higher than the non-peer-facilitated learning group (n=62, mean=2.952), t=2.210, p=.029.
“Enjoyment of Learning | 66 | 3.283 | .794 | 5.000 | 1.330 | 62 | 2.952 | .901 | 5.000 | 1.000 | 2.210 | 126 | .029*”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Premisecitation§ 2.5. Intention to learn · p. 5Learners who receive peer-facilitated learning are motivated and engage more in the learning material.
“In addition, it is reported that learners who receive peer-facilitated learning are motivated and engage more in the learning material, as they find it is easier to ask questions while they are being taught or responded to by students of similar age (Mkonto, 2018).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Mkonto, 2018 source
Classified as probably not a substantial claim.
Premisecitation§ 2.3. Students ' programming skills · p. 5There is a lack of research on how to teach programming skills in a practical way that raises students' interest.
“In addition, it is indicated that there is a lack of research on how to teach programming skills in a practical way that raises students ' interest (Seraj et al., 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Seraj et al., 2019 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ 2.3. Students ' programming skills · p. 4The need for programming skills and information technology will rapidly rise and may grow as much as 90% between 2016 and 2030.
“Recent research has indicated that the need for programming skills and information technology will rapidly rise and may grow as much as 90% between 2016 and 2030 (Bughin et al., 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bughin et al., 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Premisecitation§ 6. Conclusions · p. 13It is essential for teachers to develop and adopt appropriate pedagogies to improve students' learning in order to adapt to online learning environments.
“In order to adapt to online learning environments, it is essential for teachers to develop and adopt appropriate pedagogies to improve students ' learning (Tsai, Shen, & Chiang, 2020).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tsai, Shen, & Chiang, 2020 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ 5.3. Potential limitations of this research · p. 12The experiment environment was disturbed by the COVID-19 outbreak and students' health situations, which might potentially influence the validity of the results.
“In addition, the experiment environment was disturbed by the COVID-19 outbreak and students ' health situations; these factors might potentially influence the validity of the results.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown data§ 3.3.3. Control group (G4) intervention · p. 8Students in the control group received the same class hours, learning materials and practice time, and used the same course website as the experimental groups, without the interventions.
“In this research, students in G4 (the control group) received the same class hours, learning materials and practice time, and used the same course website as those in G1, G2, and G3, however, without the interventions of peer-facilitated learning or distributed pair programming.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 5.2. The effect of distributed pair programming · p. 12Programming is a specialized subject with a high dropout and failure rate.
“Finally, programming is a specialized subject with a high dropout and failure rate.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dawson et al., 2018 source
May combine two claims.
Interpretationown data§ 5.1. The effect of peer-facilitated learning · p. 12Students who learn in a peer-facilitated learning environment may be more confident in comprehending course content and enjoy their learning.
“That means students who learn in a peer-facilitated learning environment may be more confident in comprehending course content and enjoy their learning, even in a programming course with historically high drop-out and failure rates.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone given§ 3.2. Course setting · p. 6The course content and course objective were designed and evaluated by a committee of eight teachers with technical and managerial specializations to ensure the course content meets students' needs in the workplace.
“The course content and course objective were designed and evaluated by a committee of eight teachers with both technical and managerial specializations, to make sure the course content meets students ' needs in the workplace.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitation§ 3.4.3. Intention to learn · p. 8Intention to learn was measured using scales from Darban et al. (2016) and Davis, Bagozzi, & Warshaw (1989).
“The researchers in this study adopted scales from Darban et al. (2016) and Davis, Bagozzi, & Warshaw (1989) for behavioral intention to assess their intention to learn programming.”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
Study design and conductown data§ 3.4.4. Data analysis · p. 8The equality of variance was robust and the independent sample t-test and one-way ANOVA could be used.
“The results indicated that the equality of variance was robust and the independent sample t -test and one-way ANOVA could be used (Huang, Silitonga, & Wu, 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Huang, Silitonga, & Wu, 2022 source
Probably not a substantial claim: may not pass S2 (checkable).
Interpretationnone given§ 6. Conclusions · p. 13The design of the online peer-facilitated learning instructional method and its effects in an online programming course can provide a reference for teachers to facilitate students' collaboration and improve students' problem-solving skills and learning outcomes.
“Firstly, the design of online peer-facilitated learning instructional method and its effects in an online pro gramming course can provide a reference for teachers to facilitate students ' collaboration and improve students ' problem-solving skills and learning outcomes.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationreasoning§ 4.2. The effect of peer-facilitated learning · p. 9When students learn via peer interaction, it may build more profound connections and help students achieve positive performance in programming skills, and better development of enjoyment of learning and intention to learn.
“When students learn via peer interaction, it may build more profound connections and help students ach ieve positive performance in programming skills, and better development of enjoyment of learning and intention to learn.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ 5.2. The effect of distributed pair programming · p. 12These potential factors may have contributed to the ineffectiveness of distributed pair programming found in this study.
“These potential factors may have contributed to the ineffectiveness of distributed pair programming found in this study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitation§ 5.3. Potential limitations of this research · p. 12Students knowing they were being studied might cause the Hawthorne effect.
“For example, students knowing they were being studied might cause the Hawthorne effect (Chiesa & Hobbs, 2008).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Chiesa & Hobbs, 2008 source
Classified as probably not a substantial claim.
Interpretationown data§ 6. Conclusions · p. 13Based on students' interview feedback, the distributed pair programming approach may be effective if further improvements and adjustments are made.
“Based on students ' feedback in the interview, the distributed pair programming approach may be effective with further improvements and adjustments.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitation§ 3.4.1. Programming skills · p. 8The teacher and researchers in this study blindly graded the programs or systems employing the six success dimensions of system quality, information quality, service quality, usage, user satisfaction, and net benefits.
“the teacher and researchers in this study blindly graded the programs or systems employing the six success dimensions of system quality, information quality, service quality, usage, user satisfaction, and net benefits.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitation§ 3.4.4. Data analysis · p. 9A researcher and the involved teacher coded the students' comments.
“A researcher and the involved teacher in this programming course were invited to code the students ' comments (Chen et al., 2020).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Chen et al., 2020 source
May combine two claims.
Premisecitation§ 5.2. The effect of distributed pair programming · p. 12Many students in Taiwan are not willing to learn on their own and are not academically responsible, as they are used to didactic education.
“Second, many students in Taiwan are not willing to learn on their own and are not academically responsible, as they are used to didactic education (Tsai, 2014; Cheng et al., 2022).”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
Study design and conductown data§ 4.1. Validity and reliability · p. 9The reliability and validity of enjoyment of learning and intention to learn are acceptable.
“Therefore, the reliability and validity of enjoyment of learning and intention to learn are acceptable, since all the values shown in Table 1 met the standard levels (Huang et al., 2012).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Huang et al., 2012 source
Classified as probably not a substantial claim.
Study design and conductcitation§ 3.4.2. Enjoyment of learning · p. 8Enjoyment of learning was measured using three items from the Academic Emotions Questionnaire (AEQ) adapted to the programming course.
“three items from the Academic Emotions Questionnaire (AEQ) (Pekrun et al., 2005; Pekrun, 2006) were slightly adapted to fit the scope of this programming course”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Pekrun et al., 2005
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Pekrun, 2006 source
May combine two claims.
Study design and conductown data§ 3.4.4. Data analysis · p. 8The assumption of homogeneity of variances was met for programming skills (F=1.620, p=.188), enjoyment of learning (F=1.547, p=.206), and intention to learn (F=0.830, p=.480).
“The results reported homogeneity for programming skills ( F = 1.620, p = .188), enjoyment of learning ( F = 1.547, p = .206), and intention to learn ( F = 0.830, p = .480).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ 5.1. The effect of peer-facilitated learning · p. 12Prior studies show that peer-facilitated learning could enhance students' learning outcomes and lead to positive learning attitudes.
“This result is similar to existing studies showing that peer-facilitated learning could enhance students ' learning outcomes (Karademir, Erdo ˘ gdu & G ¨ okçearslan, 2017; Mahdi, 2006; Mkonto, 2018), and lead to students ' positive learning attitudes (Brown & Rode, 2018; Won & Choi, 2017).”
Quote in the paperNot a substantial claim0 of 3 sources checkedClassified as probably not a substantial claim.
Study design and conductnone given§ 3.1. Participants · p. 6The teacher did not directly interfere with students' interaction and collaboration.
“The involved teacher adopted and implemented the peer-facilitated learning intervention and distributed pair programming intervention in this study and did not directly interfere with students ' interaction and collaboration.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Very few studies have explored the effects of peer-facilitated learning in online learning environments.
“Although the positive effects of peer-facilitated learning have been indicated in various science courses (Lowell et al., 2022), very few studies have explored its effects in online learning environments.”
The paper relies on this without support.
Very few studies on programming education combine and integrate peer-facilitated learning and distributed pair programming in an online course.
“Up to now, there are very few studies available on programming education that combine and integrate peer-facilitated learning and distributed pair program ming in an online course.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Peer-facilitated group sizes do not fit six-member teams
MinorThe two peer-facilitated groups have 25 and 41 students. Neither total can be divided into teams each containing six members, and the text gives no exception for smaller teams.
“the peer-facilitated learning and distributed pair programming class (G1, n = 25), the peer-facilitated learning and non-distributed pair programming class (G2, n = 41)”
“In the implementation of peer-facilitated learning in G1 and G2, the students were divided into teams, each with six members.”
Cites
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709 · see citing works
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · see citing works
Pekrun, R. (2006) · Educational Psychology Review · doi:10.1007/s10648-006-9029-9 · Cited by 5,566 · cited 3× · see citing works
“In the seventeenth week of the semester, all of the students in each group were required to complete the AEQ so that the researchers could comprehend their enjoyment of learning.”
<scp>COVID</scp> ‐19 and online teaching in higher education: A case study of Peking University
Bao, W. (2020) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.191 · Cited by 2,268 · cited 1× · see citing works
“Furthermore, it is predicted that the COVID-19 pandemic has likely negatively impacted online learning, as the transition to online learning environments can be challenging (Bao, 2020).”
Online learning amid the COVID-19 pandemic: Students perspectives
Adnan, M. (2020) · Journal of Pedagogical Sociology and Psychology · doi:10.33902/jpsp.2020261309 · Cited by 1,925 · see citing works
Topping, K. J. (2005) · Educational Psychology · doi:10.1080/01443410500345172 · Cited by 1,597 · cited 1× · see citing works
“It is indicated that students’ collaboration in a peer-facilitated learning process could have a positive effect on their academic performance and class attendance (Hurley et al., 2003; Karademir et al., 2017; Kavanoz & Yüksel, 2010; Topping, 2005).”
Mailizar, M., Almanthari, A., Maulina, S., et al. (2020) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/8240 · Cited by 800 · cited 1× · see citing works
“emergency (Adnan & Anwar, 2020); as such, it has had a serious impact on students, educators, and institutions around the globe (Mailizar et al., 2020).”
A review of online course dropout research: implications for practice and future research
Lee, Y., & Choi, J. (2011) · Educational Technology Research and Development · doi:10.1007/s11423-010-9177-y · Cited by 747 · see citing works
Learners’ acceptance of e-learning in South Korea: Theories and results
Lee, B.-C., Yoon, J.-O., & Lee, I. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.06.014 · Cited by 638 · cited 1× · see citing works
“Moreover, existing research indicates that learners’ experiences in online interactions with peers and teachers are critical factors shaping their intention to learn (Brahmasrene & Lee, 2012; Guo et al., 2016; Huang et al., 2017; Lee et al., 2009; Zhu et al., 2020).”
Post-Covid-19 Education and Education Technology ‘Solutionism’: a Seller’s Market
Teräs, M., Suoranta, J., Teräs, H., & Curcher, M. (2020) · Postdigital Science and Education · doi:10.1007/s42438-020-00164-x · Cited by 638 · cited 1× · see citing works
“To keep education operating, schools and universities have had to adapt to the situation quickly (Teräs et al., 2020).”
Learning in MOOCs: Motivations and self-regulated learning in MOOCs
Littlejohn, A. H., Hood, N., Milligan, C., & Mustain, P. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.12.003 · Cited by 582 · cited 1× · see citing works
“In addition, it is reported that enjoyment of learning is one of the important primary motivations for learners in online courses (Littlejohn et al., 2016; Luik et al., 2019).”
Chien, S., Hwang, G., & Jong, M. S. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103751 · Cited by 488 · see citing works
Measuring Situational Interest in Academic Domains
Linnenbrink‐Garcia, L., Durik, A. M., Conley, A. M., Barron, K. E., Tauer, J. M., Karabenick, S. A., & Harackiewicz, J. M. (2010) · Educational and Psychological Measurement · doi:10.1177/0013164409355699 · Cited by 450 · cited 1× · see citing works
“Enjoyment of learning, instilled by instructors’ supportive and enthusiastic attitudes, and construction of knowledge, can also raise students’ value-related beliefs (such as importance and meaningfulness of learning) and feeling-related beliefs (such as affective experience in learning), that in turn develop their pe…”
Avi Besser, A., Flett, G. L., & Zeigler‐Hill, V. (2020) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000198 · Cited by 416 · see citing works
The nature of learning : using research to inspire practice
Dumont, H. (2010) · Cited by 411 · see citing works
Journal of Educational Computing Research
(2008) · Journal of Educational Computing Research · doi:10.2190/ec.39.4.f · Cited by 332 · see citing works
Rethinking Education in the New Normal Post-COVID-19 Era: A Curriculum Studies Perspective
Cahapay, M. B. (2020) · Aquademia · doi:10.29333/aquademia/8315 · Cited by 306 · cited 1× · see citing works
“Thus, there is a need to consider education anew with emerging opportunities, challenges, and technologies (Cahapay, 2020).”
Huang, Y.-M., Huang, Y.-M., Huang, S.-H., & Lin, Y.-T. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.08.008 · Cited by 293 · see citing works
Foundations of online learning: Challenges and opportunities
Greenhow, C. M., Graham, C. R., & Koehler, M. J. (2022) · Educational Psychologist · doi:10.1080/00461520.2022.2090364 · Cited by 289 · see citing works
Dai, H. M., Teo, T. P., Rappa, N. A., & Huang, F. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103850 · Cited by 284 · see citing works
Zhu, Y., Zhang, J. H., Au, W., & Yates, G. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09753-w · Cited by 267 · cited 1× · see citing works
“Moreover, existing research indicates that learners’ experiences in online interactions with peers and teachers are critical factors shaping their intention to learn (Brahmasrene & Lee, 2012; Guo et al., 2016; Huang et al., 2017; Lee et al., 2009; Zhu et al., 2020).”
Learning to code or coding to learn? A systematic review
Popat, S., & Starkey, L. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.10.005 · Cited by 260 · see citing works
Promoting online learners’ continuance intention: An integrated flow framework
Guo, Z., Xiao, L., Toorn, C. V., Lai, Y., & Seo, C. (2015) · Information & Management · doi:10.1016/j.im.2015.10.010 · Cited by 229 · see citing works
Chai, C. S., Wang, X., & Xu, C. (2020) · Mathematics · doi:10.3390/math8112089 · Cited by 226 · see citing works
Huang, Y.-M., Silitonga, L. M., & Wu, T.-T. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104494 · Cited by 225 · see citing works
Pekrun, R. H., & Stephens, E. J. (2011) · American Psychological Association eBooks · doi:10.1037/13274-001 · Cited by 224 · see citing works
Falloon, G. (2016) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12155 · Cited by 166 · cited 2× · see citing works
“bored and frustrated while facing challenges in programming (Falloon, 2016; Sun et al., 2021).”
Online Distance Learning Readiness During Covid-19 Outbreak Among Undergraduate Students
Allam, S. N. S., Hassan, M. S., Mohideen, R. S., Ramlan, A. F., & Kamal, R. M. (2020) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v10-i5/7236 · Cited by 158 · see citing works
Peer-Assisted Learning in Physical Education: A Review of Theory and Research
Ward, P., Lee, M.-A., & Lee, M.-A. (2005) · Journal of Teaching in Physical Education · doi:10.1123/jtpe.24.3.205 · Cited by 150 · see citing works
Harris, K. R. 1., & American Psychological Association (2011) · American Psychological Association eBooks · doi:10.1037/13274-000 · Cited by 147 · cited 1× · see citing works
“Enjoyment of learning is demonstrably one of the most frequently mentioned positive emotions in achievement situations and academic learning (Pekrun & Stephens, 2012).”
Making sense of social research: How useful is the Hawthorne Effect?
Chiesa, M., & Hobbs, S. (2008) · European Journal of Social Psychology · doi:10.1002/ejsp.401 · Cited by 141 · see citing works
Laird, T. F. N., Seifert, T. A., Pascarella, E. T., Mayhew, M. J., & Blaich, C. F. (2014) · The Journal of Higher Education · doi:10.1080/00221546.2014.11777333 · Cited by 131 · see citing works
Teaching Problem Solving Skills using an Educational Game in a Computer Programming Course
Mathew, R., Malik, S. I., & Tawafak, R. M. (2019) · Informatics in Education · doi:10.15388/infedu.2019.17 · Cited by 129 · see citing works
Antecedents of student MOOC revisit intention: Moderation effect of course difficulty
Huang, L., Zhang, J., & Liu, Y. (2017) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2016.12.002 · Cited by 118 · see citing works
The impact of supplemental instruction on learning competence and academic performance
Ning, H. K., & Downing, K. (2010) · Studies in Higher Education · doi:10.1080/03075070903390786 · Cited by 110 · see citing works
Li, J., & Che, W. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.103958 · Cited by 103 · see citing works
Tools and Techniques for Teaching Computer Programming: A Review
Kanika, K., Chakraverty, S., & Chakraborty, P. (2020) · Journal of Educational Technology Systems · doi:10.1177/0047239520926971 · Cited by 99 · see citing works
Do students need teacher’s initiation in online collaborative learning?
Tsai, C. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.10.021 · Cited by 79 · see citing works
Self-citationStewart, W. H., & Lowenthal, P. R. (2021) · Journal of Research on Technology in Education · doi:10.1080/15391523.2021.1891996 · Cited by 76 · see citing works
The Supplemental Instruction Project: peer-devised and delivered tutorials
Hurley, K. F., McKay, D. W., Scott, T. M., et al. (2003) · Medical Teacher · doi:10.1080/01421590306793 · Cited by 73 · see citing works
2020 IEEE Frontiers in Education Conference (FIE)
(2020) · doi:10.1109/fie44824.2020 · Cited by 71 · see citing works
Peer learning a pedagogical approach to enhance online learning: A qualitative exploration
Raymond, A., Jacob, E. R., Jacob, D., et al. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.05.016 · Cited by 69 · cited 1× · see citing works
“It is important for teachers to help students achieve expected learning effects and also reduce their isolation in the online learning environments (Raymond et al., 2016).”
Sharma, K., Papavlasopoulou, S., & Giannakos, M. N. (2019) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2019.04.004 · Cited by 66 · see citing works
Designing an Introductory Programming Course to Improve Non-Majors' Experiences
Dawson, J. Q., Allen, M., Campbell, A., & Valair, A. (2018) · Proceedings of the 49th ACM Technical Symposium on Computer Science Education · doi:10.1145/3159450.3159548 · Cited by 66 · see citing works
Distributed Pair Programming: A Systematic Literature Review
da Silva Estácio, B. J., & Prikladnicki, R. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.02.011 · Cited by 65 · see citing works
Using Structured Pair Activities in a Distributed Online Breakout Room
Saltz, J., & Heckman, R. (2020) · Online Learning · doi:10.24059/olj.v24i1.1632 · Cited by 61 · see citing works
COVID-19 impact on undergraduate teaching: Medical radiation science teaching team experience
Currie, G. M., Hewis, J., Nelson, T., Chandler, A., Nabasenja, C., Spuur, K. M., Barry, K., Frame, N., & Kilgour, A. (2020) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2020.09.002 · Cited by 54 · cited 1× · see citing works
“Online pedagogy needs to be reassessed and re-designed, particularly for complex programming courses (Currie et al., 2020; Greenhow, Graham & Koehler, 2022; Harefa & Sihombing, 2021).”
Disciplinary perspectives on feedback processes: towards signature feedback practices
Carless, D. R., To, J., Kwan, C., & Kwok, J. (2020) · Teaching in Higher Education · doi:10.1080/13562517.2020.1863355 · Cited by 53 · see citing works
Won, M., & Choi, Y. (2017) · Nurse Education Today · doi:10.1016/j.nedt.2016.12.023 · Cited by 52 · see citing works
Patterns of kindergarten children’s social interaction with peers in the computer area
Lim, E. M. (2012) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-012-9152-1 · Cited by 48 · cited 2× · see citing works
“Moreover, in pair programming, students’ collaboration is productive for acquiring computer literacy skills beyond programming skills (Lim, 2012; Sharma, Papavlasopoulou & Giannakos, 2019).”
The Supplemental Instruction Project: peer-devised and delivered tutorials
Hurley, K. F., Mckay, D. W., Scott, T. M., et al. (2003) · Medical Teacher · doi:10.1080/0142159031000136743 · Cited by 47
Chen, I.-C., Hwang, G.-J., Lai, C.-L., & Wang, W.-C. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103856 · Cited by 46 · cited 1× · see citing works
“in this programming course were invited to code the students’ comments (Chen et al., 2020).”
Problem-based collaborative learning groupware to improve computer programming skills
Chorfi, A., Hedjazi, D., Aouag, S., & Boubiche, D. E. (2020) · Behaviour and Information Technology · doi:10.1080/0144929x.2020.1795263 · Cited by 46 · see citing works
What motivates enrolment in programming MOOCs?
Luik, P., Suviste, R., Lepp, M., Palts, T., Tõnisson, E., Säde, M., & Papli, K. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12600 · Cited by 44 · cited 1× · see citing works
“In addition, it is reported that enjoyment of learning is one of the important primary motivations for learners in online courses (Littlejohn et al., 2016; Luik et al., 2019).”
Three Contrasting Pairs’ Collaborative Programming Processes in China’s Secondary Education
Sun, D., Ouyang, F., Li, Y., & Chen, H. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633120973430 · Cited by 42 · cited 2× · see citing works
“bored and frustrated while facing challenges in programming (Falloon, 2016; Sun et al., 2021).”
Determinants of Intent to Continue Using Online Learning: A Tale of Two Universities
Brahmasrene, T., & Lee, J. W. (2012) · Interdisciplinary Journal of Information Knowledge and Management · doi:10.28945/1548 · Cited by 40 · see citing works
Artificial intelligence and deep learning in educational technology research and practice
Cheng, X., Sun, J., & Zarifis, A. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.13018 · Cited by 38 · see citing works
Leadership Development Through Peer-Facilitated Simulation in Nursing Education
Brown, K. M., & Rode, J. L. (2018) · Journal of Nursing Education · doi:10.3928/01484834-20180102-11 · Cited by 37 · see citing works
Harefa, S., & Sihombing, G. L. A. (2021) · F1000Research · doi:10.12688/f1000research.52152.1 · Cited by 36 · see citing works
Takase, M., Niitani, M., & Imai, T. (2020) · Nurse Education Today · doi:10.1016/j.nedt.2020.104422 · Cited by 35 · see citing works
Melro, A., Tarling, G., Fujita, T., & Staarman, J. K. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331221133822 · Cited by 35 · see citing works
Buff, A., Reusser, K., & Dinkelmann, I. (2016) · ZDM · doi:10.1007/s11858-016-0823-7 · Cited by 34 · see citing works
Demir, Ö., & Seferoğlu, S. S. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633120949787 · Cited by 34 · see citing works
Students’ Continuance Intention Toward Programming Games: Hedonic and Utilitarian Aspects
Huang, Y. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1647665 · Cited by 33 · cited 1× · see citing works
“In recent rese arch in the field of programming education, intention to learn has come to be regarded as one of the critical factors for student learning evaluation (e.g. Dai et al., 2020; Huang, 2020; Zarei et al., 2020).”
Peer facilitated learning in Mathematics for Engineering: a case study from an Australian university
Power, C., & Dunphy, K. (2010) · Engineering Education · doi:10.11120/ened.2010.05010075 · Cited by 32 · see citing works
Effects of different teaching approaches on programming skills
Erümit, A. K. (2019) · Education and Information Technologies · doi:10.1007/s10639-019-10010-8 · Cited by 32 · cited 1× · see citing works
“Current educators and researchers are seeking to identify and develop effective teaching methods to help students develop the practical knowledge and skills required for twenty-first century workplaces (Erümit, 2020).”
Darban, M., Kwak, D.-H. (., Deng, S. (., Srite, M., & Lee, S. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.09.011 · Cited by 31 · cited 1× · see citing works
“Intention to learn refers to an individual’s motivation or willingness to obtain knowledge about a specified subject (Darban et al., 2016) and is a critical factor in theory of planned behavior (Alhamami & Khan, 2019).”
Cheng, Y.-P., Shen, P.-D., Hung, M.-L., Tsai, C.-W., Lin, C.-H., & Hsu, L. C. (2022) · Universal Access in the Information Society · doi:10.1007/s10209-020-00789-6 · Cited by 30 · see citing works
Self-citationTsai, C. (2015) · Universal Access in the Information Society · doi:10.1007/s10209-015-0401-8 · Cited by 29 · see citing works
Self-citationAn Investigation of Peer-Teaching Technique in Student Teacher Development
Kavanoz, S., & Yüksel, H. (2010) · DergiPark (Istanbul University) · Cited by 26 · see citing works
Peer-assisted Learning Associated with Team-based Learning in Dental Education
Kawas, S. A., & Hamdy, H. (2016) · Health Professions Education · doi:10.1016/j.hpe.2016.08.003 · Cited by 26 · cited 1× · see citing works
“Peer-facilitated learning has been regarded as one of several educational approaches (Huriyah & Contessa, 2020) which can assist students’ learning in higher education institutions (Kawas, 2017).”
ViDA: A virtual debugging advisor for supporting learning in computer programming courses
Lee, V. C. S., Yu, Y. T., Tang, C. M., et al. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12238 · Cited by 26 · cited 1× · see citing works
“Students may also lose motivation during the programming process due to it being very time consuming (Lee et al., 2018).”
Tsai, C.-W., Shen, P.-D., & Chiang, I.-C. (2020) · Universal Access in the Information Society · doi:10.1007/s10209-018-0614-8 · Cited by 26 · see citing works
Self-citationRemote Pair Programming in Virtual Reality
Dominic, J., Tubre, B., Ritter, C., Houser, J. A., Smith, C., & Rodeghero, P. (2020) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme46990.2020.00046 · Cited by 25 · see citing works
Tsai, C.-W. (2014) · Interactive Learning Environments · doi:10.1080/10494820.2012.745422 · Cited by 24 · cited 1× · see citing works
“Second, many students in Taiwan are not willing to learn on their own and are not academically responsible, as they are used to didactic education (Tsai, 2014; Cheng et al., 2022).”
Self-citationIntroducing peer-supported learning approach to tutoring in engineering and technology courses
Mahdi, A. E. (2006) · International Journal of Electrical Engineering & Education · doi:10.7227/ijeee.43.4.1 · Cited by 20 · cited 2× · see citing works
“In such a peer learning model or environment, first-year students’ learning and academic performance was improved (Mahdi, 2006).”
Mbunge, E., Fashoto, S. G., & Olaomi, J. O. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3757988 · Cited by 20 · cited 1× · see citing works
“Furthermore, it is difficult to teach programming in an online course as it requires appropriate supporting information and communications technology (Mbunge et al., 2021), time allocation (Lohiniva & Isomöttönen, 2021) and Internet access (Allam et al., 2020; Yoo et al., 2022).”
Effectiveness of flipped language learning classrooms and students’ perspectives
Alhamami, M., & Khan, M. R. (2019) · Journal on English as a Foreign Language · doi:10.23971/jefl.v9i1.1046 · Cited by 19 · see citing works
Tsai, C., Lee, L.-Y., Cheng, Y.-P., Lin, C.-H., Hung, M., & Lin, J. (2022) · Universal Access in the Information Society · doi:10.1007/s10209-022-00958-9 · Cited by 19 · see citing works
Self-citationSchaefer, T., Fabian, C., & Kopp, T. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12894 · Cited by 18 · see citing works
Learning with peers, active citizenship and student engagement in Enabling Education
Zepke, N. (2018) · Student Success · doi:10.5204/ssj.v9i1.433 · Cited by 17 · cited 1× · see citing works
“Moreover, it is found that active learning with peers could lead to practical learning approaches supportive of learner success, including success frameworks and student engagement pedagogy (Zepke, 2018).”
Corritore, C. L., & Love, B. (2020) · Journal of Information Technology Education Innovations in Practice · doi:10.28945/4618 · Cited by 15 · see citing works
PAIR PROGRAMMING AS A TEAM BASED LEARNING ACTIVITY: A REVIEW OF RESEARCH
(2011) · Issues In Information Systems · doi:10.48009/2_iis_2011_207-216 · Cited by 15 · cited 2× · see citing works
“In addition, it is revealed that learners in pair programming enjoy programming collaboratively (Bowman et al., 2020; Faja, 2011).”
Effects of student-facilitated learning on instructional facilitators
Bonner, S. M., Somers, J. A., Rivera, G. J., et al. (2017) · Instructional Science · doi:10.1007/s11251-017-9410-8 · Cited by 14 · see citing works
Factors Affecting Students’ Performance in Distributed Pair Programming
Xinogalos, S., Satratzemi, M., Chatzigeorgiou, A., et al. (2017) · Journal of Educational Computing Research · doi:10.1177/0735633117749432 · Cited by 14 · cited 3× · see citing works
“Although some existing literature discusses tools or groupware developed for distributed pair programming or remote pair programming (e.g. Dominic et al., 2020; Xinogalos et al., 2019), few of these studies investigated its effects on improving non-computing majors’ learning outcomes.”
InfluentialThe effect of the math emporium instructional method on students’ performance in college algebra
Cousins-Cooper, K., Staley, K., Kim, S., & Luke, N. S. (2017) · European Journal of Science and Mathematics Education · doi:10.30935/scimath/9493 · Cited by 12 · cited 1× · see citing works
“In addition, it is found that peer-facilitated learning is effective in promoting students’ communication and cooperative learning (Cousins-Cooper et al., 2017; Shechtman et al., 2010; Slavin, 2010), concurrently providing chances for personal feedback and social learning (Ward & Lee, 2005).”
Rangel, J. G. C., King, M., & Müldner, K. (2020) · ACM Transactions on Computing Education · doi:10.1145/3377427 · Cited by 12 · cited 1× · see citing works
“, 2021), while learning to program is a new way to think and solve problems (Rangel et al., 2020).”
Chen, K., & Rea, A. I. (2018) · Journal of the Association for Information Systems · Cited by 11 · see citing works
An Empirical Study on Factors related to Distributed Pair Programming
Tsompanoudi, D., Satratzemi, M., Xinogalos, S., et al. (2019) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v9i2.9947 · Cited by 11 · cited 1× · see citing works
“locations (Sobral, 2020) to develop software and write codes (Tsompanoudi et al., 2019).”
MOCSE Centered on Students: Validation of Learning Demands and Teacher Support Scales
Betoret, F. D., Gómez-Artiga, A., Roselló, L. A., & Beút, E. R. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.582926 · Cited by 11 · see citing works
Novice Programming Students' Reflections on Study Motivation during COVID-19 Pandemic
Lohiniva, M., & Isomöttönen, V. (2021) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie49875.2021.9637367 · Cited by 11 · see citing works
Ways of learning in the pharmaceutical sales industry
Hunter, C. P. (2010) · Journal of Workplace Learning · doi:10.1108/13665621011071118 · Cited by 10 · cited 1× · see citing works
“In addition, Hunter (2010) indicated that much of the knowledge learned via peer-facilitated learning could be identified as effectively involving high-status knowledge and practical knowledge.”
A genetic algorithm‐based approach for making pairs and assigning exercises in a programming course
Kanika, K., Chakraverty, S., Chakraborty, P., & Khapra, S. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22349 · Cited by 10 · cited 2× · see citing works
“, 2019); moreover, it is regarded as a successful teaching method and tool for facilitating students’ active learning in programming courses (Sun et al., 2021; Tehlan et al., 2020).”
Yoo, S., Mun, C., Cheon, M., Lee, O., Rhee, Y., & Ha, H. (2022) · Sustainability · doi:10.3390/su14116547 · Cited by 10 · see citing works
Gawlik-Kobylińska, M., Domalewska, D., & Maciejewski, P. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-52575-0_64 · Cited by 9 · see citing works
Look What I Can Do: Acquisition of Programming Skills in the Context of Living Labs
Seraj, M., Grosse, C. S., Autexier, S., & Drechsler, R. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) · doi:10.1109/icse-seet.2019.00029 · Cited by 9 · see citing works
Tang, S., Smith, J. R., Lau, W., Tse, I., Tan, C. L. H., Cotten, R., & Pittenger, A. L. (2017) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2017.23.7.755 · Cited by 8 · see citing works
PODCAST WITH PEER ASSISTED LEARNING TO DEVELOP EFL LEARNERS LISTENING COMPREHENSION AND MOTIVATION
Huriyah, S., & Contessa, E. (2020) · JURNAL BASIS · doi:10.33884/basisupb.v7i2.2476 · Cited by 7 · see citing works
Peer-facilitated learning: Students' experiences
Mkonto, N. (2018) · Africa Education Review · doi:10.1080/18146627.2016.1224599 · Cited by 6 · cited 3× · see citing works
“Peer-facilitated learning is an academic support and effective intervention program which intends to increase learners’ success in at-risk subjects (Mkonto, 2018; Ning & Downing, 2010).”
Yang, K., Tso, T.-Y., Chen, C.-S., Lin, Y.-H., Liu, S.-T., Lin, S.-W., & Lei, K. H. (2019) · Innovations in Education and Teaching International · doi:10.1080/14703297.2019.1687317 · Cited by 6 · cited 1× · see citing works
“In addition, it is reported that a positive intention to learn could lead to learners’ active thinking and reasoning (Yang et al., 2021), while learning to program is a new way to think and solve problems (Rangel, King & Muldner, 2020).”
Is Pair Programing in Higher Education a Good Strategy?
Sobral, S. R. (2020) · International Journal of Information and Education Technology · doi:10.18178/ijiet.2020.10.12.1478 · Cited by 6 · cited 6× · see citing works
“Their roles may be exchanged but one of them is the driver (whose function is writing code) and the other is the navigator (whose function is to monitor the processes and the errors) (Sobral, 2020).”
InfluentialLowell, S. Y., McMillen, S., Lightburn, A., Desjardins, J. L., & Riley, E. A. (2022) · Teaching and Learning in Communication Sciences & Disorders · doi:10.30707/tlcsd6.3.1664996985.103746 · Cited by 6 · cited 2× · see citing works
“In addition, through the mentorship in peer-facilitated collaborative learning, students could benefit by improving their involvement (Croft & Lozada, 2020), motivation (Lowell et al., 2022) and increasing their sense of belonging on campus (Croft & Lozada, 2020).”
Pairing-Based Approach to Support Understanding of Object-Oriented Concepts and Programming
Sulaiman, S. (2020) · International Journal on Advanced Science Engineering and Information Technology · doi:10.18517/ijaseit.10.2.10187 · Cited by 5 · cited 1× · see citing works
“In addition, while many countries regard programming design as a significant issue in the future (Pelmo, 2019), programming courses are considered challenging in higher education, and many educators attempt to help students in learning and mastering their programming skills (Sulaiman, 2020).”
Empowering Public Employment Service Practitioners’ peer facilitation with peer coaching training
Wolf, C., Schaefer, T., Curkovic, K., et al. (2018) · Radar (Oxford Brookes University) · doi:10.24384/000471 · Cited by 4 · see citing works
Li, M., Liu, X., & Yu, Z. (2023) · International Journal of Online Pedagogy and Course Design · doi:10.4018/ijopcd.322782 · Cited by 4 · see citing works
Hornik, T. (2020) · The European Journal of Social & Behavioural Sciences · doi:10.15405/ejsbs.270 · Cited by 3 · cited 1× · see citing works
“Since the existent literature indicates the problems of high drop-out rate in programming (Hornik, 2020), it challenges both teachers and students to maintain students’ intention to learn in and after the course.”
Teaching Introductory Programming Online: Lessons Learned
He, X. (2020) · Journal of the Association for Information Systems · Cited by 3 · see citing works
Xie, X., Liu, J., Cao, B., et al. (2023) · International Journal of Web Services Research · doi:10.4018/ijwsr.319960 · Cited by 3 · cited 1× · see citing works
“For example, it is indicated that while COVID‐19 has forced some educational institutions to close, this pandemic has dramatically increased the usage of online education applications and technologies (Cheng, Sun & Zarifis, 2020; Wang, 2020; Xie et al., 2023).”
Pelmo, M. (2019) · eSpace (Curtin University) · Cited by 2 · see citing works
A New Game-based Strategy for Enhancing Youth Programming Skills
Zarei, A., Mohd‐Yusof, K., Kolivand, H., et al. (2020) · 網際網路技術學刊 · Cited by 2 · see citing works
Proactive Retention through Integrated Modeling of Engagement (PRIME).
Croft, P., & Lozada, N. (2020) · The learning assistance review · Cited by 2 · see citing works
Flagged first, then by citations
15 of the 129 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Hou, 2019, A framework of online judge systems for assessing programming skills, International Journal of Design, Analysis & Tools for Integrated Circuits & Systems, 8, 45
- Karademir, 2017, Two birds with one stone: Enhancing technology perception with peer interaction using web 2.0, Journal of Education and Future, 11, 111
- Syam, 2022, Online learning in higher education: Analysis during the pandemic Covid-19, Jurnal Mantik, 5, 2256
Cited by
Sorted by citations
Yang, T.-C., Hsu, Y.-C., & Wu, J.-Y. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2450659 · Cited by 80 · see citing works
“…insights into the experiences and perceptions of participants in using ChatGPT for programming learning and provided supplementary evidence for the quantitative results, thereby enabling us to comprehend the effects of using ChatGPT in programming education (Liao et al., 2024; Tsai et al., 2023).”
The landscape of flipped classroom research: a bibliometrics analysis
Zhang, F., Wang, H., Zhang, H., & Sun, Q. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1165547 · Cited by 23 · see citing works
“Since the 21st century, information technology has been widely used in pedagogy (Rodríguez-Abad et al., 2022; Tsai et al., 2023).”
Ma, X., Li, C., Xu, J., Zhu, S., & Li, Y. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105453 · Cited by 17 · see citing works
Su, Y.-S., Wang, S. Y., & Liu, X. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331231210560 · Cited by 13 · see citing works
“In this way, students could have a high level of willingness to learn in PP (Tsai et al., 2023).”
BackgroundZhan, Z., Li, T., & Ye, Y. (2024) · Computer Applications in Engineering Education · doi:10.1002/cae.22793 · Cited by 13 · see citing works
“However, the effectiveness of collaborative programming varies significantly based on factors such as the nature of the tasks, the collaborative strategies employed, and the learning environment [57, 78, 79].”
InfluentialZhang, L., Jiang, Q., Xiong, W., & Zhao, W. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251333874 · Cited by 15 · see citing works
“Through pair programming, students bene fi t from social support and feedback, which enhance their problem-solving engagement (Tsai et al., 2023).”
Cheng, S. C. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2471896 · Cited by 9 · see citing works
“Furthermore, the use of instant messaging applications (e.g. Teams and Line) can assist teachers in guiding students to collaborate, enhancing problem-solving and programming skills (Tsai et al., 2023).”
InfluentialMolina, A. I., Bravo, C., Gallardo, J., Lacave, C., & Redondo, M. Á. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112276 · Cited by 7 · see citing works
Zhan, Y., Hong, J., & Zhao, L. (2024) · Journal of Research on Technology in Education · doi:10.1080/15391523.2024.2378073 · Cited by 6 · see citing works
“The explanation might be that in the process of making robots, teachers were not allowed to provide guidance and support, which impaired the teachers’ on-the-spot interaction (Tsai et al., 2023).”
Zhang, Y., Han, Z., He, T., et al. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70012 · Cited by 4 · see citing works
Tsai, C., Lin, M. Y.-C., Cheng, Y.-P., Lee, L., Lin, C.-H., Lin, J., Hung, M., & Chen, W.-Y. (2024) · Universal Access in the Information Society · doi:10.1007/s10209-024-01127-w · Cited by 3 · see citing works
“Learning programming is becoming more widespread in institutions of higher education to meet the increasing computing skills demand in the future [108].”
InfluentialSelf-citationWang, Y. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102068 · Cited by 4 · see citing works
Дегтярьова, Н., Петренко, С. І., Вернидуб, Г., et al. (2024) · Modern Information Technologies and Innovation Methodologies of Education in Professional Training Methodology Theory Experience Problems · doi:10.31652/2412-1142-2024-72-53-61 · Cited by 2 · see citing works
Evangelou, S. M., & Xenos, M. (2025) · Next Research · doi:10.1016/j.nexres.2025.101000 · Cited by 7 · see citing works
Xiong, S., Li, Y., Luo, W., et al. (2025) · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) · doi:10.1109/iaeac65194.2025.11166572 · Cited by 1 · see citing works
“…system, providing precise and learner-centric course suggestions [3] ; Chia-Wen Tsai et al. examined the significance of incorporating online peer-assisted learning and distributed pair programming to enhance students' learning experiences and inform the design of online programming courses [4] .”
Saravanan, S., Sireesha, N. V., Kalaiyarasi, M., Loretta, G. I., Rao, D. S. N. M., & Karunanithi, K. (2023) · International Conference on Energy, Materials and Communication Engineering (ICEMCE) · doi:10.1109/icemce57940.2023.10434126 · Cited by 1 · see citing works
German Reading and Writing Competencies Using Google Classroom
Saleh, N., Usman, M., & Sahayu, W. (2023) · Interference Journal of Language Literature and Linguistics · doi:10.26858/interference.v4i2.51358
“…of research conducted by Alon et al.(2023), Alyoussef (2022), Chen (2023), Hilal et al. (2022), Jardim et al. (2023), Kwong & Churchill (2023), Tsai et al. (2023), Tseng et al. (2023) and Wang et al. (2023), who have suggested that Google Classroom is one of the digital platforms that can…”
BackgroundDatabase System Development for Student Learning Planning Program
Shaferi, I., Nawarini, A. T., Laksana, R. D., et al. (2023) · WSEAS TRANSACTIONS ON ADVANCES in ENGINEERING EDUCATION · doi:10.37394/232010.2023.20.18
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-4786-1 · Cited by 1 · see citing works
The Impact of Virtual Reality Technology on EFL Students
林, 晓. (2025) · Advances in Education · doi:10.12677/ae.2025.156956
Synergy of Islamic Religious Education in Increasing Literacy and Access to Sharia Finance
Puadah, P., Akasyah, D., Hardjadinata, H., et al. (2025) · JURNAL IQRA · doi:10.25217/ji.v10i1.6338
“It was also found that there was a significant contribution from Islamic Religious Education lecturers who not only functioned as religious teachers, but also as value mediators, ethical guides, and facilitators of Islamic economic dialogue (Tsai et al., 2023).”
Hung, M., Chou, C.-L., & Lin, J. (2025) · Asia Pacific Journal of Education · doi:10.1080/02188791.2025.2585022
Self-citationExploring Assessment Approaches for Student Group Projects in Undergraduate Computing Education
Scott, M., Garcia, R., Lovellette, E., et al. (2026) · ACM Transactions on Computing Education · doi:10.1145/3822407
Chang, J.-H., Zhong, H.-X., & Lai, C. (2026) · Educational Technology Research and Development · doi:10.1007/s11423-026-10645-8
Wang, X., Cheng, M., Zeng, Y., et al. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-14156-0
- Authors
- Tsai, C.-W., Lin, M. Y.-C., Cheng, Y.-P., Lee, L.-Y., Chyr, W.-L., Lin, C.-H., Lin, J.-W., & Tsai, M.-C.
- Affiliations
- Ming Chuan University (TW)
- Dayeh University (TW)
- Corresponding author
- Tsai, Chia-Wen
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2023-10
- Volume
- 203
- Pages
- 104849
- ISSN
- 0360-1315 (ISSN-L)
- PMC
- PMC10232937
- OpenAlex
- W4379013911
- Semantic Scholar
- ab36b00bd9c6ede94f5c7fc26d71ec3aca9eaec6
- Cited by
- 25
- References
- 129
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 7 · 2023: 4
- FWCI
- 5.80
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Computers & Education (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion)
- Funders
- National Science and Technology Council (110-2628-H-130-001-)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Innovative Teaching Methods
- Keywords
- distributed pair programming, online programming education, programming skills, joyful learning, intention to learn, non-computer majors, COVID-19 remote teaching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review