Enhancing the Peer-Feedback Process Through Instructional Support: A Meta-Analysis
Open accessAbstract
Peer-feedback can be an effective method to support learning. However, students often require instructional support to provide and process peer-feedback effectively. Previous research used various types of instructional support to improve the quality of peer-feedback processes and outcomes. Yet, a comprehensive overview over their effects is missing. Therefore, this meta-analysis (based on N = 32 studies with N = 3806 learners) investigates the effects of different kinds of instructional support (feedback provision vs. feedback reception; content-specific vs. generic) on peer-feedback processes (formulating high-quality feedback messages, or effectively reflecting on the feedback received) and outcomes (subject-matter-related knowledge). Overall, peer-feedback with vs. without instructional support had a substantial positive effect ( g = 0.47). Furthermore, we found a positive effect of feedback provision support on the quality of feedback provision ( g = 0.72) and the quality of feedback reception ( g = 0.69) but not on subject-matter-related knowledge. For feedback reception support, we found no effects on peer-feedback processes and outcomes at all. During feedback provision, content-specific support positively influenced the quality of feedback provision ( g = 0.75) but not subject-matter-related knowledge, while generic support exerts a positive impact on the quality of feedback provision ( g = 0.70) and subject-matter-related knowledge ( g = 0.55). During feedback reception, we again found no significant effects of content-related support and generic support at all. The lack of effects for feedback reception support may be related to the limited number of studies on feedback reception in general. Finally, concrete implications and suggestions for future research are provided.
AI snapshot
Written from the paper’s full text.
TL;DR
This meta-analysis of 32 studies (3,806 learners) found that adding instructional support to peer-feedback improved peer-feedback processes and some outcomes, with an overall effect of g = 0.47. Effects were reliable for feedback provision support but not for feedback reception support, and subject-matter-related knowledge did not significantly improve overall.
Key findings
- Overall, peer-feedback with instructional support vs. without instructional support had a positive effect: g = 0.47, 95% CI [0.23, 0.72], p < 0.001.
- For dependent variables, effects were positive for quality of feedback provision (g = 0.64, 95% CI [0.30, 0.98], p < 0.01) and quality of feedback reception (g = 0.49, 95% CI [0.05, 0.92], p < 0.05), but not for subject-matter-related knowledge (g = 0.25, 95% CI [-0.00, 0.51], p = 0.05).
- Feedback provision support had a positive effect (g = 0.51, 95% CI [0.24, 0.78], p < 0.001), whereas feedback reception support did not (g = 0.19, 95% CI [-0.83, 1.22], p = 0.50). During feedback provision, both content-specific support (g = 0.48, 95% CI [0.09, 0.87], p < 0.05) and generic support (g = 0.55, 95% CI [0.26, 0.83], p < 0.01) were positive.
- Feedback provision support improved quality of feedback provision (g = 0.72, 95% CI [0.32, 1.12], p < 0.01) and quality of feedback reception (g = 0.69, 95% CI [0.12, 1.25], p < 0.05), but not subject-matter-related knowledge (g = 0.43, 95% CI [-0.03, 0.88], p = 0.06). Generic support during provision significantly improved subject-matter-related knowledge (g = 0.55, 95% CI [0.13, 0.98], p < 0.05), while content-specific support did not (g = 0.34, 95% CI [-0.12, 0.81], p = 0.14).
Methods
- Systematic literature search conducted in December 2024 across Web of Science, Psyndex, PubMed, ERIC, PsycArticles, PubPsych, Google Scholar, and ProQuest; 3,193 records were identified, and 32 articles met all inclusion criteria (N = 3,806 learners).
- Included studies were English, peer-reviewed, primary-data, (quasi-)experimental studies in teaching-learning contexts that compared peer-feedback with instructional support vs. peer-feedback without instructional support, with assessable initial task solutions and cognitive dependent variables.
- Random-effects three-level meta-analysis with robust variance estimation (RVE) in R, using Hedges’ g, post-test scores only, the metafor and clubSandwich packages, and rho = 0.6; influence diagnostics removed one outlier, and publication bias was assessed with funnel plots, Begg’s rank test, and Egger’s regression test.
Limitations
- Stated: only journal-published studies were included; strict criteria yielded only 32 studies; feedback reception support evidence was too small (n = 3 studies, k = 14 effect sizes) to interpret meta-analytically; the small N forced coarse-grained categories and prevented finer subdivision of support types and dependent variables.
- Stated: Egger’s regression test was significant (b = -0.96, t = 2.11, df = 29, 95% CI [-1.90, -0.03], p = 0.04), suggesting possible publication bias, though Begg’s test was non-significant (Kendall’s tau = 0.20, p = 0.12) and the counter-enhanced funnel plot appeared symmetrical; the authors note high heterogeneity may bias Egger’s test.
- Evident from the text: many feedback reception analyses had degrees of freedom less than four and were not interpretable; most included studies measured overt behavior rather than covert cognitive processes, which the authors note limits understanding of mechanisms.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 68 cited sources checked · 0 supported · 0 flagged
- Findingown data
During feedback reception, generic support had no significant effects on peer-feedback processes and outcomes.
“During feedback reception, we again found no significant effects of content-related support and generic support at all.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Rests on an assumption: The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
- Findingown data
Feedback provision support had a positive effect on the quality of feedback reception (g = 0.69).
“Furthermore, we found a positive effect of feedback provision support on the quality of feedback provision (g = 0.72) and the quality of feedback reception (g = 0.69) but not on subject-matter-related knowledge.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Findingown data
During feedback reception, content-related support had no significant effects on peer-feedback processes and outcomes.
“During feedback reception, we again found no significant effects of content-related support and generic support at all.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Rests on an assumption: The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
- Findingown data
Feedback provision support had no effect on subject-matter-related knowledge.
“Furthermore, we found a positive effect of feedback provision support on the quality of feedback provision (g = 0.72) and the quality of feedback reception (g = 0.69) but not on subject-matter-related knowledge.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Findingown data
During feedback provision, generic support had a positive impact on the quality of feedback provision (g = 0.70).
“During feedback provision, content-specific support positively influenced the quality of feedback provision (g = 0.75) but not subject-matter-related knowledge, while generic support exerts a positive impact on the quality of feedback provision (g = 0.70) and subject-matter-related knowledge (g = 0.55).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Rests on an assumption: The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
- Findingown data
During feedback provision, content-specific support did not influence subject-matter-related knowledge.
“During feedback provision, content-specific support positively influenced the quality of feedback provision (g = 0.75) but not subject-matter-related knowledge, while generic support exerts a positive impact on the quality of feedback provision (g = 0.70) and subject-matter-related knowledge (g = 0.55).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Rests on an assumption: The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
- Findingown data
Overall, peer-feedback with vs. without instructional support had a substantial positive effect (g = 0.47).
“Overall, peer-feedback with vs. without instructional support had a substantial positive effect (g = 0.47).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Findingown data
During feedback provision, content-specific support positively influenced the quality of feedback provision (g = 0.75).
“During feedback provision, content-specific support positively influenced the quality of feedback provision (g = 0.75) but not subject-matter-related knowledge, while generic support exerts a positive impact on the quality of feedback provision (g = 0.70) and subject-matter-related knowledge (g = 0.55).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Rests on an assumption: The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
- Findingown data
Feedback reception support had no effects on peer-feedback processes and outcomes.
“For feedback reception support, we found no effects on peer-feedback processes and outcomes at all.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Findingown data
Egger's regression test was significant (b = -0.96, t = 2.11, df = 29, 95% CI [-1.90, -0.03], p = 0.04).
“The result of Egger's regression test (b = -0.96,t = 2.11, df = 29, 95% CI [-1.90, -0.03], p = 0.04) was significant”
Quote in the paperNot a substantial claim - Findingown data
Feedback provision support had a positive effect on the quality of feedback provision (g = 0.72).
“Furthermore, we found a positive effect of feedback provision support on the quality of feedback provision (g = 0.72) and the quality of feedback reception (g = 0.69) but not on subject-matter-related knowledge.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Findingown data
During feedback provision, generic support had a positive impact on subject-matter-related knowledge (g = 0.55).
“During feedback provision, content-specific support positively influenced the quality of feedback provision (g = 0.75) but not subject-matter-related knowledge, while generic support exerts a positive impact on the quality of feedback provision (g = 0.70) and subject-matter-related knowledge (g = 0.55).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
- Rests on an assumption: The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
- Findingown data
Feedback provision support compared to peer-feedback without instructional support has a significantly positive, medium-sized effect.
“we found a significantly positive, medium-sized effect of feedback provision support compared to peer-feedback without instructional support.”
Quote in the paperSubstantial claim - Findingown data
Peer-feedback with instructional support compared to peer-feedback without instructional support has a positive, small-sized general effect (g = 0.47, 95% CI [0.23, 0.72], p < 0.001).
“the results regarding the first research question revealed a positive, small-sized general effect of peer-feedback with instructional support compared to peer-feedback without instructional support (g = 0.47, 95% CI [0.23, 0.72], p < 0.001).”
Quote in the paperSubstantial claim - Findingnone given
Only very few studies measure learning processes that capture how learners actually process peer-feedback.
“One explanation for the lack of such effects might be that only very few studies measure learning processes that capture how learners actually process peer-feedback.”
Quote in the paperSubstantial claim - Findingown data
Content-specific and generic support during the feedback reception phase compared to peer-feedback without instructional support during the feedback reception phase have no significant effects.
“Regarding the effects of contentspecific support and generic support during the feedback reception phase (RQ3c), we found no significant effects.”
Quote in the paperSubstantial claim - Findingown data
Most primary studies have mainly focused on students' overt behavior when operationalizing the quality of feedback provision and feedback reception.
“it appears that most of them have mainly focused on students' overt behavior (i.e., the way they actually formulated their feedback or the way they edited their initial task solutions based on the feedback they received).”
Quote in the paperNot a substantial claim - Findingown data
Feedback reception support compared to peer-feedback without instructional support has no significant effect.
“For feedback reception support, we found no significant effect.”
Quote in the paperSubstantial claim - Findingown data
Content-specific support during feedback provision has a positive medium-sized effect on the quality of feedback provision.
“we found a positive medium-sized effect of content-specific support during feedback provision on the quality of feedback provision”
Quote in the paperSubstantial claim - Findingown data
The effect sizes for feedback provision support vs. without and feedback reception support vs. without were not significantly different (F(1, 2.43) = 1.36, p = 0.35).
“The results showed no significant differences between the effect sizes for the comparison between feedback provision support and peer-feedback without instructional support on the one hand and the comparison between feedback reception support vs. peer-feedback without instructional support on the other (F(1, 2.43) = 1.36, p = 0.35).”
Quote in the paperSubstantial claim - Findingown data
Content-specific and generic support during the feedback provision phase compared to peer-feedback without instructional support during the feedback provision phase have small to medium-sized positive effects.
“we found small to medium-sized positive effects for content-specific and generic support during the feedback provision phase compared to peer-feedback without instructional support during the feedback provision phase.”
Quote in the paperSubstantial claim - Findingown data
The counterenhanced funnel plot showed a rather symmetrical distribution.
“the counterenhanced funnel plot in Fig. 3 showed a rather symmetrical distribution”
Quote in the paperSubstantial claim - Findingown data
Generic support during feedback provision has no significant effect on the quality of feedback reception.
“but no significant effect on the quality of feedback reception.”
Quote in the paperSubstantial claim - Findingown data
Feedback provision support has no significant effect on subject-matter-related knowledge.
“For subject-matter-related knowledge, we did not find a significant effect of feedback provision support (see Table 4).”
Quote in the paperSubstantial claim - Findingown data
Peer-feedback with instructional support vs. without instructional support has a small positive effect on the quality of feedback reception.
“and a small positive effect on the quality of feedback reception.”
Quote in the paperSubstantial claim - Findingown data
Peer-feedback with instructional support vs. without instructional support has no significant effect on subject-matter-related knowledge.
“For subject-matter-related knowledge, we found no significant effect (see Table 2).”
Quote in the paperSubstantial claim - Findingown data
Begg's correlation rank test was non-significant (Kendall's tau = 0.20, p = 0.12).
“whereas Begg's correlation rank test (Kendall's tau = 0.20, p = 0.12) was non-significant.”
Quote in the paperNot a substantial claim - Findingown data
The effects of peer-feedback with instructional support vs. without on the different dependent variables were not significantly different from each other (F(2,187) = 1.83, p = 0.23).
“This was not the case (F(2,187) = 1.83, p = 0.23).”
Quote in the paperNot a substantial claim - Findingown data
Peer-feedback with instructional support vs. without instructional support has a positive, medium-sized effect on the quality of feedback provision.
“Results revealed a positive, medium-sized effect for peer-feedback with instructional support vs. without instructional support on the quality of feedback provision”
Quote in the paperSubstantial claim - Findingown data
Instructional support had an effect on subject-matter-related knowledge (g = 0.25, SE = 0.12, 95% CI [-0.00, 0.51], p = 0.05).
“| Subject-matter-related knowledge | 17 | 60 | 0.25 | 0.12 | 17.31 | [-0.00, 0.51] | 0.05 |”
Quote in the paperSubstantial claim - Findingown data
There are differential effects regarding the interaction of different types of instructional support on different kinds of peer-feedback learning processes and outcomes.
“The finding that there are differential effects regarding the interaction of different types of instructional support on different kinds of peer-feedback learning processes and outcomes”
Quote in the paperSubstantial claim - Findingown data
Generic feedback provision support had a positive effect (g = 0.55, SE = 0.13, 95% CI [0.26, 0.83], p < 0.01).
“| Generic | 13 | 79 | 0.55 | 0.13 | 11.94 | [0.26, 0.83] | < 0.01 |”
Quote in the paperSubstantial claim - Findingown data
Feedback provision support had an overall positive effect (g = 0.51, SE = 0.13, 95% CI [0.24, 0.78], p < 0.001).
“| Feedback provision | 29 a | 178 | 0.51 | 0.13 | 25.73 | [0.24, 0.78] | < 0.001 |”
Quote in the paperSubstantial claim - Findingown data
Content-specific feedback provision support had a positive effect (g = 0.48, SE = 0.18, 95% CI [0.09, 0.87], p < 0.05).
“| Content-specific | 20 | 99 | 0.48 | 0.18 | 14.89 | [0.09, 0.87] | < 0.05 |”
Quote in the paperSubstantial claim - Findingown data
Instructional support had a positive effect on the quality of feedback provision (g = 0.64, SE = 0.16, 95% CI [0.30, 0.98], p < 0.01).
“| Quality of feedback provision | 18 | 92 | 0.64 | 0.16 | 17.81 | [0.30, 0.98] | < 0.01 |”
Quote in the paperSubstantial claim - Findingown data
Generic feedback reception support had no significant effect (g = 0.12, SE = 0.37, 95% CI [-4.56, 4.80], p = 0.80).
“| Generic | 2 | 10 | 0.12 | 0.37 | 1 | [-4.56, 4.80] | 0.80 b |”
Quote in the paperSubstantial claim - Findingown data
Feedback reception support had no significant overall effect (g = 0.19, SE = 0.23, 95% CI [-0.83, 1.22], p = 0.50).
“| Feedback reception | 3 | 14 | 0.19 | 0.23 | 1.97 | [-0.83, 1.22] | 0.50 b |”
Quote in the paperSubstantial claim - Findingown data
Instructional support had a positive effect on the quality of feedback reception (g = 0.49, SE = 0.21, 95% CI [0.05, 0.92], p < 0.05).
“| Quality of feedback reception | 18 | 40 | 0.49 | 0.21 | 20.70 | [0.05, 0.92] | < 0.05 |”
Quote in the paperSubstantial claim - Findingown data
Content-specific feedback reception support had no significant effect (g = 0.37, SE = 0.13, 95% CI [-1.32, 2.06], p = 0.22).
“| Content-specific | 1 | 4 | 0.37 | 0.13 | 1 | [-1.32, 2.06] | 0.22 b |”
Quote in the paperSubstantial claim - Premisecitation
Instructional support can play an important role in the peer-feedback process.
“Particularly important in the context of this article are the significant positive effects of rater training for the feedback provider, explicit rating criteria, and rubrics, which suggest that instructional support can play an important role in the peer-feedback process (Double et al., 2020;Li et al., 2020).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Double et al., 2020 source
Not checked in the free run.
- cites Li et al., 2020
Not checked in the free run.
- Premisecitation
Different moderator variables can improve the effects of peer-feedback on processes and outcomes.
“Furthermore, the meta-analyses (Double et al., 2020;Huisman et al., 2019;Li et al., 2020) showed that different moderator variables can improve the effects of peer-feedback on processes and outcomes.”
Quote in the paperSubstantial claim0 of 3 sources checked - Premisecitation
Instructional support in peer-feedback may help students formulate high-quality feedback messages.
“With respect to peer-feedback processes, it may help students formulate high-quality feedback messages or deeply elaborate on the feedback they receive from their peers (Lui & Andrade, 2022;Patchan & Schunn, 2015).”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
Students often have difficulties with how to process and integrate feedback from their peers in their revisions.
“as well as with how to process and integrate feedback from their peers in their revisions (e.g., Wu & Schunn, 2020a, 2020b).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Wu & Schunn, 2020a, 2020b
Not checked in the free run.
- Premisecitation
Explicit rating criteria have significant positive effects on peer-feedback processes and outcomes.
“Particularly important in the context of this article are the significant positive effects of rater training for the feedback provider, explicit rating criteria, and rubrics, which suggest that instructional support can play an important role in the peer-feedback process (Double et al., 2020;Li et al., 2020).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Double et al., 2020 source
Not checked in the free run.
- cites Li et al., 2020
Not checked in the free run.
- Premisecitation
Students often require additional instructional support to realize the full potential of peer-feedback.
“Therefore, students often require additional instructional support to realize the full potential of peer-feedback (e.g., Lui & Andrade, 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lui & Andrade, 2022 source
Not checked in the free run.
- Premisecitation
Use of supplemental instructional support compared to no instructional support led to medium positive effects on learning achievement.
“In addition, the use of supplemental instructional support compared to no instructional support led to medium positive effects on learning achievement.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Zheng et al., 2020 source
Not checked in the free run.
- Premisecitation
Students often have difficulties with how to provide high-quality feedback.
“However, research has shown that students often have difficulties with how to provide high-quality feedback (Carless & Boud, 2018)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Carless & Boud, 2018 source
Not checked in the free run.
- Premisecitation
Peer-feedback has great potential to enhance students' learning processes and outcomes.
“Peer-feedback has great potential to enhance students' learning processes and outcomes (e.g., Double et al., 2020;Huisman et al., 2019).”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
Receiving training during peer-feedback can improve learning.
“Further, Zheng et al. (2020) found in moderator analyses that receiving training during peerfeedback can improve learning.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Zheng et al., 2020 source
Not checked in the free run.
- Premisecitation
Rater training for the feedback provider has significant positive effects on peer-feedback processes and outcomes.
“Particularly important in the context of this article are the significant positive effects of rater training for the feedback provider, explicit rating criteria, and rubrics, which suggest that instructional support can play an important role in the peer-feedback process (Double et al., 2020;Li et al., 2020).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Double et al., 2020 source
Not checked in the free run.
- cites Li et al., 2020
Not checked in the free run.
- Premisecitation
Instructional support in peer-feedback may help students deeply elaborate on the feedback they receive from their peers.
“With respect to peer-feedback processes, it may help students formulate high-quality feedback messages or deeply elaborate on the feedback they receive from their peers (Lui & Andrade, 2022;Patchan & Schunn, 2015).”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
Among types of instructional support Zheng et al. investigated, peer-feedback rules and extra tools had significant and medium-sized positive effects on achievement.
“Among the types of instructional support Zheng et al. (2020) investigated,”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zheng et al., 2020 source
Not checked in the free run.
- Premisecitation
Instructional support in peer-feedback may help students acquire subject-matter-related knowledge on the topic they discussed with their peers.
“With respect to outcomes, instructional support may help students acquire subject-matter-related knowledge on the topic they discussed with their peers (e.g., Dmoshinskaia et al., 2021).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Dmoshinskaia et al., 2021
Not checked in the free run.
- Premisecitation
Rubrics have significant positive effects on peer-feedback processes and outcomes.
“Particularly important in the context of this article are the significant positive effects of rater training for the feedback provider, explicit rating criteria, and rubrics, which suggest that instructional support can play an important role in the peer-feedback process (Double et al., 2020;Li et al., 2020).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Double et al., 2020 source
Not checked in the free run.
- cites Li et al., 2020
Not checked in the free run.
- Interpretationreasoning
It might be easier to support the feedback provision phase than the feedback reception phase.
“These effects may indicate that it might be easier to support the feedback provision phase than the feedback reception phase.”
Quote in the paperSubstantial claim - Interpretationreasoning
Content-specific support needs to be very carefully designed to yield positive effects on subject-matter-related knowledge.
“Apparently, content-specific support needs to be very carefully designed to yield such positive effects.”
Quote in the paperSubstantial claim - Premisecitation
Students often need support regarding how to provide and/or process feedback they receive from their peers to truly benefit from it.
“students often need support regarding how to provide and/or process feedback they receive from their peers to truly benefit from it”
Quote in the paperSubstantial claim0 of 3 sources checked - Interpretationown data
Integrating instructional support in the peer-feedback process seems to promote peer-feedback in general, beyond the positive effects of peer-feedback when it is not supported.
“Thus, integrating instructional support in the peer-feedback process seems to promote peer-feedback in general (i.e., without differentiating between different kinds of instructional support and dependent variables), beyond the positive effects of peer-feedback when it is not supported.”
Quote in the paperSubstantial claim - Interpretationcitation
The result for feedback reception support might not be robust once the evidence basis increases.
“this result might not be robust once the evidence basis increases (Fisher & Tipton, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fisher & Tipton, 2015
Not checked in the free run.
- Interpretationown data
Augmenting peer-feedback with instructional support yields positive effects on relevant learning processes in peer-feedback.
“these findings show that augmenting peer-feedback with instructional support yields positive effects on relevant learning processes in peer-feedback”
Quote in the paperSubstantial claim0 of 3 sources checked - Interpretationown data
When instructors choose generic support, they may additionally produce positive effects on students' subject-matter-related knowledge, which is less likely when they opt for content-specific support.
“when they choose generic support, they may additionally produce positive effects on students' subject-matter-related knowledge, which according to our results is less likely when they opt for content-specific support (e.g., Hsu, 2016).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hsu, 2016
Not checked in the free run.
- Study design and conductcitation
The number of studies available to examine the effects of content-specific support and generic support during feedback reception on the quality of feedback reception and subject-matter-related knowledge was too small to interpret them as the degrees of freedom are less than four in all these analyses.
“Unfortunately, the number of studies available to examine the effects of content-specific support and generic support during feedback reception on the quality of feedback reception, and subject-matterrelated knowledge (RQ4c) was too small to interpret them as the degrees of freedom are less than four in all these analyses (Fisher & Tipton, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fisher & Tipton, 2015
Not checked in the free run.
- Study design and conductreasoning
The meta-analysis did not compare peer-feedback with instructional support with no-peer-feedback conditions but instead with conditions in which learners also participated in peer-feedback.
“our metaanalysis did not compare peer-feedback with instructional support with no-peerfeedback conditions but instead with conditions in which learners also participated in peer-feedback.”
Quote in the paperSubstantial claim - Interpretationown data
Increasing the effectiveness of peer-feedback by almost one half of a standard deviation through the integration of instructional support is notable.
“increasing its effectiveness by almost one half of a standard deviation through the integration of instructional support is definitely notable”
Quote in the paperSubstantial claim - Premisecitation
The phase of receiving feedback is more complex than providing feedback.
“In contrast, the phase of receiving feedback appears to be more complex (e.g., Lipnevich & Smith, 2022;Winstone et al., 2017)”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
Peer-feedback in itself has been shown to be an effective learning method.
“As peer-feedback in itself has been shown to be an effective learning method (e.g., Double et al., 2020)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Double et al., 2020 source
Not checked in the free run.
- Study design and conductcitation
The results for content-specific and generic support during feedback reception cannot be interpreted because the degrees of freedom are all less than four.
“as the degrees of freedom are all less than four, these results cannot be interpreted (Fisher & Tipton, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fisher & Tipton, 2015
Not checked in the free run.
- Interpretationown data
There is no strong evidence for publication bias in the meta-analysis.
“indicating no strong evidence for publication bias in our meta-analysis.”
Quote in the paperNot a substantial claim - Premisecitation
Other meta-analyses also found no effects in moderator analyses of different types of instructional support on learning outcomes assessed after peer-feedback scenarios.
“This finding is in line with the results of other meta-analyses, which also found no effects in moderator analyses of different types of instructional support on learning outcomes that are assessed after peer-feedback scenarios (e.g., Double et al., 2020;Huisman et al., 2019;Li et al., 2020).”
Quote in the paperNot a substantial claim0 of 3 sources checked - Interpretationcitation
The lack of effects of feedback reception support may also be caused by a statistical power problem.
“the lack of effects of feedback reception support may also be caused by a statistical power problem (Fisher & Tipton, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fisher & Tipton, 2015
Not checked in the free run.
- Interpretationreasoning
An engagement in higher-quality cognitive processes does not necessarily translate into the development of a deeper understanding of subject-matter information.
“an engagement in these higher-quality cognitive processes does not necessarily translate into the development of a deeper understanding of subject-matter information.”
Quote in the paperSubstantial claim - Premisecitation
Peer-feedback can be an effective way to promote learning.
“While peer-feedback can be an effective way to promote learning”
Quote in the paperSubstantial claim0 of 3 sources checked - Interpretationcitation
It is not guaranteed that the studies ensured that the students actually engaged in mindful processing.
“Therefore, it is not guaranteed that the studies ensured that the students actually engaged in mindful processing, as a kind of manipulation check (Bolzer et al., 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Bolzer et al., 2015 source
Not checked in the free run.
- Interpretationown data
The general effectiveness of peer-feedback as instructional method can further be improved by adding instructional support to the peer-feedback process, especially by implementing instructional support that supports learners in providing high-quality feedback to each other.
“Taken together, the results of this meta-analysis indicate that the general effectiveness of peer-feedback as instructional method can further be improved by adding instructional support to the peer-feedback process, especially by implementing instructional support that supports learners in providing high-quality feedback to each other.”
Quote in the paperSubstantial claim - Interpretationown data
Instructional support, as opposed to no instructional support, can effectively improve the peer-feedback process.
“Overall, the results of our meta-analysis show that instructional support, as opposed to no instructional support, can effectively improve the peer-feedback process.”
Quote in the paperSubstantial claim - Study design and conductown data
The small N of available studies allowed looking at types of instructional support and indicators of peer-feedback learning processes and outcomes only at a rather coarse-grained level.
“Third, the small N of available studies in general allowed us to look at the types of instructional support and indicators of peer-feedback learning processes and outcomes only at a rather coarse-grained level”
Quote in the paperNot a substantial claim - Study design and conductown data
The results for feedback reception support cannot be interpreted meta-analytically because the number of effect sizes for individual combinations is far too small.
“This means that the results cannot be interpreted meta-analytically, as the number of effect sizes for individual combinations is far too small.”
Quote in the paperSubstantial claim - Premisecitation
Peer-feedback by itself is an effective method to support student learning.
“while peer-feedback by itself is an effective method to support student learning (e.g., Double et al., 2020)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Double et al., 2020 source
Not checked in the free run.
- Interpretationown data
Different types of instructional support in the two phases of feedback provision and feedback reception can have similar effects on the dependent variables analyzed.
“in the two phases of feedback provision and feedback reception can have similar effects on the dependent variables analyzed (i.e., quality of feedback provision, quality of feedback reception, subject-matter-related knowledge).”
Quote in the paperSubstantial claim - Study design and conductcitation
The evidence base for content-specific and generic support during feedback reception is too weak to arrive at definitive conclusions.
“However, the evidence base is too weak to arrive at definitive conclusions (Fisher & Tipton, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fisher & Tipton, 2015
Not checked in the free run.
- Interpretationown data
Peer-feedback can be even more effective if instructors carefully integrate instructional support in the peer-feedback process.
“it can be even more effective if instructors carefully integrate instructional support in the peer-feedback process.”
Quote in the paperSubstantial claim - Interpretationown data
In general, the different types of instructional support have positive effects on learning processes such as formulating high-quality feedback messages and effectively elaborating on feedback received.
“In general, these types of instructional support seem to have positive effects on different learning processes (i.e., formulating high-quality feedback messages, effectively elaborating on the feedback received) and learning outcomes (i.e., subject-matter-related knowledge).”
Quote in the paperSubstantial claim - Interpretationown data
The positive effects of instructional support can be stated rather reliably with respect to feedback provision.
“While we can say this rather reliably with respect to feedback provision, more research is needed at this stage that looks at the effects of instructional support on feedback reception, which is an important phase in the peer-feedback process.”
Quote in the paperSubstantial claim - Interpretationown data
In general, the different types of instructional support have positive effects on subject-matter-related knowledge.
“In general, these types of instructional support seem to have positive effects on different learning processes (i.e., formulating high-quality feedback messages, effectively elaborating on the feedback received) and learning outcomes (i.e., subject-matter-related knowledge).”
Quote in the paperSubstantial claim - Study design and conductown data
The literature search found only n = 3 studies with k = 14 effect sizes for feedback reception support at all.
“In addition, our literature search found only n = 3 studies with k = 14 effect sizes for feedback reception support at all.”
Quote in the paperSubstantial claim - Study design and conductnone given
The current evidence base for feedback reception does not allow for reliable results.
“as the current evidence base for feedback reception does not allow for reliable results.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 20
- May combine two claims. 21
Classified as probably not a substantial claim.
Findingown data32 articles met all inclusion criteria.
“In the end, we scanned 379 full texts, of which 32 articles met all inclusion criteria (see below).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
May combine two claims.
Findingown dataThere were no differences of the types of instructional support for the quality of feedback provision (F(1, 10.86) = 0.01, p = 0.91), the quality of feedback reception (F(1, 5.88) = 1.02, p = 0.35), or subject-matter-related knowledge (F(1, 1.2) = 18.54, p = 0.11).
“we did not find differences of the types of instructional support for the quality of feedback provision (F(1, 10.86) = 0.01, p = 0.91), the quality of feedback reception (F(1, 5.88) = 1.02, p = 0.35), or subject-matter-related knowledge (F(1, 1.2) = 18.54, p = 0.11).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataContent-specific support during feedback provision has no significant effect on the quality of feedback reception nor on subject-matter-related knowledge.
“but no significant effect on the quality of feedback reception, nor on subject-matterrelated knowledge.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataContent-specific support and generic support during feedback reception have no significant effects on the quality of feedback reception and on subject-matter-related knowledge.
“For RQ4c, we found no significant effects neither of content-specific support nor of generic support during feedback reception on the quality of feedback reception and on subject-matter-related knowledge.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThere were no significant differences between the effect sizes of the types of instructional support on the quality of feedback reception (F(1, 2.87) = 1.74, p = 0.28) nor on subject-matter-related knowledge (F(1, 1.31) = 0.55, p = 0.57).
“we tested the effect sizes for differences but found no significant differences between the effect sizes of the types of instructional support, neither on the quality of feedback reception (F(1, 2.87) = 1.74, p = 0.28) nor on subject-matter-related knowledge (F(1, 1.31) = 0.55, p = 0.57).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataGeneric support during feedback provision has positive medium-sized effects on the quality of feedback provision and on subject-matter-related knowledge.
“For generic support during feedback provision, we found positive medium-sized effects on the quality of feedback provision and on subject-matter-related knowledge”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFeedback provision support has small to medium-sized positive effects on the quality of feedback provision and on the quality of feedback reception.
“our analyses revealed small to medium-sized positive effects of feedback provision support on the quality of feedback provision and on the quality of feedback reception.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe dependent variables are rather coarse-grained and relate to overt rather than covert cognitive processes.
“This is also supported by the fact that the dependent variables are rather coarse-grained and relate to overt rather than covert cognitive processes.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductcitationWe used counter-enhanced funnel plots, the rank test, and Egger's regression test to test for publication bias.
“To test for publication bias, we used counter-enhanced funnel plots for visual inspection, the rank test as non-parametric version of robustness (Begg & Mazumdar, 1994), and Egger's regression test (Egger et al., 1997) for statistical analysis.”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe first author and the second author performed the screening with a very good interrater reliability (Gwet's AC1 = 0.92).
“The first author and the second author performed the screening with a very good interrater reliability (Gwet's AC1 = 0.92).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductcitationWe only used post-test scores in our analyses, following recommendations that change scores and post-test scores should not be mixed.
“Thus, we only used post-test scores in our analyses, following recommendations that change scores and post-test scores should not be mixed, as this would introduce another factor of heterogeneity into the data structure (e.g., Deeks et al., 2019;Lipsey & Wilson, 2001).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Deeks et al., 2019
Not checked in the free run.
- cites Lipsey & Wilson, 2001
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductown dataDecisions on inclusion and exclusion were made by two independent raters with a very good interrater reliability (Gwet's AC1 = 0.92).
“Decisions on inclusion and exclusion were made by two independent raters with a very good interrater reliability (Gwet's AC1 = 0.92).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe coding scheme was applied to a random subsample of the studies (N = 9, k = 83) by two independent coders, with sufficient interrater reliability.
“This coding scheme was applied to a random subsample of the studies (N = 9, k = 83) by two independent coders, with sufficient interrater reliability, as described below.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductcitationWe calculated three-level meta-analyses using robust variance estimation (RVE) to control for dependencies within studies.
“We calculated three-level meta-analyses using robust variance estimation (RVE; Hedges et al., 2010) to control for dependencies within studies.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hedges et al., 2010 source
Not checked in the free run.
May combine two claims.
Study design and conductown dataThe meta-analysis included 32 studies with 3806 learners.
“Table 1 gives an overview of the included N = 32 studies with N = 3806 learners.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationPeer-feedback yields better outcomes than no peer-feedback or, in some cases, other forms of feedback, including teacher feedback and self-assessment.
“Taken together, the results of these meta-analyses demonstrated that peer-feedback yields better outcomes than no peer-feedback or, in some cases, other forms of feedback, including teacher feedback and self-assessment.”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationWe performed influence diagnostics (Cook's Distance and DFBETAS) to statistically identify potential outliers.
“To statistically identify potential outliers, we performed influence diagnostics (Cook's Distance and DFBETAS) for all effect sizes (Viechtbauer & Cheung, 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Viechtbauer & Cheung, 2010 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe influence diagnostics revealed one effect size as outlier, and the authors excluded it from the analyses.
“The results of the influence diagnostics revealed one effect size as outlier (see Online Resource 2).We therefore excluded the outlier from the analyses.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe lack of effects for feedback reception support may be related to the limited number of studies on feedback reception in general.
“The lack of effects for feedback reception support may be related to the limited number of studies on feedback reception in general.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTechnology-facilitated peer-feedback had moderate positive effects on learning achievement compared to non-technology-facilitated peer-feedback.
“Their results revealed that technologyfacilitated peer-feedback had moderate positive effects on learning achievement compared to non-technology-facilitated peer-feedback.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zheng et al., 2020 source
Not checked in the free run.
Classified as probably not a substantial claim.
InterpretationreasoningThe lack of effects of content-specific and generic support on feedback reception may indicate that feedback reception is more difficult to support.
“The fact that we did not find effects of content-specific and generic support on feedback reception may again indicate that feedback reception is more difficult to support due to the reasons outlined above”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationcitationThe small number of available studies may hint towards a statistical power problem for feedback reception support.
“Yet again, the small number of available studies may also hint towards a statistical power problem (Fisher & Tipton, 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fisher & Tipton, 2015
Not checked in the free run.
May combine two claims.
PremisecitationReceiving feedback involves both processing and implementing the feedback received, which may require different and more fine-grained types of instructional support than providing feedback.
“Thus, receiving feedback involves both processing and implementing the feedback received, which may require different and more fine-grained types of instructional support than providing feedback (e.g., Li & Grion, 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Li & Grion, 2019 source
Not checked in the free run.
Classified as probably not a substantial claim.
InterpretationcitationAn engagement in covert, subject-matter related cognitive processes might be more responsible for subject-matter-related knowledge.
“an engagement in covert, subjectmatter related cognitive processes might be more responsible for subject-matterrelated knowledge (e.g., Stegmann et al., 2012).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Stegmann et al., 2012 source
Not checked in the free run.
May combine two claims.
InterpretationcitationStudents have a double task when they are not supported by generic support: following content-specific support and writing well-structured feedback at the same time, which can lead to cognitive overload.
“students have a double task when they are not supported by generic support: on the one hand, they have to follow the content-specific support in order to get through the learning content well, and on the other hand, they have to write well-structured feedback at the same time.This can lead to cognitive overload, so that the potential of content-specific support is lost (Sweller, 1999).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Sweller, 1999
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationA possible explanation for the positive effect of generic support on subject-matter-related knowledge is that structural support might reduce students' need to overly ponder about how to provide feedback, so they can focus explicitly on the learning content.
“a possible explanation for the positive effect of generic support on subject-matter-related knowledge could be that this structural support might reduce students' need to overly ponder about how to provide feedback (as generic support will explicitly tell them how to do this), so that they can focus explicitly on the learning content (e.g., Hein & Prediger, 2017;Reiser, 2004).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Hein & Prediger, 2017
Not checked in the free run.
- cites Reiser, 2004 source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThere may be further processes that occur during peer-feedback which might be more predictive for subject-matter-related knowledge that are typically not measured in related studies.
“there may be further processes that occur during peer-feedback which might be more predictive for subject-matter-related knowledge that are typically not measured in related studies.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationGeneric support can be applied across different contexts and domains.
“generic support, as it can be applied across different contexts and domains (Hein & Prediger, 2017;Reiser, 2004).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Hein & Prediger, 2017
Not checked in the free run.
- cites Reiser, 2004 source
Not checked in the free run.
May combine two claims.
Interpretationown dataSupporting students in how to provide high quality feedback messages leads to improvements in the feedback provision phase and has spillover effects to the feedback reception phase.
“The results regarding feedback provision imply that supporting students with respect to how to provide high quality feedback messages does not only lead to improvements in this very phase; it also has spillover effects to the feedback reception phase.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationcitationIf learners process the subject-matter better during feedback provision through instructional support, this could lead to better skill acquisition and thus to better revision performance in the feedback reception phase.
“if learners process the subject-matter better during feedback provision through instructional support, this could lead to better skill acquisition and thus to better revision performance in the feedback reception phase (e.g., Wu & Schunn, 2020b).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Wu & Schunn, 2020b
Not checked in the free run.
May combine two claims.
Study design and conductown dataThe number of available studies for feedback reception support on different dependent variables was too small to reasonably conduct a meta-analysis; these analyses cannot be interpreted.
“To examine the effects of feedback reception support on the different dependent variables, the number of available studies unfortunately was too small to reasonably conduct a meta-analysis.Therefore, these analyses cannot be interpreted.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataBoth content-specific and generic support can be used during feedback provision.
“it seems that, in principle, both types of instructional support can be used during feedback provision.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationContent-specific support needs to be tailored to each new learning situation, which makes it costly to develop.
“Content-specific support, in contrast, needs to be tailored to each new learning situation, which makes it costly to develop (e.g., Hannafin et al., 1999;Vogel et al., 2017).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Hannafin et al., 1999
Not checked in the free run.
- cites Vogel et al., 2017 source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThere are complex mechanisms at work in the peer-feedback process.
“This suggests that there are complex mechanisms at work in the peer-feedback process, which should be uncovered in future research.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataApplying rather strict exclusion criteria allowed the inclusion of only 32 studies, indicating that the number of (quasi-)experimental studies that compare the effects of peer-feedback with instructional support vs. without is still rather low.
“Second, applying rather strict exclusion criteria allowed us to include only 32 studies, indicating that the number of (quasi-)experimental studies that compare the effects of peer-feedback with instructional support vs. peer-feedback without instructional support is still rather low.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe meta-analysis only included studies that were published in a journal.
“First, we only included studies that were published in a journal.”
Quote in the paperNot a substantial claim
The authors state this as an assumption.
Papers that have successfully undergone a rigorous peer-review process provide more reliable results.
“assuming that papers that have successfully undergone a rigorous peerreview process would provide more reliable results.”
The paper relies on this without support.
The two categorizations of instructional support (presentation modes and level of specificity of the dependent variable) are orthogonal to each other.
“Note that these two categorizations of instructional support (i.e., different presentation modes and level of specificity of the dependent variable) are orthogonal to each other.”
The paper relies on this without support.
A comprehensive overview over the effects of different kinds of instructional support is missing.
“Yet, a comprehensive overview over their effects is missing.”
The paper relies on this without support.
Prior empirical research has used a broad variety of different kinds of instructional support in peer-feedback scenarios.
“prior empirical research (a) has used a broad variety of different kinds of instructional support in peer-feedback scenarios”
The paper relies on this without support.
Prior empirical research has yielded rather divergent findings on the effectiveness of different kinds of instructional support.
“and has yielded (b) rather divergent findings on their effectiveness”
The authors state this as an assumption.
The results are not biased by including only published studies.
“However, we can assume that our results are not biased by this as there is little evidence of publication bias.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Since pre-test measures were not consistently available across studies, only post-test scores were included in the analysis.
“Since pre-test measures were not consistently available across studies, only post-test scores were included in the analysis.This approach follows methodological guidance for handling heterogeneous pre-post reporting (Hornstein et al., 2025).”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Hornstein et al., 2025
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Not confirmedF(2, 187) = 1.83reported p = .23 · recomputed p = .163
“F(2,187) = 1.83, p = .23”
- ConsistentF(1, 2.43) = 1.36reported p = .35 · recomputed p = .345
“F(1, 2.43) = 1.36, p = .35”
- ConsistentF(1, 3.84) = 0.14reported p = .72 · recomputed p = .727
“F(1, 3.84) = 0.14, p = .72”
- ConsistentF(1, 1.07) = 0.4reported p = .63 · recomputed p = .635
“F(1, 1.07) = 0.40, p = .63”
- ConsistentF(1, 2.87) = 1.74reported p = .28 · recomputed p = .279
“F(1, 2.87) = 1.74, p = .28”
- ConsistentF(1, 1.31) = 0.55reported p = .57 · recomputed p = .568
“F(1, 1.31) = 0.55, p = .57”
- ConsistentF(1, 10.86) = 0.01reported p = .91 · recomputed p = .922
“F(1, 10.86) = 0.01, p = .91”
- ConsistentF(1, 5.88) = 1.02reported p = .35 · recomputed p = .351
“F(1, 5.88) = 1.02, p = .35”
- ConsistentF(1, 1.2) = 18.54reported p = .11 · recomputed p = .113
“F(1, 1.2) = 18.54, p = .11”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · cited 1× · see citing works
“To test for publication bias, we used counter-enhanced funnel plots for visual inspection, the rank test as non-parametric version of robustness (Begg & Mazumdar, 1994), and Egger’s regression test (Egger et al., 1997) for statistical analysis.”
Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 2× · see citing works
“To calculate effect sizes (Hedge’s g ), we used the “metafor” package [4.4–0] (Viechtbauer, 2010).”
InfluentialOperating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · cited 1× · see citing works
“To test for publication bias, we used counter-enhanced funnel plots for visual inspection, the rank test as non-parametric version of robustness (Begg & Mazumdar, 1994), and Egger’s regression test (Egger et al., 1997) for statistical analysis.”
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 3× · see citing works
“We performed all statistical analyses in R [4.3.2], using random effects three-level meta-analysis (e.g., Assink & Wibbelink, 2016; Borenstein et al., 2009).”
InfluentialHattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 2× · see citing works
“…e.g., “The aim is to…”), describes how they did in their initial task solution (i.e., feed back; e.g., “What you have already done well is…”), or to provide suggestions for improvement (i.e., feed forward; e.g., “For the future, hold on to…”; Bürger-meister et al., 2021; Hattie & Timperley, 2007).”
(2000) · Cited by 9,198 · see citing works
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949 · cited 1× · see citing works
“To statistically identify potential outliers, we performed influence diagnostics (Cook’s Distance and DFBETAS) for all effect sizes (Viechtbauer & Cheung, 2010).”
Analysing data and undertaking meta‐analyses
Deeks, J. J., Higgins, J. P., Altman, D. G., & on behalf of the Cochrane Statistical Methods Group (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch10 · Cited by 2,672 · cited 1× · see citing works
“Thus, we only used post-test scores in our analyses, following recommendations that change scores and post-test scores should not be mixed, as this would introduce another factor of heterogeneity into the data structure (e.g., Deeks et al., 2019; Lip-sey & Wilson, 2001).”
The development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428 · cited 5× · see citing works
“While peer-feedback can be an effective way to promote learning, students often need support regarding how to provide and/or process feedback they receive from their peers to truly benefit from it (e.g., Carless & Boud, 2018; Lui & Andrade, 2022; Strijbos et al., 2010; Winstone et al., 2017).”
InfluentialRobust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · cited 2× · see citing works
“…include multiple effect sizes for one variable from one study (i.e., when a study included multiple instruments to measure the same construct) or comparisons of multiple experimental conditions with the same control condition within one study (Hedges et al., 2010; Moeyaert et al., 2017).”
Doing Meta-Analysis with R: A Hands-On Guide
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021) · doi:10.1201/9781003107347 · Cited by 1,850 · see citing works
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330 · cited 1× · see citing works
“We performed all statistical analyses in R [4.3.2], using random effects three-level meta-analysis (e.g., Assink & Wibbelink, 2016; Borenstein et al., 2009).”
InfluentialSchwarzer, G., Carpenter, J. R., & Rücker, G. (2015) · Use R! · doi:10.1007/978-3-319-21416-0 · Cited by 1,230 · see citing works
Scaffolding Complex Learning: The Mechanisms of Structuring and Problematizing Student Work
Reiser, B. J. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1303_2 · Cited by 1,054 · cited 3× · see citing works
“That way, the complexity of the task of providing feedback is reduced through breaking it down into smaller aspects to mitigate the danger of potential cognitive overload (Hein & Prediger, 2017; Reiser, 2004; Sweller, 1999).”
Rethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966 · cited 3× · see citing works
“…explaining and evaluation processes; van Popta et al., 2017) and feedback reception (i.e., reflect and compare critical the received feedback with their own initial task solution; Nicol et al., 2014), and how they are affected by different kinds of instructional support, are desperately needed.”
(1999) · Cited by 944 · see citing works
Winstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017) · Educational Psychologist · doi:10.1080/00461520.2016.1207538 · Cited by 884 · cited 5× · see citing works
“While peer-feedback can be an effective way to promote learning, students often need support regarding how to provide and/or process feedback they receive from their peers to truly benefit from it (e.g., Carless & Boud, 2018; Lui & Andrade, 2022; Strijbos et al., 2010; Winstone et al., 2017).”
InfluentialTo give is better than to receive: The benefits of peer review to the reviewer's own writing
Lundstrom, K., & Baker, W. (2009) · Journal of Second Language Writing · doi:10.1016/j.jslw.2008.06.002 · Cited by 843 · cited 1× · see citing works
“By elaborating on their peer’s task solution, and by comparing it with their own (Lundstrom & Baker, 2009; van Popta et al., 2017), they may thus engage in deep cognitive processes that may help them to advance their own understanding (Double et al., 2020; Ion et al., 2018).”
Adjusting for publication bias in the presence of heterogeneity
Terrin, N., Schmid, C. H., Lau, J., & Olkin, I. (2003) · Statistics in Medicine · doi:10.1002/sim.1461 · Cited by 809 · cited 1× · see citing works
“Given the way the rank test and Egger’s regression test have been developed and validated, they necessitate statistical independence (e.g., Terrin et al., 2003).”
Meta-analysis with robust variance estimation: Expanding the range of working models
Pustejovsky, J. E., & Tipton, E. (2022) · Prevention Science · doi:10.1007/s11121-021-01246-3 · Cited by 737 · see citing works
The effects of trained peer response on ESL students' revision types and writing quality
Berg, E. C. (1999) · Journal of Second Language Writing · doi:10.1016/s1060-3743(99)80115-5 · Cited by 457 · see citing works
The Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group Studies
Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09510-3 · Cited by 446 · cited 10× · see citing works
“This finding is in line with the results of other meta-analyses, which also found no effects in moderator analyses of different types of instructional support on learning outcomes that are assessed after peer-feedback scenarios (e.g., Double et al., 2020; Huisman et al., 2019; Li et al., 2020).”
InfluentialDoes peer assessment promote student learning? A meta-analysis
Li, H., Xiong, Y., Hunter, C. V., Guo, X., & Tywoniw, R. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1620679 · Cited by 375 · cited 7× · see citing works
“This finding is in line with the results of other meta-analyses, which also found no effects in moderator analyses of different types of instructional support on learning outcomes that are assessed after peer-feedback scenarios (e.g., Double et al., 2020; Huisman et al., 2019; Li et al., 2020).”
InfluentialStrijbos, J.-W., Narciss, S., & Dünnebier, K. (2009) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.008 · Cited by 369 · cited 1× · see citing works
“While peer-feedback can be an effective way to promote learning, students often need support regarding how to provide and/or process feedback they receive from their peers to truly benefit from it (e.g., Carless & Boud, 2018; Lui & Andrade, 2022; Strijbos et al., 2010; Winstone et al., 2017).”
Improving Assessment through Student Involvement
Falchikov, N. (2010) · Routledge eBooks · doi:10.4324/9780203220993 · Cited by 344 · see citing works
Huisman, B., Saab, N., van den Broek, P., & van Driel, J. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1545896 · Cited by 306 · see citing works
The Impact of Scaffolding and Student Achievement Levels in a Problem-based Learning Environment
Glazewski, K. D., & Klein, J. D. (2006) · Instructional Science · doi:10.1007/s11251-006-9002-5 · Cited by 297 · cited 1× · see citing works
“In this article, we use the term “instructional support” in a liberal sense, denoting all kinds of support that help learners engage in a practice that would otherwise be out of reach (cf. Davis & Miyake, 2004; Jackson et al., 1994; Simons & Klein, 2007).”
robumeta: An R-package for robust variance estimation in meta-analysis
Fisher, Z., & Tipton, E. (2015) · arXiv · doi:10.48550/arxiv.1503.02220 · Cited by 280 · see citing works
Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts: a Meta-Analysis
Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2017) · Educational Psychology Review · doi:10.1007/s10648-016-9361-7 · Cited by 278 · cited 2× · see citing works
“The focus of content-specific support is therefore more on the application of specific knowledge in a selected subject area (e.g., Hannafin et al., 1999; Vogel et al., 2017).”
Self-citationInducing Self-Explanation: a Meta-Analysis
Bisra, K., Liu, Q., Nesbit, J. C., Salimi, F., & Winne, P. H. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9434-x · Cited by 278 · cited 1× · see citing works
“In addition, when justifying their feedback, students evaluate their peer’s initial task solutions and may provide subject-matter-related explanations, which all represent important learning activities in their own right (e.g., Bisra et al., 2018; Lachner et al., 2022).”
Moeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van den Noortgate, W. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1252189 · Cited by 274 · cited 3× · see citing works
“This means that less information is lost, and statistical analyses can be carried out despite a small number of studies and effect sizes (Moeyaert et al., 2017).”
Exploring the value of peer feedback in online learning for the provider
van Popta, E., Kral, M., Camp, G., Martens, R. L., & Simons, P. R.-J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2016.10.003 · Cited by 269 · cited 6× · see citing works
“…the internal, that is the covert, cognitive processes that learners engage in during feedback provision (i.e., explaining and evaluation processes; van Popta et al., 2017) and feedback reception (i.e., reflect and compare critical the received feedback with their own initial task solution; Nicol…”
InfluentialPeer assessment as collaborative learning: A cognitive perspective
Kollar, I., & Fischer, F. (2009) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.005 · Cited by 257 · cited 1× · see citing works
“In the (2) task performance phase, the learners produce a first task solution on which their peer(s) can give feed-back, such as a written analysis of a specific problem (Kollar & Fischer, 2010).”
Self-citationPanadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195 · see citing works
Explorations of Scaffolding in Complex Classroom Systems
Davis, E. A., & Miyake, N. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1303_1 · Cited by 189 · cited 1× · see citing works
“In this article, we use the term “instructional support” in a liberal sense, denoting all kinds of support that help learners engage in a practice that would otherwise be out of reach (cf. Davis & Miyake, 2004; Jackson et al., 1994; Simons & Klein, 2007).”
Patchan, M. M., & Schunn, C. D. (2015) · Instructional Science · doi:10.1007/s11251-015-9353-x · Cited by 181 · cited 1× · see citing works
“…peer-feedback may improve different kinds of peer-feedback processes and outcomes: With respect to peer-feedback processes, it may help students formulate high-quality feedback messages or deeply elaborate on the feedback they receive from their peers (Lui & Andrade, 2022; Patchan & Schunn, 2015).”
Latifi, S., Noroozi, O., & Talaee, E. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13054 · Cited by 163 · cited 2× · see citing works
“The literature suggests that students can be supported in this cognitively demanding activity using different kinds of instructional support (e.g., Bürgermeister et al., 2021; Latifi et al., 2021a; Valero et al., 2019).”
An inventory of peer assessment diversity
Gielen, S., Dochy, F., & Onghena, P. (2011) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903221444 · Cited by 160 · cited 1× · see citing works
“With regard to the objects of peer-feed-back (according to Alqassab et al., 2023; S. Gielen et al., 2011), we only included studies in which the initial task solution could be assessed separately from the person (Criterion 9; e.g., case analysis, picture, but not an oral presentation or dance…”
Gielen, S., Tops, L., Dochy, F., Onghena, P., & Smeets, S. (2010) · British Educational Research Journal · doi:10.1080/01411920902894070 · Cited by 160 · see citing works
Making Dynamic Modeling Accessible to Precollege Science Students
Jackson, S. L., Stratford, S. J., Krajcik, J. S., & Soloway, E. M. (1994) · Interactive Learning Environments · doi:10.1080/1049482940040305 · Cited by 157 · cited 1× · see citing works
“In this article, we use the term “instructional support” in a liberal sense, denoting all kinds of support that help learners engage in a practice that would otherwise be out of reach (cf. Davis & Miyake, 2004; Jackson et al., 1994; Simons & Klein, 2007).”
Stegmann, K., Wecker, C., Weinberger, A., & Fischer, F. (2012) · Instructional Science · doi:10.1007/s11251-011-9174-5 · Cited by 149 · cited 2× · see citing works
“Given our observation that most studies we included strongly focused on overt processes that occur during peer-feedback, an engagement in covert, subject-matter related cognitive processes might be more responsible for subject-matter-related knowledge (e.g., Stegmann et al., 2012).”
How does online peer feedback improve argumentative essay writing and learning?
Latifi, S., Noroozi, O., Hatami, J., & Biemans, H. J. A. (2019) · Innovations in Education and Teaching International · doi:10.1080/14703297.2019.1687005 · Cited by 148 · see citing works
From feedback to revisions: Effects of feedback features and perceptions
Wu, Y., & Schunn, C. D. (2019) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2019.101826 · Cited by 141 · cited 4× · see citing works
“A low feedback quality is problematic because the feedback receiver should benefit much less likely from low quality feedback than from high quality feedback (e.g., Wu & Schunn, 2020a).”
InfluentialEffects of Training for Peer Response on Students' Comments and Interaction
Zhu, W. (1995) · Written Communication · doi:10.1177/0741088395012004004 · Cited by 135 · see citing works
Bauer, E., Greisel, M., Kuznetsov, I., Berndt, M., Kollar, I., Dresel, M., Fischer, M. R., & Fischer, F. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13336 · Cited by 130 · cited 3× · see citing works
“According to Bauer et al. (2023), the peer-feedback process consists of five phases: In the (1) design phase, the teacher decides which assignment can be used for further processing, how many learners should provide feedback to each other, from how many peers the learners should receive feedback,…”
InfluentialSelf-citationTraining teachers in peer-assessment skills: effects on performance and perceptions
Sluijsmans *, D. M. A., Brand-Gruwel, S., van Merriënboer, J. J. G., & Martens, R. L. (2004) · Innovations in Education and Teaching International · doi:10.1080/1470329032000172720 · Cited by 127 · see citing works
Student – Feedback Interaction Model: Revised
Lipnevich, A. A., & Smith, J. K. (2022) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2022.101208 · Cited by 125 · cited 1× · see citing works
“In contrast, the phase of receiving feedback appears to be more complex (e.g., Lipnevich & Smith, 2022; Winstone et al., 2017): For feedback to be used efficiently, the feed-back receiver must understand it in the first place.”
Gielen, M., & De Wever, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.06.019 · Cited by 122 · cited 1× · see citing works
“…messages can be measured using various criteria (e.g., coding according to correctness and usefulness of feedback; Dmoshinskaia et al., 2021; category system with “peer-feedback style,” “verification type,” “verification focus,” “elaboration type,” “elaboration focus”; M. Gielen & De Wever, 2015).”
Making internal feedback explicit: exploiting the multiple comparisons that occur during peer review
Nicol, D., & McCallum, S. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.1924620 · Cited by 107 · cited 1× · see citing works
“In this process, they compare the information from the feedback with their own task solution, which may help them expand their existing knowledge or even develop new knowledge (Nicol & McCallum, 2022).”
Giving or receiving feedback: which is more beneficial to students’ learning?
Ion, G., Martí, A. S., & Morell, I. A. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1484881 · Cited by 106 · cited 3× · see citing works
“…surprising finding, as we expected that content-specific support in particular would have a positive effect on subject-matter-related knowledge, as this kind of support is primarily concerned with having learners elaborate more deeply on content information (Double et al., 2020; Ion et al., 2018).”
Mayring, P. (2020) · Springer eBooks · doi:10.1007/978-3-658-26887-9_52 · Cited by 88 · see citing works
Gan, M. J. S., & Hattie, J. (2014) · Instructional Science · doi:10.1007/s11251-014-9319-4 · Cited by 87 · see citing works
Wu, Y., & Schunn, C. D. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101897 · Cited by 83 · cited 4× · see citing works
“A low feedback quality is problematic because the feedback receiver should benefit much less likely from low quality feedback than from high quality feedback (e.g., Wu & Schunn, 2020a).”
InfluentialZheng, L., Cui, P., Li, X., & Huang, R. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1370533 · Cited by 79 · see citing works
Learning-by-Teaching Without Audience Presence or Interaction: When and Why Does it Work?
Lachner, A., Hoogerheide, V., van Gog, T., & Renkl, A. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09643-4 · Cited by 77 · cited 1× · see citing works
“In addition, when justifying their feedback, students evaluate their peer’s initial task solutions and may provide subject-matter-related explanations, which all represent important learning activities in their own right (e.g., Bisra et al., 2018; Lachner et al., 2022).”
The role of technology-facilitated peer assessment and supporting strategies: a meta-analysis
Zheng, L., Zhang, X., & Cui, P. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1644603 · Cited by 75 · cited 5× · see citing works
“Among the types of instructional support Zheng et al. (2020) investigated, “peer-feedback rules” and “extra tools” were found to have significant and medium-sized positive effects on achievement.”
InfluentialStructural validity and invariance of the Feedback Perceptions Questionnaire
Strijbos, J.-W., Pat‐El, R., & Narciss, S. (2021) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2021.100980 · Cited by 75 · cited 1× · see citing works
“Second, even when students have understood the feedback, their own perceptions and skills play a crucial role in how they use the feedback they receive (Berndt et al., 2018; Strijbos et al., 2021).”
Lui, A. M., & Andrade, H. L. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.751548 · Cited by 71 · cited 5× · see citing works
“While peer-feedback can be an effective way to promote learning, students often need support regarding how to provide and/or process feedback they receive from their peers to truly benefit from it (e.g., Carless & Boud, 2018; Lui & Andrade, 2022; Strijbos et al., 2010; Winstone et al., 2017).”
InfluentialA systematic review of peer assessment design elements
Alqassab, M., Strijbos, J.-W., Panadero, E., Ruiz, J. F., Warrens, M., & To, J. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09723-7 · Cited by 65 · cited 2× · see citing works
“With regard to the objects of peer-feed-back (according to Alqassab et al., 2023; S. Gielen et al., 2011), we only included studies in which the initial task solution could be assessed separately from the person (Criterion 9; e.g., case analysis, picture, but not an oral presentation or dance…”
Supporting Peer Feedback on Learning Strategies: Effects on Self-Efficacy and Feedback Quality
Bürgermeister, A., Glogger-Frey, I., & Saalbach, H. (2021) · Psychology Learning & Teaching · doi:10.1177/14757257211016604 · Cited by 60 · cited 3× · see citing works
“The literature suggests that students can be supported in this cognitively demanding activity using different kinds of instructional support (e.g., Bürgermeister et al., 2021; Latifi et al., 2021a; Valero et al., 2019).”
Valero Haro, A., Noroozi, O., Biemans, H. J. A., & Mulder, M. (2019) · Journal of Biological Education · doi:10.1080/00219266.2018.1472132 · Cited by 59 · cited 1× · see citing works
“The literature suggests that students can be supported in this cognitively demanding activity using different kinds of instructional support (e.g., Bürgermeister et al., 2021; Latifi et al., 2021a; Valero et al., 2019).”
Haro, A. V., Noroozi, O., Biemans, H. J. A., Mulder, M., & Banihashem, S. K. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2215822 · Cited by 59 · see citing works
Bolzer, M., Strijbos, J. W., & Fischer, F. (2015) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12091 · Cited by 57 · cited 2× · see citing works
“Bolzer et al. (2015), who explored how mindful cognitive processing can be measured via eye-tracking, provide a good starting point for this.”
Wichmann, A., Funk, A., & Rummel, N. (2017) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0348-7 · Cited by 52 · cited 1× · see citing works
“…presentation modes of instructional support (e.g., preparatory activities, rubrics, sentence start-ers, guiding questions, and integrated support; Wichmann et al., 2018) and (2) the level of specificity of the dependent variables the instructional support focuses on (content-specific vs. generic…”
Berndt, M., Strijbos, J.-W., & Fischer, F. (2017) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0343-z · Cited by 50 · cited 1× · see citing works
“Second, even when students have understood the feedback, their own perceptions and skills play a crucial role in how they use the feedback they receive (Berndt et al., 2018; Strijbos et al., 2021).”
Lee, Y.-F., Lin, C.-J., Hwang, G., Fu, Q.-K., & Tseng, W.-H. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2021.1916763 · Cited by 47 · see citing works
Alemdağ, E., & Yıldırım, Z. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104574 · Cited by 47 · cited 1× · see citing works
“Unfortunately though, prior research shows that the quality of the feedback messages that peers produce often is rather low (Alemdag & Yildirim, 2022).”
Demiraslan Çevik, Y. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.05.056 · Cited by 42 · cited 1× · see citing works
“To do this, students need to plan, monitor, regulate, and reflect their own thinking in order to be able to provide high quality feedback messages (Çevik, 2015; van Popta et al., 2017).”
Scaffolding peer-assessment skills: Risk of interference with learning domain-specific skills?
Könings, K. D., van Zundert, M. J., & van Merriënboer, J. J. G. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2018.11.007 · Cited by 41 · see citing works
Gielen, M., & Wever, B. D. (2012) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2012.11.450 · Cited by 39 · cited 2× · see citing works
“For example, in a study by M. Gielen and De Wever (2012), the most proximal variable that was measured regarding feedback reception was the extent to which students used the feedback they received in their revisions.”
Peters, O., Körndle, H., & Narciss, S. (2018) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0344-y · Cited by 37 · see citing works
Fostering Revision of Argumentative Writing through Structured Peer Assessment
Tsai, Y.-C., & Chuang, M.-T. (2013) · Perceptual and Motor Skills · doi:10.2466/10.23.pms.116.1.210-221 · Cited by 36 · see citing works
Maximizing the benefits of peer interaction: Form-focused instruction and peer feedback training
Sippel, L. (2021) · Language Teaching Research · doi:10.1177/13621688211004638 · Cited by 36 · see citing works
The Power of Giving Feedback and Receiving Feedback in Peer Assessment.
Li, L., & Grion, V. (2019) · All Ireland Journal of Higher Education · doi:10.62707/aishej.v11i2.413 · Cited by 34 · cited 3× · see citing works
“Thus, receiving feedback involves both processing and implementing the feedback received, which may require different and more fine-grained types of instructional support than providing feedback (e.g., Li & Grion, 2019).”
Leenknecht, M. J. M., & Prins, F. J. (2017) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0340-2 · Cited by 30 · see citing works
Dmoshinskaia, N., Gijlers, H., & de Jong, T. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09884-y · Cited by 28 · see citing works
Zhao, Y., Zhang, F., Schunn, C. D., He, P., Li, D., & Zhao, Y. (2023) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2023.2278017 · Cited by 27 · cited 1× · see citing works
“…effects on peer-feedback processes and outcomes (e.g., Altstaedter, 2016; Bürgermeister et al., 2021; Gyamfi et al., 2024; Jurkowski, 2018; Zhao et al., 2023), it is still unclear whether their effects are comparable in size or whether some types of instructional support are more…”
Ertl, B., Kopp, B., & Mandl, H. (2007) · Springer eBooks · doi:10.1007/978-0-387-36949-5_13 · Cited by 26 · cited 3× · see citing works
“…overarching categories (see Online Resource 1) and coded whether the kinds of instructional support had a content-specific or a generic focus (Gwet’s AC1 = 0.79), based on a distinction that has been repeatedly proposed in instructional research (e.g., Belland et al., 2013; Ertl et al., 2007).”
InfluentialInvestigating the impact of peer feedback in foreign language writing
Altstaedter, L. L. (2016) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2015.1115052 · Cited by 26 · cited 2× · see citing works
“…found that show that all these different kinds of instructional support can have beneficial effects on peer-feedback processes and outcomes (e.g., Altstaedter, 2016; Bürgermeister et al., 2021; Gyamfi et al., 2024; Jurkowski, 2018; Zhao et al., 2023), it is still unclear whether their effects…”
Prilop, C. N., & Weber, K. E. (2023) · Teaching and Teacher Education · doi:10.1016/j.tate.2023.104099 · Cited by 26 · see citing works
Eye Tracking the Feedback Assigned to Undergraduate Students in a Digital Assessment Game
Cutumisu, M., Turgeon, K.-L., Saiyera, T., Chuong, S., Esparza, L. M. G., MacDonald, R., & Kokhan, V. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01931 · Cited by 23 · cited 1× · see citing works
“Thus, future studies should develop and use methods to better capture the feedback reception and the covert cognitive processes that occur during this phase (e.g., through think-aloud methods, Stegmann et al., 2012; or via eye-tracking, e.g., Cutumisu et al., 2019).”
Do question prompts support students in working with peer feedback?
Jurkowski, S. (2018) · International Journal of Educational Research · doi:10.1016/j.ijer.2018.07.003 · Cited by 20 · cited 4× · see citing works
“…is on the extent to which the feedback received has been implemented and the extent to which the initial task solution has improved as a result (e.g., essay scoring rubric; Altstaedter, 2016; integration of received feedback via comparison of initial and revised task solution; Jurkowski, 2018).”
Influential(2016) · Educational Technology & Society · Cited by 18 · see citing works
Hannafin, M. J., Land, S., & Oliver, K. M. (2013) · Routledge eBooks · doi:10.4324/9781410603784-8 · Cited by 13 · see citing works
USING GENERIC AND CONTEXT-SPECIFIC SCAFFOLDING TO SUPPORT AUTHENTIC SCIENCE INQUIRY
Belland, B. R., Gu, J., Armbrust, S., & Cook, B. (2013) · Cognition and Exploratory Learning in Digital Age · Cited by 12 · see citing works
Bouwer, R., van Braak, M., & van der Veen, C. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101965 · Cited by 12 · see citing works
Bouwer, R., & van der Veen, C. (2023) · Reading and Writing · doi:10.1007/s11145-023-10474-8 · Cited by 10 · see citing works
Gyamfi, G., Hanna, B. E., & Khosravi, H. (2024) · Educational Technology Research and Development · doi:10.1007/s11423-024-10346-0 · Cited by 9 · cited 1× · see citing works
“…of instructional support can have beneficial effects on peer-feedback processes and outcomes (e.g., Altstaedter, 2016; Bürgermeister et al., 2021; Gyamfi et al., 2024; Jurkowski, 2018; Zhao et al., 2023), it is still unclear whether their effects are comparable in size or whether some types of…”
Enhancing Argumentative Writing Via Online Peer Feedback-Based Essay: A Quasi-Experiment Study
Mulyati, Y., & Hadianto, D. (2023) · International Journal of Instruction · doi:10.29333/iji.2023.16212a · Cited by 7 · cited 1× · see citing works
“Subject-matter-related knowledge is typically measured in subsequent post-tests, after the peer-feedback process has been completed (e.g., domain-specific knowledge test; Mulyati & Hadianto, 2023).”
Zeeb, H., Bürgermeister, A., Saalbach, H., Renkl, A., & Glogger‐Frey, I. (2023) · Unterrichtswissenschaft · doi:10.1007/s42010-023-00184-z · Cited by 5 · see citing works
The Effects of Trained Peer Feedback for High School Students
Ho, P. V. P., Le, T. C., Phan, T. H., & Nguyen, N. H. V. (2021) · World Journal of English Language · doi:10.5430/wjel.v12n1p27 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Hein, K., & Prediger, S. (2017). Fostering and investigating university students’ pathways to formal reasoning: A design research project on structural scaffolding for 9th graders. In T. Dooley & G. Gueudet (Eds.), Proceedings of the Tenth Congress of the European Society for Research in Mathematics Education (CERME 10). Dublin, Ireland: DCU / ERME, (pp. 163–170).
Cited by
Sorted by citations
Ratinho, E., Figueiredo, M., Estêvão, D., Faísca, L., & Martins, C. (2026) · Educational Psychology Review · doi:10.1007/s10648-025-10108-1 · Cited by 11 · see citing works
“This approach follows methodological guidance for handling heteroge - neous pre–post reporting (Hornstein et al., 2025).”
Yan, D. “., Tian, F., Li, H., Gao, Y., & Li, J. (2025) · System · doi:10.1016/j.system.2025.103895 · Cited by 9 · see citing works
Language as Power in the Language Teacher Education Ecosystem
Kamali, J. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009733823 · Cited by 5 · see citing works
Formative Assessment and Educational Benefits
Vegliante, R. (2025) · Encyclopedia · doi:10.3390/encyclopedia5020068 · Cited by 5 · see citing works
“Studies have also indicated that these practices, supported by rubrics, can predict students’ self-regulation [40,41].”
Hornstein, J., Greisel, M., & Kollar, I. (2025) · Instructional Science · doi:10.1007/s11251-025-09745-4 · Cited by 5 · see citing works
“…learners and therefore also pre-service teachers need scaffolding on both how to provide high-quality feedback messages and how to integrate multiple feedback messages with each other to implement this feedback in their own task solutions (e.g., Gielen & De Wever, 2015; Hornstein et al., 2025).”
InfluentialSelf-citationOcampo, J. C. G., Panadero, E., Zamorano, D., & Sánchez‐Iglesias, I. (2025) · Assessing Writing · doi:10.1016/j.asw.2025.100987 · Cited by 1 · see citing works
Melhorando a qualidade dos feedbacks na avaliação por pares mediada por rubrica
Ferreira, F. C., & Alvés, I. P. (2025) · Revista de Gestão e Avaliação Educacional · doi:10.5902/2318133892978 · Cited by 1 · see citing works
Robust Pupil Detection Using Deep Learning Networks
Zhang, G., Zhang, Z., & Li, C. (2025) · International Conference on Image Processing, Computer Vision and Machine Learning (ICICML) · doi:10.1109/icicml67980.2025.11333782 · Cited by 1 · see citing works
“…of pupil boundaries and center coordinates is essential for a wide range of applications, including human-computer interaction [1], [2], driver monitoring systems [3], [4], virtual reality [5]–[7], iris recognition [8], [9], and studies in neuroscience and clinical diagnostics [10], [11].”
Alvarado-Mendoza, M., Gurrero-Jadan, M., Sandoval-Ortiz, F. D., & Contreras-Falcones, A. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1757812 · Cited by 2 · see citing works
Chen, S. C., Borchers, C., & Schunn, C. D. (2026) · Learning and Instruction · doi:10.1016/j.learninstruc.2026.102489 · Cited by 1 · see citing works
Keller, M. V., Daumiller, M. H., & Dresel, M. (2025) · Studies in Higher Education · doi:10.1080/03075079.2025.2555322 · Cited by 1 · see citing works
“Such support measures for receiving peer-feedback are sparse in current research (Hornstein et al. 2025).”
InfluentialSelf-citationEnhancing Peer Feedback Practices with Generative AI
Greisel, M., Hornstein, J., Kollar, I., Noroozi, O., Haddadian, G., Gao, X., Alqassab, M., Banihashem, K., Khosravi, H., Pozdniakov, S., et al. (2025) · Computer-supported collaborative learning/The Computer-Supported Collaborative Learning Conference · doi:10.22318/cscl2025.921873
Self-citationWei, S., & Wei, W. (2026) · Nursing Reports · doi:10.3390/nursrep16060182
“In addition, prior studies indicate that nursing students’ feedback behaviors vary across instructional contexts, and that behavioral pattern analysis can be used to evaluate instructional effectiveness and guide intervention design [41,42].”
Tong, Y., Schunn, C. D., Zhang, Y., & Zhang, X. (2026) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-026-09487-6
What have researchers examined? Capturing the conceptual diversity of peer feedback quality measures
Zhang, Y., & Schunn, C. D. (2026) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2026.101642
Hui, M. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1837762
Rethinking Learning with AI-Powered Personalized Virtual Agents and Human-AI Collaboration
Dai, C. (2026) · Springer international handbooks of education · doi:10.1007/978-3-032-04596-6_14-1
Peer feedback quality matters for post-feedback outcomes: A meta-analysis
Alemdağ, E., Lipnevich, A. A., Bardach, L., & Lindner, M. A. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100848
- Authors
- Hornstein, J., Keller, M. V., Greisel, M., Dresel, M., & Kollar, I.
- Affiliations
- University of Augsburg (DE)
- Corresponding author
- Hornstein, Julia
- Venue
- Educational Psychology Review
- Published
- 2025-04-21
- Volume
- 37
- Issue
- 2
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W4409649726
- Semantic Scholar
- 0dd895b733620b67370c5fb2a4f72b624a3d080b
- Cited by
- 18
- References
- 91
- Citations by year
- 2026: 10 · 2025: 8
- FWCI
- 6.45
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Educational Psychology Review (publishedVersion, cc-by)
- Funders
- Stifung Innovation in der Hochschullehre (FBM2020)
- Universität Augsburg
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- peer feedback, pedagogical support, feedback provision, feedback reception, feedback quality, content knowledge, peer learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review