The nature of feedback: How peer feedback features affect students’ implementation rate and quality of revisions.
The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
Although feedback is often seen as a critical component of the learning process, many open questions about how specific feedback features contribute to the effectiveness of feedback remain—especially in regards to peer feedback of writing. Nelson and Schunn (2009) identified several important features of peer feedback in their nature of feedback model. In the current study, we test an updated theoretical model that includes a broader set of features and considers not only students’ likelihood of implementing a comment but also the quality of their revisions. To empirically test the updated theoretical model, we analyze over 7,500 comments from 351 reviewers to 189 authors. Each comment was coded for the presence of praise, a problem description, a suggested solution, localization, focus (i.e., low prose, high prose, substance), implementation, and revision quality. To account for the cross-classified nesting of data, we used a 2-level, cross-classified, hierarchical logistic regression model. Only 2 feedback features increased students’ likelihood of implementation (i.e., overall praise and localization), while several feedback features reduced students’ likelihood of implementation (i.e., mitigating praise, solutions, and high-prose comments). Overlapping feedback features affected students’ ability to revise and in opposing directions from their effect on likelihood of implementation: Revisions were less likely to improve the quality of their paper when implementing comments that included a specific location in the text, but they were more likely to improve the quality of their paper when implementing comments that focused on high-prose and substance issues. Implications of these findings are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“a study by Patchan etal. (2016) found that the quality of feedback, including its specificity, clarity, and detail was a significant predictor of students' writing improvement in online peer feedback activities.”
From Online peer feedback in higher education: A synthesis of the literature (2024) · cites this paper as Patchan et al., 2016
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
The ICAP framework: Linking cognitive engagement to active learning outcomes
Chi, M. T. H., & Wylie, R. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.965823 · Cited by 2,911
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Contextual prerequisites for understanding: Some investigations of comprehension and recall
Bransford, J. D., & Johnson, M. K. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80006-9 · Cited by 2,131
Consequences of individual feedback on behavior in organizations.
Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.4.349 · Cited by 1,822
Self‐Explanations: How Students Study and Use Examples in Learning to Solve Problems
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_1 · Cited by 1,714
The instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313
Paas, F., Renkl, A., & Sweller, J. (2004) · Instructional Science · doi:10.1023/b:truc.0000021806.17516.d0 · Cited by 1,054
Cited by
Items 101–165 of 165
The role of platform design in online peer feedback: a comparison of two digital environments
Jongsma, M. V., Meeter, M., van Muijlwijk‐Koezen, J. E., & Scholten, D. J. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13598-2 · Cited by 5
“…as affective comments, solutions, or suggestions (Kerman et al., 2024b; Liu & Sadler, 2003; Patchan et al., 2016), the length of the feedback (Zong et al., 2021 ), the accuracy of the feedback (He & Gao, 2023; Mehrpour et al., 2023), or the uptake of the feedback provided (Patchan et al., 2016).”
InfluentialLi, C., Chen, Y., Zhou, S., Shi, J., Yang, S., & Li, M. (2024) · Sustainability · doi:10.3390/su16229657 · Cited by 4
Ocampo, J. C. G., Panadero, E., Sánchez‐Iglesias, I., & Díez, F. (2025) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2025.101455 · Cited by 4
Chen, W., Lyu, Q., Su, J., Chai, A. S. C., Zhang, W., Su, G., & Li, X. (2023) · Proceedings. · doi:10.22318/icls2023.747522 · Cited by 6
Lin, Y., Zhang, Y., Yang, Y., Lu, Y., Zhou, P., & Wang, Y. (2024) · Journal of Computing in Higher Education · doi:10.1007/s12528-023-09374-1 · Cited by 3
“…as indicated by constructivist theory, effective learning and knowledge construction can occur when students construct assignments that are visible to others (Liu et al., 2016) because this enables students to reflect on their learning by observing others’ assignments (Patchan et al., 2016).”
Zamorano, D., Panadero, E., Alqassab, M., & Amillano, A. (2025) · The Journal of Experimental Education · doi:10.1080/00220973.2025.2466146 · Cited by 4
“Therefore, study feedback implementation as an outcome is relevant for evaluating the success of the peer feedback activity (Patchan et al., 2016).”
Song, M. H., Lim, J., Kim, H., & Park, J. (2025) · Teaching of Psychology · doi:10.1177/00986283251377657 · Cited by 3
“This can be addressed by providing feedback that highlights the signi fi cance of revision and identi fi es problems that students may not have noticed themselves (Berggren, 2015; Patchan et al., 2016).”
A Review of Empirical Studies on Peerceptiv
Wu, Y., & Schunn, C. D. (2022) · International Conference on Information Technology Based Higher Education and Training (ITHET) · doi:10.1109/ithet56107.2022.10031747 · Cited by 3
“Patchan et al. [19] used more advanced statistical techniques to analyze 7,500 comments given by undergraduates in an Introduction to Psychological Science course in the United States.”
BackgroundSelf-citationPotencialidades da metodologia ativa revisão por pares na formação inicial docente
Camillo, C. M., & Sepel, L. M. N. (2022) · Amazônia Revista de Educação em Ciências e Matemáticas · doi:10.18542/amazrecm.v18i41.13550 · Cited by 2
Unveiling Genre Analysis and Genre-based Instruction in EAP
Yaylı, D. (2024) · Springer eBooks · doi:10.1007/978-3-031-72545-6_10 · Cited by 4
An Integrative Research Review on Chinese Integrated Writing Assessment Over Two Decades
Zhu, X., Li, J. X., Yao, Y., Xu, W., Zhu, S., Pang, W., & Sun, Y. (2025) · ECNU Review of Education · doi:10.1177/20965311251351987 · Cited by 3
“Excessive feedback added an extra burden on students ’ cognition and memory resources, which in turn caused undesirable effects on writing performance (Patchan et al., 2016).”
Hornstein, J., Greisel, M., & Kollar, I. (2025) · Instructional Science · doi:10.1007/s11251-025-09745-4 · Cited by 7
“We coded feedback quality by aid of a category system with ten dimen - sions we derived from the literature (e.g., Hattie & Timperley, 2007; Langer et al., 2019; Nelson & Schunn, 2008; Patchan et al., 2016 ; Yu & Schunn, 2023 ).”
Investigating the Relation Between Peer Critiquing and Model Revisions in Modeling‐Based Learning
Chang, H. (2025) · Science Education · doi:10.1002/sce.70026 · Cited by 2
Lu, X., Ju, K. P., Dudley, M., Sano, L., & Wang, X. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791121 · Cited by 7
“In this work, we categorize feed-back by type following [90], and evaluate feedback quality using a set of dimensions synthesized from prior feedback-quality literature and the INSPIRE tutoring model.”
InfluentialDrennan, L. (2022) · Journal for Language Teaching · doi:10.56285/jltvol56iss2a5293 · Cited by 5
Rater behaviors in peer evaluation: Patterns and early detection with learner model
Liang, C., Horikoshi, I., Majumdar, R., & Ogata, H. (2024) · Research and Practice in Technology Enhanced Learning · doi:10.58459/rptel.2025.20012 · Cited by 3
“Cho and Schunn (2007) considered consistency with others to model reviewers’ capabilities, while Patchan et al. (2016) extracted features from review texts, such as sentimental tendencies and comment types, using semantic analysis to build a regression model.”
BackgroundRasenberg, E. M. C., Brand, G. M., Thoonen, B. P. A., & Thoonen, B. P. A. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07405-2 · Cited by 2
“This is also described by Patchan et al. (2016) who indicated several strategies students deploy to mitigate their critical feedback.”
Zhao, Y. E., Zhang, F., & Schunn, C. D. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2512416 · Cited by 2
“…such as the use of well-structured rubrics, making feedback anonymous for honest feed-back, assigning grades for quality of feedback provided, and using multiple peer feedback (Panadero, Romero, and Strijbos 2013; Patchan, Schunn, and Correnti 2016; Lin 2018; Zou et al. 2018; Shui ng and Yu 2023).”
Self-citationThe impact of peer feedback features on feedback receivers' implementation in university classrooms
Lyu, Q., Chen, W., & Heng, K. H. J. G. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2514097 · Cited by 3
“In the scope dimension, this study finds that it positively impacts the implementation of peer feedback among the participants resonating with studies by Nelson and Schunn (2009) and Patchan et al. (2016).”
InfluentialMarion, C., Laferrière, T., & Tremblay-Gagnon, D. (2022) · Revue internationale du CRIRES innover dans la tradition de Vygotsky · doi:10.51657/ric.v6i1.51446 · Cited by 9
van Daal, T., Snajder, M., Nijs, K., & Dyck, H. V. (2023) · Social interaction in learning and development · doi:10.1007/978-3-031-29411-2_4 · Cited by 6
Son, M., & Ha, M. (2024) · SAGE Open · doi:10.1177/21582440241256538 · Cited by 4
“The positive effects of peer assessment on academic achievement have been documented in several studies (Boud & Molloy, 2013; Patchan et al., 2016; Topping, 2017; Topping, 2003).”
Ntumi, S. (2025) · Research Square · doi:10.21203/rs.3.rs-6794493/v1 · Cited by 2
Unfolding the Network of Peer Grades: A Latent Variable Approach
Mignemi, G., Chen, Y., & Moustaki, I. (2025) · Psychometrika · doi:10.1017/psy.2025.10021 · Cited by 3
“The assessments had a similar format, and the online peer reviewing system managed the submission and peer grading procedures SWoRD/Peerceptiv (Patchan et al., 2016).”
Lyu, Q., Chen, W., Gerard), K. H. H. (., & Su, J. (2025) · Higher Education Research & Development · doi:10.1080/07294360.2025.2505136 · Cited by 1
“Rooted in socio-constructivist theory, peer feedback enables students to bridge the gap between their current and desired performance through peer discussions, logical reasoning, and deep reflection (Nicol et al., 2013; Patchan et al., 2016).”
Yan, D. “., & Gao, Y. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2569352 · Cited by 1
Ocampo, J. C. G., Panadero, E., Zamorano, D., & Sánchez‐Iglesias, I. (2025) · Assessing Writing · doi:10.1016/j.asw.2025.100987 · Cited by 1
A Zero-Shot Prompting Approach for Automated Feedback Generation on ENEM Essays
Anchiêta, R. T., Luz, A. I. M., Lopes, S. L. C., & Moura, R. S. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.15377 · Cited by 1
“Furthermore, guiding students on areas for improvement and how to enhance their writing skills is essential to the learning process of essay writing [23].”
Academic ability generates better quality feedback: Evidence from PeerWise assessments
Huang, W., Stephens, J. M., & Brown, G. (2026) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2026.101566 · Cited by 1
Black, R. E., & Schafer, A. E. (2026) · Journal of Chemical Education · doi:10.1021/acs.jchemed.6c00269 · Cited by 1
Gao, X., Schunn, C. D., Noroozi, O., Gulikers, J. T. M., Biemans, H. J. A., & Banihashem, S. K. (2026) · Learning and Instruction · doi:10.1016/j.learninstruc.2026.102428 · Cited by 1
Self-citationPublic Peer Review Motivates Higher Quality Feedback
Wang, X., Chen, Y., GODLEY, A. J., & Rosé, C. P. (2018) · International Society of the Learning Sciences, Inc. [ISLS]. eBooks · doi:10.22318/cscl2018.296 · Cited by 1
Attitudinal Evaluation in Written Peer Feedback: An Appraisal Study
Liu, X., & Jiang, X. (2023) · Literacy studies · doi:10.1007/978-3-031-36472-3_20 · Cited by 1
Implementing a Peer Feedback Intervention within a Community of Practice Framework
Gilken, J., & Johnson, H. L. (2019) · Community College Journal of Research and Practice · doi:10.1080/10668926.2019.1655502 · Cited by 1
Yan, E. (2023) · Multilingual education yearbook · doi:10.1007/978-3-031-32811-4_6 · Cited by 1
Harney, O. (2018) · Arrow@dit (Dublin Institute of Technology) · doi:10.13025/17913
Practice and Efficacy of Peer Writing Feedback in a Large First-Year Engineering Course
Ekoniak, & Roman, M. R. (2018) · VTechWorks (Virginia Tech)
Research on the types and adoption of peer feedback integrated with interdisciplinary collaboration
Kuang, S., Xu, Z., Gui, J., & Deng, J. (2021) · International Symposium on Educational Technology · doi:10.1109/iset52350.2021.00014
The Development of Student Writing Feedback Attitudes in Grades 3–7: A Latent Growth Analysis
Ekholm, E. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1432288
Chen, J. (2022) · International Journal of English Language Studies · doi:10.32996/ijels.2022.4.4.4
“This paper argues that MPEs, regarded as relation-oriented strategies, are an essential component of the potential mediator between feedback and adoption (cf. Nelson & Schunn, 2009; Patchan et al., 2016).”
BackgroundJames, E. M. (2022) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-james-eileen-2022
Chen, X. (2023) · Frontiers in Humanities and Social Sciences · doi:10.54691/fhss.v3i6.5148 · Cited by 1
How to Use Theory to Implement Natural Language Processing for Peer-Feedback
Greisel, M., Bauer, E., Kuznetsov, I., Berndt, M., Dresel, M., Fischer, M. R., Kollar, I., & Fischer, F. (2023) · Computer-supported collaborative learning/The Computer-Supported Collaborative Learning Conference · doi:10.22318/cscl2023.108887 · Cited by 1
Anna, R.-A., Mondéjar-Pont, M., Vaqué-Crusellas, C., Goutan‐Roura, E., Montserrat, S. M., Castro-Prat, R., María, N.-M. E., & Desirée, V.-G. (2024) · Research Square · doi:10.21203/rs.3.rs-4327307/v1
Henry, D. S., Sell, J., & Malenke, L. B. (2024) · New Directions for Teaching and Learning · doi:10.1002/tl.20599
Ploeger, N. A., & Strong, J. (2024) · Business and Professional Communication Quarterly · doi:10.1177/23294906241278917
“…the feedback narrative, including but not limited to elaborations (solutions offered by the assessor as suggestive comments that guide the assessee toward improvement; Patchan et al., 2016; Rotsaert et al., 2018) and verifications (judgments about the correctness of the work; Hattie & Gan, 2011).”
Enhancing Academic Feedback Systems with Deep Learning and Ensemble Methods
Sharma, H., & Joshi, H. (2025) · International Conference on Advances in Computer Science, Electrical, Electronics, and Communication Technologies (CE2CT) · doi:10.1109/ce2ct64011.2025.10939665
“However, its overall effect may be either beneficial or detrimental, contingent upon its quality and promptness [5] [6].”
An inductive approach to developing students’ awareness of useful written peer feedback
Lorenzen, H., Jacobsen, D., & Ellegaard, M. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2501685
“This aligns with Patchan, Schunn, and Correnti (2016), who found that the motivational aspect praise can increase the likelihood of the receiver utilizing peer feedback, but also noted that praise used to soften critique, negatively impacts feedback implementation.”
Peer Assessment Analysis via the Many-Facet Rasch Model
Ayçiçek, B. (2025) · Mersin Üniversitesi Eğitim Fakültesi Dergisi · doi:10.17860/mersinefd.1642676 · Cited by 2
Enhancing MarkEd with Peer Feedback Functionality with LLM Support
Maillo, T., Alexandru, C., & Constantin, A. (2025) · Conference on United Kingdom & Ireland Computing Education Research (UKICER) · doi:10.1145/3754508.3754511
Urbanek, M. T., Vinton, D., & Moon, A. C. (2025) · Chemistry Education Research and Practice · doi:10.1039/d5rp00118h
Kollar, I., & Fischer, F. (2025) · Springer eBooks · doi:10.1007/978-3-662-69557-9_20
Zink, T., Hahnel, C., Kroehne, U., Deribo, T., Artelt, C., Goldhammer, F., Naumann, J., & Schoor, C. (2025) · European Journal of Psychology of Education · doi:10.1007/s10212-025-01033-6 · Cited by 1
“Patchan et al. (2016) investigated written peer feedback in writing tasks, where students provided comments on their peers’ essays.”
Shulgina, G., Адамович, К., Zhang, H., Fanguy, M., Baldwin, M., & Costley, J. (2025) · Active Learning in Higher Education · doi:10.1177/14697874251389104
Cover Letters as a Tool to Elicit Peer Feedback Within Doctoral Writing Groups
Yallop, R., Leijen, D. A. J., & Lang, S. M. (2025) · The Journal of Writing Analytics · doi:10.37514/jwa-j.2025.8.1.02
The influence of online peer review on EFL learners’ cohesion and coherence in narrative writing
Li, J., Guan, Y., Pack, A., Jia, W., Xia, W., & Wang, B. (2026) · Journal of China Computer-Assisted Language Learning · doi:10.1515/jccall-2025-0028
“…platform-generated peer-reviewing grades correlate highly with how an expert would assess those same artifacts, which turn out to help learners make revisions (Patchan et al. 2016), and improve reviewing skills (Cho and MacArthur 2010) and writing quality (Cho and Schunn 2007; Patchan et al. 2016).”
Zhang, D., Hong, X., & Qi, Y. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101121 · Cited by 5
Investigating students’ engagement with GenAI-supported peer feedback generation in EFL writing
Guo, K., Li, D., Pan, M., & Lai, C. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2679729 · Cited by 1
The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness
Niousha, R., Smith, S. F., Akram, B., Brusilovsky, P. L., Hellas, A., Leinonen, J., DeNero, J., & Norouzi, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29755-6_26 · Cited by 2
Yang, J., & Schunn, C. D. (2026) · Instructional Science · doi:10.1007/s11251-026-09813-3
“In general, when peer comments are featured with complex content-focused elements, receivers are more likely to make macro revisions (Cho & MacArthur, 2011; Patchan et al., 2016; Tuzi, 2004; Wu & Schunn, 2023 ).”
Self-citationWhat have researchers examined? Capturing the conceptual diversity of peer feedback quality measures
Zhang, Y., & Schunn, C. D. (2026) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2026.101642
Self-citationAccept, elaborate, modify, or no uptake?: Which peer feedback features matter?
Gao, X., Schunn, C. D., Gulikers, J. T. M., Banihashem, S. K., Biemans, H. J. A., & Noroozi, O. (2026) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2026.102491
Self-citationPeer feedback quality matters for post-feedback outcomes: A meta-analysis
Alemdağ, E., Lipnevich, A. A., Bardach, L., & Lindner, M. A. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100848
Lu, G., Zhang, H., Ba, S., & Yang, L. (2026) · Journal of Educational Computing Research · doi:10.1177/07356331261494805
Metadata
- Authors
- Patchan, M. M., Schunn, C. D., & Correnti, R. J.
- Venue
- Journal of Educational Psychology
- Published
- 2016-11
- Volume
- 108
- Issue
- 8
- Pages
- 1098-1120
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2328994266
- Semantic Scholar
- d9cc62a10825881c75c2c7a4b5491b9a2f81bdf1
- Cited by
- 165
- References
- 77
- Citations by year
- 2026: 14 · 2025: 35 · 2024: 23 · 2023: 32 · 2022: 17 · 2021: 7 · 2020: 10 · 2019: 10 · 2018: 12 · 2017: 4
- FWCI
- 38.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Psychology (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- peer feedback, writing revision, praise, localization, problem description, student writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.