Cited by 83Student Assessment and FeedbackInnovative Teaching and Learning MethodsEvaluation of Teaching Practices

Design, implementation, and evaluation of an online supported peer feedback module to enhance students’ argumentative essay quality

Open access
Noroozi, Omid, Banihashem, Seyyed Kazem, Biemans, Harm J. A., Smits, Mattijs, Vervoort, Mariëtte T.W., Verbaan, Caro-Lynn·2023·Education and Information Technologies

Abstract

We know little to what extent peer feedback strategies can be applied on a large scale in higher education for complex tasks. This study aimed to design, implement, and evaluate an online-supported peer feedback module for large-scale use to enhance higher education students’ argumentative essay writing performance. To do this, 330 students from five different courses at bachelor and master levels followed the online supported peer feedback module. In this module, students were asked to write an argumentative essay about a controversial issue, provide peer feedback for two peers, and revise their original essays based on the received feedback. Three types of data including original essay (pre-test) data, peer feedback data, and revised essay (post-test) data collected. Students also filled out the learning satisfaction questionnaire at the end of the module. The findings showed that the suggested online-supported peer feedback module was effective in improving students’ argumentative essay quality in all courses at the bachelor and master levels. The findings also showed there is a difference in the level of students’ satisfaction with the module among the courses and between the education levels. The findings of this study provide insights into and add value to the scalability of online peer feedback tools for argumentative essay writing in different contexts. Based on the findings, recommendations for future studies and educational practice are provided.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10639-023-11683-y

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 58

  1. Aghaee, N., & Keller, C. (2016). ICT-supported peer interaction among learners in bachelor’s and master’s thesis courses. Computers & Education, 94, 276–297. 10.1016/j.compedu.2015.11.006 · DOI
  2. Akbas Y Şahin İF Meral E Implementing argumentation-based science learning approach in social studies: academic achievement and students’ views Review of International Geographical Education Online 2019 9 1 209 245 10.33403/rigeo.529139 · DOI
  3. Alqassab M Strijbos JW Ufer S Training peer-feedback skills on geometric construction tasks: role of domain knowledge and peer-feedback levels European Journal of Psychology of Education 2018 33 1 11 30 10.1007/s10212-017-0342-0 · DOI · Paper page
  4. Andrews R Argumentation in higher education Improving practice through theory and research 2010 Routledge
  5. Awada, G. M., & Diab, N. M. (2021). Effect of online peer review versus face-to-face peer review on argumentative writing achievement of EFL learners. Computer Assisted Language Learning, 1–19. 10.1080/09588221.2021.1912104 · DOI
  6. Baker KM Peer review as a strategy for improving students’ writing process Active Learning in Higher Education 2016 17 3 179 192 10.1177/1469787416654794 · DOI
  7. Boud, D., & Dawson, P. (2021). What feedback literate teachers do: an empirically-derived competency framework. Assessment & Evaluation in Higher Education, 1–14. 10.1080/02602938.2021.1910928 · DOI
  8. Chuang PL Yan X An investigation of the relationship between argument structure and essay quality in assessed writing Journal of Second Language Writing 2022 56 100892 10.1016/j.jslw.2022.100892 · DOI
  9. Cohen J Statistical power analysis for the behavioural sciences 1988 2 Academic Press
  10. Er E Dimitriadis Y Gašević D Collaborative peer feedback and learning analytics: theory-oriented design for supporting class-wide interventions Assessment & Evaluation in Higher Education 2021 46 2 169 190 10.1080/02602938.2020.1764490 · DOI
  11. Ertmer PA Richardson JC Belland B Camin D Connolly P Coulthard G Mong C Using peer feedback to enhance the quality of student online postings: an exploratory study Journal of Computer-Mediated Communication 2007 12 2 412 433 10.1111/j.1083-6101.2007.00331.x · DOI
  12. Fan CY Chen GD A scaffolding tool to assist learners in argumentative writing Computer Assisted Language Learning 2021 34 1–2 159 183 10.1080/09588221.2019.1660685 · DOI
  13. Foo SY Analysing peer feedback in asynchronous online discussions: a case study Education and Information Technologies 2021 26 4 4553 4572 10.1007/s10639-021-10477-4 · DOI
  14. Foutz TL Collaborative argumentation as a learning strategy to improve student performance in engineering statics: a pilot study American Journal of Engineering Education (AJEE) 2018 9 1 11 22 10.19030/ajee.v9i1.10185 · DOI
  15. Iglesias Pérez MC Vidal-Puga J Pino Juste MR The role of self and peer assessment in higher education Studies in Higher Education 2022 47 3 683 692 10.1080/03075079.2020.1783526 · DOI
  16. Jin, X., Jiang, Q., Xiong, W., Feng, Y., & Zhao, W. (2022). Effects of student engagement in peer feedback on writing performance in higher education. Interactive Learning Environments, 1–16. 10.1080/10494820.2022.2081209 · DOI
  17. Jongsma, M. V., Scholten, D. J., Muijlwijk-Koezen, J. E. V., & Meeter, M. (2022). Online versus offline peer feedback in higher education: a meta-analysis. Journal of Educational Computing Research, 1–26. 10.1177/07356331221114181 · DOI
  18. Kerman, N. T., Noroozi, O., Banihashem, S. K., Karami, M., & Biemans, H. J. (2022). Online peer feedback patterns of success and failure in argumentative essay writing. Interactive Learning Environments, 1–13. 10.1080/10494820.2022.2093914 · DOI
  19. Kern VM Saraiva LM dos Pacheco SRC Peer review in education: promoting collaboration, written expression, critical thinking, and professional responsibility Education and Information Technologies 2003 8 1 37 46 10.1023/A:1023974224315 · DOI
  20. King A Structuring peer interaction to promote high-level cognitive processing Theory Into Practice 2002 41 1 33 39 10.1207/s15430421tip4101_6 · DOI · Paper page
  21. Ko, S., & Rossen, S. (2017). Teaching online: a practical guide. Routledge.
  22. Latifi S Noroozi O Hatami J Biemans HJ How does online peer feedback improve argumentative essay writing and learning? Innovations in Education and Teaching International 2021 58 2 195 206 10.1080/14703297.2019.1687005 · DOI
  23. Latifi S Noroozi O Talaee E Peer feedback or peer feedforward? Enhancing students’ argumentative peer learning processes and outcomes British Journal of Educational Technology 2021 52 2 768 784 10.1111/bjet.13054 · DOI · Paper page
  24. Lazarou D Sutherland R Erduran S Argumentation in science education as a systemic activity: an activity-theoretical perspective International Journal of Educational Research 2016 79 150 166 10.1016/j.ijer.2016.07.008 · DOI
  25. Liu NF Carless D Peer feedback: the learning element of peer assessment Teaching in Higher Education 2006 11 3 279 290 10.1080/13562510600680582 · DOI · Paper page
  26. Liunokas Y Assessing students’ ability in writing argumentative essay at an Indonesian senior high school. IDEAS: Journal on english language teaching and learning Linguistics and Literature 2020 8 1 184 196 10.24256/ideas.v8i1.1344 · DOI
  27. Lizzio A Wilson K Feedback on assessment: students’ perceptions of quality and effectiveness Assessment & Evaluation in Higher Education 2008 33 3 263 275 10.1080/02602930701292548 · DOI
  28. Mahdizadeh, H. (2008). Student collaboration and learning. Knowledge construction and participation in an asynchronous computer-supported collaborative learning environment in higher education. PhD dissertation, Wageningen University, The Netherlands. https://library.wur.nl/WebQuery/wurpubs/357306
  29. Mayweg-Paus E Zimmermann M Le NT Pinkwart N A review of technologies for collaborative online information seeking: on the contribution of collaborative argumentation Education and Information Technologies 2021 26 2 2053 2089 10.1007/s10639-020-10345-7 33013181 PMC7525077 · DOI
  30. Mercader C Ion G Díaz-Vicario A Factors influencing students’ peer feedback uptake: instructional design matters Assessment & Evaluation in Higher Education 2020 45 8 1169 1180 10.1080/02602938.2020.1726283 · DOI
  31. Nilson LB Improving student peer feedback College Teaching 2003 51 1 34 38 10.1080/87567550309596408 · DOI · Paper page
  32. Noroozi, O. (2022). The role of students’ epistemic beliefs for their argumentation performance in higher education. Innovations in Education and Teaching International, 1–12. 10.1080/14703297.2022.2092188 · DOI
  33. Noroozi, O., Banihashem, S. K., & Biemans, H. J. (2022). Online supported peer feedback tool for argumentative essay writing: does course domain knowledge matter?. In 15th International Conference on Computer-Supported Collaborative Learning 2022 (pp. 356–358). International Society of the Learning Sciences.
  34. Noroozi, O., Banihashem, S. K., Taghizadeh Kerman, N., Parvaneh Akhteh Khaneh, M., Babayi, M., Ashrafi, H., & Biemans, H. J. (2022). Gender differences in students’ argumentative essay writing, peer review performance and uptake in online learning environments. Interactive Learning Environments, 1–15. 10.1080/10494820.2022.2034887 · DOI · Paper page
  35. Noroozi O Kirschner PA Biemans HJ Mulder M Promoting argumentation competence: extending from first-to second-order scaffolding through adaptive fading Educational Psychology Review 2018 30 1 153 176 10.1007/s10648-017-9400-z · DOI
  36. Noroozi, O., Weinberger, A., Biemans, H. J., Mulder, M., & Chizari, M. (2012). Argumentation-based computer supported collaborative learning (ABCSCL): A synthesis of 15 years of research. Educational Research Review, 7(2), 79–106. 10.1016/j.edurev.2011.11.006 · DOI · Paper page
  37. Nussbaum EM Edwards OV Critical questions and argument stratagems: a framework for enhancing and analyzing students’ reasoning practices Journal of the Learning Sciences 2011 20 3 443 488 10.1080/10508406.2011.564567 · DOI
  38. Ogan-Bekiroglu F Eskin H Examination of the relationship between engagement in scientific argumentation and conceptual knowledge International Journal of Science and Mathematics Education 2012 10 6 1415 1443 10.1007/s10763-012-9346-z · DOI
  39. Salakhova VB Bazhdanova YV Dugarova TT Morozova NS Simonova MM The crisis of education in conditions of the covid-19 pandemic: the model of blended learning Systematic Reviews in Pharmacy 2020 11 12 1411 1416 10.31838/srp.2020.12.210 · DOI
  40. Shang HF An exploration of asynchronous and synchronous feedback modes in EFL writing Journal of Computing in Higher Education 2017 29 3 496 513 10.1007/s12528-017-9154-0 · DOI
  41. Shi M The effects of class size and instructional technology on student learning performance The International Journal of Management Education 2019 17 1 130 138 10.1016/j.ijme.2019.01.004 · DOI · Paper page
  42. Topping K Peer assessment between students in colleges and universities Review of Educational Research 1998 68 3 249 276 10.3102/00346543068003249 · DOI · Paper page
  43. Topping KJ Smith EF Swanson, I Elliot A Formative peer assessment of academic writing between postgraduate students Assessment & Evaluation in Higher Education 2000 25 2 149 169 10.1080/713611428 · DOI
  44. Toulmin S The uses of argument 1958 Cambridge University Press
  45. Tsemach E Zohar A The intersection of gender and culture in argumentative writing International Journal of Science Education 2021 43 6 969 990 10.1080/09500693.2021.1894499 · DOI
  46. Valero Haro A Noroozi O Biemans HJ Mulder M The effects of an online learning environment with worked examples and peer feedback on students’ argumentative essay writing and domain-specific knowledge acquisition in the field of biotechnology Journal of Biological Education 2019 53 4 390 398 10.1080/00219266.2018.1472132 · DOI · Paper page
  47. Valero Haro A Noroozi O Biemans H Mulder M Argumentation competence: students’ argumentation knowledge, behavior and attitude and their relationships with domain-specific knowledge acquisition Journal of Constructivist Psychology 2022 35 1 123 145 10.1080/10720537.2020.1734995 · DOI
  48. Van Seters JR Ossevoort MA Tramper J Goedhart MJ The influence of student characteristics on the use of adaptive e-learning material Computers & Education 2012 58 3 942 952 10.1016/j.compedu.2011.11.002 · DOI
  49. van Zundert MJ Sluijsmans DM Könings KD van Merriënboer JJ The differential effects of task complexity on domain-specific and peer assessment skills Educational Psychology 2012 32 1 127 145 10.1080/01443410.2011.626122 · DOI
  50. Veerman AL Andriessen JE Kanselaar G Learning through synchronous electronic discussion Computers & Education 2000 34 3–4 269 290 10.1016/S0360-1315(99)00050-0 · DOI
  51. Wingate U ‘Argument!’ Helping students understand what essay writing is about Journal of English for academic purposes 2012 11 2 145 154 10.1016/j.jeap.2011.11.001 · DOI
  52. Wood J Making peer feedback work: the contribution of technology-mediated dialogic peer feedback to feedback uptake and literacy Assessment & Evaluation in Higher Education 2022 47 3 327 346 10.1080/02602938.2021.1914544 · DOI
  53. Wu Y Schunn CD When peers agree, do students listen? The central role of feedback quality and feedback frequency in determining uptake of feedback Contemporary Educational Psychology 2020 62 101897 10.1016/j.cedpsych.2020.101897 · DOI
  54. Xiong Y Schunn CD Reviewer, essay, and reviewing-process characteristics that predict errors in web-based peer review Computers & Education 2021 166 104146 10.1016/j.compedu.2021.104146 · DOI
  55. Yu S Zhang Y Zheng Y Yuan K Zhang L Understanding student engagement with peer feedback on master’s theses: a Macau study Assessment & Evaluation in Higher Education 2019 44 1 50 65 10.1080/02602938.2018.1467879 · DOI
  56. Zhang, R., & Zou, D. (2022). A review of research on technology-enhanced peer feedback for second language writing based on the activity theory framework. Education and Information Technologies, 1–27. 10.1007/s10639-022-11469-8 · DOI · Paper page
  57. Zhao H Investigating teacher-supported peer assessment for EFL writing ELT journal 2014 68 2 155 168 10.1093/elt/cct068 · DOI · Paper page
  58. Zhao H New insights into the process of peer review for EFL writing: a process-oriented socio-cultural perspective Learning and Instruction 2018 58 263 273 10.1016/j.learninstruc.2018.07.010 · DOI

Cited by

Sorted by citations

Authors
Noroozi, O., Banihashem, S. K., Biemans, H. J. A., Smits, M., Vervoort, M. T. W., & Verbaan, C.-L.
Affiliations
  • Wageningen University & Research (NL)
  • Open University of the Netherlands (NL)
Corresponding author
Banihashem, Seyyed Kazem
Venue
Education and Information Technologies
Published
2023-03-15
Volume
28
Issue
10
Pages
12757-12784
ISSN
  • 1360-2357 (ISSN-L)
  • 1573-7608
OpenAlex
W4324381756
Cited by
83
References
19
Citations by year
2026: 17 · 2025: 29 · 2024: 23 · 2023: 13 · 2013: 1
FWCI
60.66
Type
journal article
Language
en
Open access
Locations
  • Education and Information Technologies (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Socio-Environmental Systems Modeling (submittedVersion, cc-by)
  • DSpace (Open University in the Netherlands) (submittedVersion, cc-by)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
  • Social Sciences › Education › Evaluation of Teaching Practices
Keywords
peer feedback, argumentative essay writing, essay quality, scalability, university students, writing revision, student satisfaction, controversial issues

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review