The role of peer-assisted learning in building evaluative judgement: opportunities in clinical medical education
Open accessThe DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
This study explored the contribution of peer-assisted learning (PAL) in the development of evaluative judgement capacity; the ability to understand work quality and apply those standards to appraising performance. The study employed a mixed methods approach, collecting self-reported survey data, observations of, and reflective interviews with, the medical students observed. Participants were in their first year of clinical placements. Data were thematically analysed. Students indicated that PAL contributed to both the comprehension of notions of quality, and the practice of making comparisons between a given performance and the standards. Emergent themes included peer story-telling, direct observation of performance, and peer-based feedback, all of which helped students to define 'work quality'. By participating in PAL, students were required to make comparisons, therefore using the standards of practice and gaining a deeper understanding of them. The data revealed tensions in that peers were seen as less threatening than supervisors with the advantage of increasing learners' appetites for thoughtful 'intellectual risk taking'. Despite this reported advantage of peer engagement, learners still expressed a preference for feedback from senior teachers as more trusted sources of clinical knowledge. While this study suggests that PAL already contributes to the development of evaluative judgement, further steps could be taken to formalise PAL in clinical placements to improve learners' capacity to make accurate judgements on the performance of self and others. Further experimental studies are necessary to confirm the best methods of using PAL to develop evaluative judgement. This may include both students and educators as instigators of PAL in the workplace.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, although there have been some theoretical arguments about its importance (e.g. Sadler 2010), evaluative judgement has not been the focus of sustained attention and very little empirical work exists on the effectiveness of strategies for developing students ' evaluative judgement (Nicol 2014; Tai et al. 2016).”
From Developing evaluative judgement: enabling students to make decisions about the quality of work (2018) · cites this paper as Tai et al. 2016
In the citing paper
“In alignment with Tai et al. (2016), there are two components integral to evaluative judgement which operate as complements to each other: firstly, understanding what constitutes quality and, secondly, applying this understanding through an appraisal of work, whether it be one ' s own, or another ' s.”
From Developing evaluative judgement: enabling students to make decisions about the quality of work (2018) · cites this paper as Tai et al. 2016
In the citing paper
“Secondly, Tai et al. (2016) also explored the role of informal peer learning in producing accurate evaluative judgements, which impacted on students ' capacity to engage in feedback conversations, through a better understanding of standards.”
From Developing evaluative judgement: enabling students to make decisions about the quality of work (2018) · cites this paper as Tai et al. 2016
In the citing paper
“By engaging more closely with criteria and standards, and having to compare work to these, students have reported a better understanding of quality work (McConlogue 2012; Tai et al. 2016).”
From Developing evaluative judgement: enabling students to make decisions about the quality of work (2018) · cites this paper as Tai et al. 2016
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
(2008) · Biostatistics and Microbiology: A Survival Manual · doi:10.1007/978-0-387-77282-0_6 · Cited by 17,371
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731 · cited 3×
“The self-assessment literature has also placed importance on external information (and seeking external information) in order to make judgements on one’s own performance (Eva and Regehr 2005), as internal evaluation alone is inaccurate due to flaws in reasoning, especially at the extremes of ability (Kruger and Dunnin…”
Apprenticeship in thinking: cognitive development in social context
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0612 · Cited by 5,464
Apprenticeship in Thinking: Cognitive Development in Social Context
Rogoff, B. (1990) · doi:10.1093/oso/9780195059731.001.0001 · Cited by 4,709
Formative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285 · cited 1×
“For effective learning, the learner also requires the ability to develop strategies to close the gap between observed and ideal performance (Sadler 1989).”
Background(2014) · Research Methods and Statistics for Public and Nonprofit Administrators: A Practical Guide · doi:10.4135/9781544307763.n14 · Cited by 1,675
Sustainable Assessment: Rethinking assessment for the learning society
Boud, D. (2000) · Studies in Continuing Education · doi:10.1080/713695728 · Cited by 1,545
Self-Assessment in the Health Professions: A Reformulation and Research Agenda
Eva, K. W., & Regehr, G. (2005) · Academic Medicine · doi:10.1097/00001888-200510001-00015 · Cited by 992
Rethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966 · cited 3×
“Despite the use of the term ‘evaluative judgement’ in higher and professional education, a definition has not yet been forthcoming (Boud and Molloy 2013; Cowan 2010; Nicol et al. 2014).”
BackgroundMethodAdvances in Medical Education and Practice
(2020) · Advances in Medical Education and Practice · doi:10.2147/amep · Cited by 554
(1998) · Routledge eBooks · doi:10.4324/9781410603678 · Cited by 503
“I'll never play professional football” and other fallacies of self-assessment
Eva, K. W., & Regehr, G. (2008) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.150 · Cited by 453
Medical students-as-teachers: a systematic review of peer-assisted teaching during medical school
Hill, A., Yu, Wilson, Hawken, Singh, & Lemanu (2011) · Advances in Medical Education and Practice · doi:10.2147/amep.s14383 · Cited by 383
Medical students as peer tutors: a systematic review
Burgess, A., McGregor, D., & Mellis, C. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-115 · Cited by 363 · cited 1×
“that PAL can produce gains in students’ clinical knowledge and skill (Burgess et al. 2014; Yu et al. 2011), there is little evidence, or conversation in fact, about the role of PAL in supporting learners’ capacity to make judgements about quality of work (Speyer et al.”
BackgroundThe processes and dimensions of informed self-assessment: A conceptual model.
Sargeant, J., Armson, H., Chesluk, B., Dornan, T., Eva, K., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & van der Vleuten, C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d85a4e · Cited by 318
Reflection: a link between receiving and using assessment feedback
Sargeant, J. M., Mann, K. V., van der Vleuten, C. P., & Metsemakers, J. F. (2009) · Advances in Health Sciences Education · doi:10.1007/s10459-008-9124-4 · Cited by 296
Multisource feedback in the assessment of physician competencies
Lockyer, J. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230103 · Cited by 282 · cited 1×
“Educators could refer students to the multisource feedback literature (Lockyer 2003; Sharma et al. 2012) indicating that sources at different levels of expertise often comment on different aspects of performance (they identify different points for improvement when observing the same performance) and this also helps to…”
BackgroundKnobe, M., Münker, R., Sellei, R. M., Holschen, M., Mooij, S. C., Schmidt‐Rohlfing, B., Niethard, F., & Pape, H. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03557.x · Cited by 243 · cited 1×
“Trained student tutors have also been shown to be as effective as faculty tutors in ultrasound technique teaching (Knobe et al. 2010) and clinical examination (Burke et al.”
BackgroundReciprocal peer teaching: Students teaching students in the gross anatomy laboratory
Krych, A. J., March, C. N., Bryan, R. E., Peake, B. J., Pawlina, W., & Carmichael, S. W. (2005) · Clinical Anatomy · doi:10.1002/ca.20090 · Cited by 238 · cited 1×
“This has been relatively successful in knowledge-based areas such as anatomy teaching (Krych et al. 2005; Nnodim 1997).”
Not knowing that they do not know: self‐assessment accuracy of third‐year medical students
Langendyk, V. (2006) · Medical Education · doi:10.1111/j.1365-2929.2005.02372.x · Cited by 184
An analysis of peer, self, and tutor assessment in problem-based learning tutorials
Papinczak, T., Young, L., Groves, M., & Haynes, M. (2007) · Medical Teacher · doi:10.1080/01421590701294323 · Cited by 175
Peer Assessment in Problem-Based Learning: A Qualitative Study
Papinczak, T., Young, L., & Groves, M. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-005-5046-6 · Cited by 164 · cited 2×
“Students are also reluctant to undertake PAL in terms of giving each other feedback, as they do not wish to cause social rifts, and prefer to take a supportive role (Levine et al. 2007; Papinczak et al. 2007).”
BackgroundVicarious learning during simulations: is it more effective than hands‐on training?
Stegmann, K., Pilz, F., Siebeck, M., & Fischer, F. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04344.x · Cited by 151 · cited 1×
“The accuracy of peer assessment may also be improved by the provision of frameworks or guidelines (Stegmann et al. 2012).”
BackgroundReliability and validity of student peer assessment in medical education: A systematic review
Speyer, R., Pilz, W., Van Der Kruis, J., & Brunings, J. W. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.610835 · Cited by 123 · cited 2×
“2011), there is little evidence, or conversation in fact, about the role of PAL in supporting learners’ capacity to make judgements about quality of work (Speyer et al. 2011).”
BackgroundPeer feedback as an aid to learning – What do we want? Feedback. When do we want it? Now!
Cushing, A., Abbott, S., Lothian, D., Hall, A., & Westwood, O. M. R. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.542522 · Cited by 121
Human anatomy: A foundation for education about death and dying in medicine
Marks, S. C., Bertman, S. L., & Penney, J. C. (1997) · Clinical Anatomy · doi:10.1002/(sici)1098-2353(1997)10:2<112::aid-ca7>3.0.co;2-x · Cited by 121 · cited 1×
“This has been relatively successful in knowledge-based areas such as anatomy teaching (Krych et al. 2005; Nnodim 1997).”
The 2:1 Clinical Placement Model
Currens, J. B., & Bithell, C. P. (2003) · Physiotherapy · doi:10.1016/s0031-9406(05)60152-6 · Cited by 111
Trust and its role in facilitating dialogic feedback
(2012) · Feedback in Higher and Professional Education · doi:10.4324/9780203074336-11 · Cited by 107
Burke, J., Fayaz, S., Graham, K., Matthew, R. G. S., & Field, M. (2007) · Medical Teacher · doi:10.1080/01421590701469867 · Cited by 102
Impact of Peer Assessment on the Professional Development of Medical Students: A Qualitative Study
Nofziger, A. C., Naumburg, E. H., Davis, B. J., Mooney, C. J., & Epstein, R. M. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181c47a5b · Cited by 98 · cited 1×
“Many studies involving peer assessment, especially in the clinical environment, have also focussed on professional behaviour rather than clinical or procedural skill evaluation (Lurie et al. 2006; Nofziger et al. 2010; Schönrock-Adema et al. 2007).”
BackgroundClinical Education for the Health Professions: Theory and Practice
Irvine, S., & Irvine, I. J. (2020) · Springer eBooks · doi:10.1007/978-981-13-6106-7 · Cited by 98
Sargeant, J., Mcnaughton, E., Mercer, S., Murphy, D., Sullivan, P., & Bruce, D. A. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.577287 · Cited by 96 · cited 1×
“Sources of external information for self-assessment have broadened in recent years with the adoption of 360 evaluation and multi-source feedback processes (Sargeant et al. 2011).”
BackgroundIntroduction to Peer-Assisted Learning
Ehly, S. W. (1998) · doi:10.4324/9781410603678-7 · Cited by 76
Developing the ability for making evaluative judgements
Cowan, J. (2010) · Teaching in Higher Education · doi:10.1080/13562510903560036 · Cited by 71 · cited 2×
“Despite the use of the term ‘evaluative judgement’ in higher and professional education, a definition has not yet been forthcoming (Boud and Molloy 2013; Cowan 2010; Nicol et al. 2014).”
BackgroundMethodLevine, R. E., Kelly, P. A., Karakoç, T. H., & Haidet, P. (2007) · Academic Psychiatry · doi:10.1176/appi.ap.31.1.19 · Cited by 71 · cited 2×
“Students are also reluctant to undertake PAL in terms of giving each other feedback, as they do not wish to cause social rifts, and prefer to take a supportive role (Levine et al. 2007; Papinczak et al. 2007).”
BackgroundSchönrock‐Adema, J., Heijne‐Penninga, M., Van Duijn, M. A. J., Geertsma, J., & Cohen‐Schotanus, J. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02817.x · Cited by 62 · cited 1×
“Many studies involving peer assessment, especially in the clinical environment, have also focussed on professional behaviour rather than clinical or procedural skill evaluation (Lurie et al. 2006; Nofziger et al. 2010; Schönrock-Adema et al. 2007).”
BackgroundPeer Assessment of Professionalism: A Five-Year Experience in Medical Clerkship
Kovach, R. A., Resch, D. S., & Verhulst, S. J. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-009-0961-5 · Cited by 61 · cited 1×
“There is some evidence supporting the role of students as assessors: correlations with expert grading, though positive, are weak (Kovach et al. 2009; Levine et al. 2007; Papinczak et al. 2007).”
BackgroundComparison of student examiner to faculty examiner scoring and feedback in an OSCE
Moineau, G., Power, B., Pion, A. J., Wood, T. J., & Humphrey‐Murto, S. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03800.x · Cited by 59 · cited 1×
“This is consistent with other studies, where students still preferred faculty members’ instruction and feedback on their performance (Byrne and Cohen 1973; Moineau et al. 2011).”
ResultResituating feedback from the reactive to the proactive
(2012) · Feedback in Higher and Professional Education · doi:10.4324/9780203074336-8 · Cited by 58 · cited 3×
“This capacity to think and apply standards of quality is known in the higher education discourse as ‘evaluative judgement’ and one of the generic skills needed for lifelong learning (Nicol 2013).”
BackgroundInfluentialTai, J. H., Canny, B. J., Haines, T. P., & Molloy, E. K. (2017) · Teaching and Learning in Medicine · doi:10.1080/10401334.2016.1165101 · Cited by 51 · cited 1×
“Further information regarding the breakdown of activities students participated is contained within another manuscript (Tai et al. 2015).”
BackgroundSelf-citationTrust and its role in facilitating dialogic feedback
Carless (2013) · The HKU Scholars Hub (University of Hong Kong) · Cited by 48
Temporal and group‐related trends in peer assessment amongst medical students
Lurie, S. J., Nofziger, A. C., Meldrum, S., Mooney, C., & Epstein, R. M. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02540.x · Cited by 44
Tai, J., Haines, T. P., Canny, B. J., & Molloy, E. (2014) · eCite Digital Repository (University of Tasmania) · Cited by 43
Self-citationChange in action: using positive deviance to improve student clinical performance
Zaidi, Z., Jaffery, T., Shahid, A., Moin, S., Gilani, A., & Burdick, W. P. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9301-8 · Cited by 29 · cited 1×
“Student champions have previously had success in encouraging their peers to participate in learning (Zaidi et al. 2012).”
BackgroundSevenhuysen, S., Nickson, W., Farlie, M. K., Raitman, L., Keating, J. L., Molloy, E., Skinner, E. P., Maloney, S. R., & Haines, T. P. (2013) · Research Online (University of Wollongong) · Cited by 29
Self-citationLearning in clinical practice: Stimulating and discouraging response to social comparison
Raat, J., Kuks, J., & Cohen-Schotanus, J. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.497820 · Cited by 27 · cited 1×
“Observing others’ performance and comparing it with one’s own may also motivate some students to apply themselves to a task (Raat et al. 2010).”
BackgroundObservational study of clinical clerkship activities
Byrne, N. M., & Cohen, R. A. (1973) · Academic Medicine · doi:10.1097/00001888-197310000-00005 · Cited by 25 · cited 1×
“This is consistent with other studies, where students still preferred faculty members’ instruction and feedback on their performance (Byrne and Cohen 1973; Moineau et al. 2011).”
ResultTeam-based assessment of medical students in a clinical clerkship is feasible and acceptable
Sharma, N., Cui, Y., Leighton, J. P., & White, J. S. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.669083 · Cited by 23
The role of peers in feedback processes
(2012) · Routledge eBooks · doi:10.4324/9780203074336-16 · Cited by 11
The role of peers in feedback processes
Ladyshewsky, R. K. (2013) · eSpace (Curtin University) · Cited by 3
Haines, T. P., Hemming, K., Girling, A. J., Hill, A., Bulsara, M. K., & Deeks, J. J. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-s2-p54 · Cited by 2
Self-citation
Research works printed but not linked: 4
- Boud, D., & Molloy, E. K. (Eds.). (2013). Effective feedback in higher and professional education. London, UK: Routledge/Taylor & Francis Group.
- Freire, P. (1970). Pedagogy of the oppressed. New York, NY: Continuum International Publishing Group.
- Molloy, E. K. (2009). Time to pause: Feedback in clinical education. In C. Delany & E. K. Molloy (Eds.), Clinical education in the health professions. Sydney: Elsevier.
- Ngo, K. (2011). “Bull-dogging” for the RACP exams. Australian Medical Student Journal, 2(1), 9.
Cited by
The development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428
“Without training and support for peer feedback, anticipated gains are unlikely to occur (Patton 2012; Tai et al. 2016).”
Developing evaluative judgement: enabling students to make decisions about the quality of work
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018) · Higher Education · doi:10.1007/s10734-017-0220-3 · Cited by 810
“By engaging more closely with criteria and standards, and having to compare work to these, students have reported a better understanding of quality work (McConlogue 2012; Tai et al. 2016).”
BackgroundInfluentialSelf-citationDeveloping a learning-centred framework for feedback literacy
Molloy, E., Boud, D., & Henderson, M. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1667955 · Cited by 555
Self-citationAuthentic assessment: creating a blueprint for course design
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1412396 · Cited by 560
What makes for effective feedback: staff and student perspectives
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1467877 · Cited by 514
“The near absence of peer feedback is potentially unsurprising, as although we are aware of some use of peer feedback within our contexts, we are also aware of resistance to these approaches from students and educators (Liu and Carless 2006; Tai et al. 2016; Adachi, Tai, and Dawson 2018).”
BackgroundSelf-citation
Metadata
- Authors
- Tai, J. H.-M., Canny, B. J., Haines, T. P., & Molloy, E. K.
- Affiliations
- Deakin University (AU)
- Monash University (AU)
- Monash Health (AU)
- Corresponding author
- Tai, Joanna Hong-Meng
- Venue
- Advances in Health Sciences Education
- Published
- 2015-12-12
- Volume
- 21
- Issue
- 3
- Pages
- 659-676
- ISSN
- 1382-4996 (ISSN-L)
- 1573-1677
- OpenAlex
- W2194784372
- Cited by
- 117
- References
- 53
- Citations by year
- 2026: 4 · 2025: 13 · 2024: 12 · 2023: 15 · 2022: 13 · 2021: 16 · 2020: 10 · 2019: 10 · 2018: 10 · 2017: 8 · 2016: 6
- FWCI
- 8.56
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- www.springer.com/tdm (tdm)
- Locations
- Advances in Health Sciences Education (publishedVersion)
- PubMed (publishedVersion)
- eCite Digital Repository (University of Tasmania) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- peer-assisted learning, evaluative judgments, clinical medicine education, medical students, clinical practicum, peer feedback, work quality, standards of practice, intellectual risk-taking, reflective practice
- MeSH terms
- Formative Feedback, Clinical Competence, Education, Medical, Educational Measurement, Female, Humans, Judgment, Learning, Male, Peer Group, Students, Medical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.