Cited by 147Innovations in Medical EducationClinical Reasoning and Diagnostic SkillsMusculoskeletal Disorders and Rehabilitation

The DOI matches its Crossref record; 67 of the 69 references it cites were found in a registry or an index.

Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings

Massie, Jonathan, Ali, Jason M.·2016·Advances in Health Sciences Education

DOI 10.1007/s10459-015-9614-0

Open this paper in CoChat — free account

Abstract

Workplace based assessments (WBAs) are now commonplace in postgraduate medical training. User acceptability and engagement is essential to the success of any medical education innovation. To this end, possessing an insight into trainee and trainer perceptions towards WBAs will help identify the major problems, permitting strategies to be introduced to improve WBA implementation. A review of literature was performed to identify studies examining trainee and trainer perceptions towards WBAs. Studies were excluded if non-English or sampling a non-medical/dental population. The identified literature was synthesised for the purpose of this critical narrative review. It is clear that there is widespread negativity towards WBAs in the workplace. This has negatively impacted on the effectiveness of WBA tools as learning aids. This negativity exists in trainees but also to an extent in their trainers. Insight gained from the literature reveals three dominant problems with WBA implementation: poor understanding as to the purpose of WBAs; insufficient time available for undertaking these assessments; and inadequate training of trainers. Approaches to addressing these three problems with WBA implementation are discussed. It is likely that a variety of solutions will be required. The prevalence of negativity towards WBAs is substantial in both trainees and trainers, eroding the effectiveness of learning that is consequent upon them. The educational community must now listen to the concerns being raised by the users and consider the range of strategies being proposed to improve the experiences of trainees, and their trainers.

Integrity signals

Registry

Crossref · 10.1007/s10459-015-9614-0

Cites

67 of 67 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Power of Feedback
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
General Medical Council
Square, T., London, & Wc, H. (1920) · British Journal of Ophthalmology · doi:10.1136/bjo.4.1.25 · Cited by 1,623
Workplace-based assessment as an educational tool: AMEE Guide No. 31
Norcini, J., & Burch, V. (2007) · Medical Teacher · doi:10.1080/01421590701775453 · Cited by 984
Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7
Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006) · Medical Teacher · doi:10.1080/01421590600622665 · Cited by 500
Impact of workplace based assessment on doctors' education and performance: a systematic review
Miller, A. P., & Archer, J. C. (2010) · BMJ · doi:10.1136/bmj.c5064 · Cited by 462
From context to contextualizing
van Oers, B. (1998) · Learning and Instruction · doi:10.1016/s0959-4752(98)00031-0 · Cited by 335
Faculty and the Observation of Trainees’ Clinical Skills: Problems and Opportunities
Holmboe, E. S. (2004) · Academic Medicine · doi:10.1097/00001888-200401000-00006 · Cited by 327
Programmatic assessment of competency-based workplace learning: when theory meets practice
Bok, H. G., Teunissen, P. W., Favier, R. P., Rietbroek, N. J., Theyse, L. F., Brommer, H., Haarhuis, J. C., van Beukelen, P., van der Vleuten, C. P., & Jaarsma, D. A. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-123 · Cited by 303
Implementing workplace‐based assessment across the medical specialties in the United Kingdom
Wilkinson, J. R., Crossley, J. G. M., Wragg, A., Mills, P., Cowan, G., & Wade, W. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03010.x · Cited by 272
Workplace-based assessment as an educational tool
Norcini, J. J., Burch, V. C., & Gibbs, T. J. (2007) · Medical Entomology and Zoology · Cited by 266
Learning from clinical work: the roles of learning cues and credibility judgements
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04126.x · Cited by 261
Peer assessment of competence
Norcini, J. J. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01536.x · Cited by 244
The validity and reliability of a Direct Observation of Procedural Skills assessment tool: assessing colonoscopic skills of senior endoscopists
Barton, J. R., Corbett, S. S., & van der Vleuten, C. P. M. (2012) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2011.09.053 · Cited by 153
Trainee doctors’ views on workplace-based assessments: Are they just a tick box exercise?
Bindal, T., Wall, D., & Goodyear, H. M. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.558140 · Cited by 144
The process of feedback in workplace‐based assessment: organisation, delivery, continuity
Pelgrim, E. A. M., Kramer, A. W. M., Mokkink, H. G. A., & van der Vleuten, C. P. M. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04266.x · Cited by 128
Mini-clinical evaluation exercise in anaesthesia training
Weller, J. M., Jolly, B. C., Misur, M., Merry, A., Jones, A., Crossley, J., Pedersen, K., & Smith, K. (2009) · British Journal of Anaesthesia · doi:10.1093/bja/aep055 · Cited by 124
The role of feedback in improving the effectiveness of workplace based assessments: a systematic review
Saedon, H., Salleh, S., Balakrishnan, A., Imray, C., & Saedon, M. H. (2012) · BMC Medical Education · doi:10.1186/1472-6920-12-25 · Cited by 124
Evaluation of procedure-based assessment for assessing trainees' skills in the operating theatre
Marriott, J., Purdie, H., Crossley, J., & Beard, J. D. (2010) · British journal of surgery · doi:10.1002/bjs.7342 · Cited by 112
British surgeons' experiences of mandatory online workplace-based assessment
Pereira, E. A. C., & Dean, B. J. F. (2009) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2009.080398 · Cited by 81
A qualitative study on trainees’ and supervisors’ perceptions of assessment for learning in postgraduate medical education
Dijksterhuis, M. G. K., Schuwirth, L. W. T., Braat, D. D. M., Teunissen, P. W., & Scheele, F. (2013) · Medical Teacher · doi:10.3109/0142159x.2012.756576 · Cited by 79
The use of mini-CEX in UK foundation training six years following its introduction: Lessons still to be learned and the benefit of formal teaching regarding its utility
Weston, P. S. J., & Smith, C. A. (2014) · Medical Teacher · doi:10.3109/0142159x.2013.836267 · Cited by 67 · cited 1×
“Despite this, a recent study of Foundation doctors revealed that just 10 % had received any formal training in the use of WBA tools (Weston and Smith 2014).”
Feasibility, Reliability and User Satisfaction With a PDA-Based Mini-CEX to Evaluate the Clinical Skills of Third-Year Medical Students
Torre, D. M., SIMPSON, D. E., Elnicki, D. M., Sebastian, J. L., & Holmboe, E. S. (2007) · Teaching and Learning in Medicine · doi:10.1080/10401330701366622 · Cited by 63
The Quality of Written Comments on Professional Behaviors in a Developmental Multisource Feedback Program
Canavan, C., Holtman, M. C., Richmond, M., & Katsufrakis, P. J. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed4cdb · Cited by 62
Assessing the assessments: U.K. dermatology trainees’ views of the workplace assessment tools
Cohen, S. N., Farrant, P., & Taibjee, S. M. (2009) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2009.09097.x · Cited by 60
DOPS assessment: A study to evaluate the experience and opinions of trainees and assessors
Bindal, N., Goodyear, H. M., Bindal, T., & Wall, D. (2013) · Medical Teacher · doi:10.3109/0142159x.2012.746447 · Cited by 58
British Surgeons' Experiences of a Mandatory Online Workplace Based Assessment Portfolio Resurveyed Three Years On
Pereira, E. A. C., & Dean, B. J. F. (2012) · Journal of surgical education · doi:10.1016/j.jsurg.2012.06.019 · Cited by 56
Portfolio learning for foundation doctors: early feedback on its use in the clinical workplace
Hrisos, S., Illing, J. C., & Burford, B. C. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02960.x · Cited by 56
Value and face validity of objective structured assessment of technical skills (OSATS) for work based assessment of surgical skills in obstetrics and gynaecology
Bodle, J. F., Kaufmann, S., Bisson, D., Nathanson, B., & Binney, D. M. (2008) · Medical Teacher · doi:10.1080/01421590701881624 · Cited by 54
Workplace‐based assessments of junior doctors: do scores predict training difficulties?
Mitchell, C., Bhat, S., Herbert, A., & Baker, P. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04056.x · Cited by 53
Workplace-based assessment and students’ approaches to learning: a qualitative inquiry
Al-Kadri, H. M., Al-Kadi, M., & van der Vleuten, C. P. M. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.765547 · Cited by 51
Exploration of perceived effects of innovations in postgraduate medical education
Fokkema, J. P. I., Teunissen, P. W., Westerman, M., van der Lee, N., van der Vleuten, C. P. M., Scherpbier, A. J. J. A., Dorr, P., & Scheele, F. (2013) · Medical Education · doi:10.1111/medu.12081 · Cited by 49
Training in hospitals: what do GP specialist trainees think of workplace-based assessments?
Sabey, A., & Harris, M. F. (2011) · Education for Primary Care · doi:10.1080/14739879.2011.11493974 · Cited by 47
The Teamwork Mini-Clinical Evaluation Exercise (T-MEX)
Olupeliyawa, A. M., O’Sullivan, A., Hughes, C. S., & Balasooriya, C. D. (2013) · Academic Medicine · doi:10.1097/acm.0000000000000115 · Cited by 45
Workplace-based assessment: The need for continued evaluation and refinement
Beard, J. (2011) · The Surgeon · doi:10.1016/j.surge.2010.11.014 · Cited by 43
Supervised learning events in the Foundation Programme: a UK-wide narrative interview study
Rees, C. E., Cleland, J., Dennis, A. A., Kelly, N. A. A., Mattick, K. L., & Monrouxe, L. V. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005980 · Cited by 41
Getting lost in translation? Workplace based assessments in surgical training
Ali, J. M. (2013) · The Surgeon · doi:10.1016/j.surge.2013.03.001 · Cited by 39
Self-citation
Do trainees value feedback in case-based discussion assessments?
Mehta, F., Brown, J., & Shaw, N. J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.731100 · Cited by 36
Perceived Effects of Innovations in Postgraduate Medical Education
Fokkema, J. P. I., Scheele, F., Westerman, M., van Exel, J. N. A., Scherpbier, A. J. J. A., van der Vleuten, C. P. M., Dorr, P., & Teunissen, P. W. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000394 · Cited by 34
What Evidence is There for the Use of Workplace-Based Assessment in Surgical Training?
Shalhoub, J., Vesey, A. T., & Fitzgerald, J. E. F. (2014) · Journal of surgical education · doi:10.1016/j.jsurg.2014.03.013 · Cited by 32
Student perception of workplace‐based assessment
Nesbitt, A., Baird, F., Canning, B., Griffin, A., & Sturrock, A. M. (2013) · The Clinical Teacher · doi:10.1111/tct.12057 · Cited by 27
Case-based Discussion: Assessment Tool or Teaching Aid?
Jyothirmayi, R. (2012) · Clinical Oncology · doi:10.1016/j.clon.2012.07.008 · Cited by 26
The Journal of Surgical Education
Weigelt, J. A. (2007) · Journal of surgical education · doi:10.1016/j.jsurg.2006.11.002 · Cited by 26
Evaluation of workplace based assessment tools in dental foundation training
Grieveson, B., Kirton, J. A., Palmer, N. O., & Balmer, M. C. (2011) · BDJ · doi:10.1038/sj.bdj.2011.681 · Cited by 26
‘Team observation’: a six-year study of the development and use of multi-source feedback (360-degree assessment) in obstetrics and gynaecology training in the UK
Wood, L., Wall, D., Bullock, A. D., HASSELL, A. B., Whitehouse, A., & Campbell, I. S. (2006) · Medical Teacher · doi:10.1080/01421590600834260 · Cited by 24
Perceptions, attitudes, and beliefs of staff anaesthetists related to multi-source feedback used for their performance appraisal.
Castanelli, D. J., & Kitto, S. (2011) · British Journal of Anaesthesia · doi:10.1093/bja/aer152 · Cited by 24
Workplace-based assessments in Wessex: the first 6 months
Babu, K. S., Htike, M. M., & Cleak, V. E. (2009) · Psychiatric Bulletin · doi:10.1192/pb.bp.108.022889 · Cited by 24
Opinions of the ePortfolio and workplace-based assessments: a survey of core medical trainees and their supervisors
Tailor, A., Dubrey, S. W., & Das, S. K. (2014) · Clinical Medicine · doi:10.7861/clinmedicine.14-5-510 · Cited by 24
The national portfolio of learning for postgraduate family medicine training in South Africa: experiences of registrars and supervisors in clinical practice
Jenkins, L. S., Mash, R. J., & Derese, A. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-149 · Cited by 22
Hospital consultants and workplace based assessments: how foundation doctors view these educational interactions?
McKavanagh, P., Smyth, A., & Carragher, A. M. (2012) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2011-130121 · Cited by 20
Workplace-based assessment as an educational tool: Guide supplement 31.3 – Viewpoint
Saedon, H., Saedon, M., & Aggarwal, S. (2010) · Medical Teacher · doi:10.3109/01421590903548547 · Cited by 19
Lessons learnt from a pilot of assessment for learning
Cho, S. P., Parry, D., & Wade, W. B. (2014) · Clinical Medicine · doi:10.7861/clinmedicine.14-6-577 · Cited by 18
Educational supervision and the impact of workplace-based assessments: a survey of psychiatry trainees and their supervisors
Julyan, T. E. (2009) · BMC Medical Education · doi:10.1186/1472-6920-9-51 · Cited by 17
A national evaluation of workplace-based assessment tools (WPBAs) in foundation dental training: a UK study. Effective and useful but do they provide an equitable training experience?
Kirton, J. A., Palmer, N. O., Grieveson, B., & Balmer, M. C. (2013) · BDJ · doi:10.1038/sj.bdj.2013.302 · Cited by 16
Mapping the problems facing the new surgical curriculum
Eraut, M. R. (2005) · Bulletin of The Royal College of Surgeons of England · doi:10.1308/147363505x53558 · Cited by 12
Foundation doctors’ experience of their training: a questionnaire study
Dean, B. J. F., & Duggleby, P. M. (2013) · JRSM Short Reports · doi:10.1258/shorts.2012.012095 · Cited by 11
Trainers' perceptions of the direct observation of practical skills assessment in histopathology training: a qualitative pilot study
Finall, A. (2012) · Journal of Clinical Pathology · doi:10.1136/jclinpath-2012-200682 · Cited by 10
Workplace-based assessment as an educational tool: Guide Supplement 31.4–Review
Bruce, D. (2010) · Medical Teacher · doi:10.3109/01421591003680636 · Cited by 9
Mersey deanery ophthalmology trainees’ views of the objective assessment of surgical and technical skills (OSATS) workplace-based assessment tool
Tsagkataki, M., & Choudhary, A. (2013) · Perspectives on Medical Education · doi:10.1007/s40037-013-0041-8 · Cited by 9
The perception of online work‐based assessments
Basu, I., Parvizi, S., & Chin, K. H. (2013) · The Clinical Teacher · doi:10.1111/j.1743-498x.2012.00609.x · Cited by 8
Workplace based assessments are no more
Kessel, D. O., Jenkins, J. G., & Neville, E. (2012) · BMJ · doi:10.1136/bmj.e6193 · Cited by 8
Annual review of competence: trainees’ perspective
Goodyear, H. M., Wall, D., & Bindal, T. (2013) · The Clinical Teacher · doi:10.1111/tct.12040 · Cited by 7
Attitudes and perceptions of rheumatologists regarding consultation skills training for specialist trainees: a qualitative study
Sandhu, R. S., Ong, B. N., Cooper, V., & HASSELL, A. B. (2010) · Clinical Medicine · doi:10.7861/clinmedicine.10-1-8 · Cited by 7
Trainee and trainer opinion on increasing numbers of workplace-based assessments
Powell, H., DiMarco, A., & Saeed, S. R. (2014) · Bulletin of The Royal College of Surgeons of England · doi:10.1308/rcsbull.2014.96.5.160 · Cited by 7
Workplace-based assessments in surgery: Are we heading in the wrong direction?
Pentlow, A. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.716561 · Cited by 6
How are workplace-based assessments viewed by UK psychiatry trainees?
Simmons, M. (2013) · PubMed · Cited by 6
Work place based assessment in foundation year: Foundation University Medical College experience.
Rauf, S., Aurangzeb, W., Abbas, S., & Sadiq, N. (2011) · PubMed · Cited by 3

Research works printed but not linked: 1

Academy of Medical Royal Colleges. (2009). Improving assessment. London: Academy of Medical Royal Colleges.

Sorted by citations

Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education.
Lefroy, J., Watling, C., Teunissen, P. W., & Brand, P. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0231-7 · Cited by 347
Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference
Boursicot, K. A. M., Kemp, S., WILKINSON, T. J., Findyartini, A., Canning, C., Cilliers, F. J., & Fuller, R. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1830052 · Cited by 96
Managing tensions in assessment: moving beyond either–or thinking
Govaerts, M., van der Vleuten, C. P. M., & Holmboe, E. S. (2018) · Medical Education · doi:10.1111/medu.13656 · Cited by 93
Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics
van der Schaaf, M., Donkers, J., Slof, B., Moonen-van Loon, J., van Tartwijk, J., Driessen, E., Badii, A., Serban, O., & Ten Cate, O. (2017) · Educational Technology Research and Development · doi:10.1007/s11423-016-9496-8 · Cited by 82
Barriers and Enablers to Direct Observation of Trainees’ Clinical Performance: A Qualitative Study Using the Theoretical Domains Framework
Cheung, W. J., Patey, A. M., Frank, J. R., Mackay, M., & Boet, S. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002396 · Cited by 73

See all 147

Authors: Massie, J., & Ali, J. M.
Affiliations: University of Cambridge (GB)
Corresponding author: Ali, Jason M.
ORCID: Ali, Jason M.
Venue: Advances in Health Sciences Education
Publisher: Springer Science and Business Media LLC
Published: 2015-05-24
Volume: 21
Issue: 2
Pages: 455-473
ISSN: 1382-4996 (ISSN-L)
1573-1677
DOI: 10.1007/s10459-015-9614-0
OpenAlex: W314279525
Cited by: 147
References: 69
Citations by year: 2026: 12 · 2025: 10 · 2024: 14 · 2023: 15 · 2022: 14 · 2021: 16 · 2020: 17 · 2019: 18 · 2018: 15 · 2017: 8 · 2016: 7 · 2015: 1
FWCI: 1.49
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Advances in Health Sciences Education (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Education › Innovations in Medical Education
Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Health Sciences › Medicine › Rehabilitation › Musculoskeletal Disorders and Rehabilitation
Keywords: workplace-based assessment, graduate medical education, trainee perceptions, trainer perceptions, user acceptance, assessment implementation, trainer training, medical education innovation
MeSH terms: Attitude of Health Personnel, Clinical Competence, Educational Measurement, Employee Performance Appraisal, Faculty, Medical, Humans, Internship and Residency, Perception, Workplace, Observation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks