Peer assessment of professional competence
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Background Current assessment formats for medical students reliably test core knowledge and basic skills. Methods for assessing other important domains of competence, such as interpersonal skills, humanism and teamwork skills, are less well developed. This study describes the development, implementation and results of peer assessment as a measure of professional competence of medical students to be used for formative purposes. Methods Year 2 medical students assessed the professional competence of their peers using an online assessment instrument. Fifteen randomly selected classmates were assigned to assess each student. The responses were analysed to determine the reliability and validity of the scores and to explore relationships between peer assessments and other assessment measures. Results Factor analyses suggest a 2‐dimensional conceptualisation of professional competence: 1 factor represents Work Habits, such as preparedness and initiative, and the other factor represents Interpersonal Habits, including respect and trustworthiness. The Work Habits factor had moderate, yet statistically significant correlations ranging from 0.21 to 0.53 with all other performance measures that were part of a comprehensive assessment of professional competence. Approximately 6 peer raters were needed to achieve a generalisability coefficient of 0.70. Conclusions Our findings suggest that it is possible to introduce peer assessment for formative purposes in an undergraduate medical school programme that provides multiple opportunities to interact with and observe peers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Herne, H., Cooley, W. W., & Lohnes, P. R. (1973) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344428 · Cited by 35,697
Defining and Assessing Professional Competence
Epstein, R. M. (2002) · JAMA · doi:10.1001/jama.287.2.226 · Cited by 3,107 · cited 1×
“Identifies and solves problems ( 2 ) 0.96 0.93 0.37 Thinks and works independently (14) 0.92 0.91 0.50 Clearly explains reasoning processes (3) 0.86 0.87 0.52 Consistently well-prepared (1) 0.84 0.86 0.44 Seeks responsibility (8) 0.81 0.86 Takes initiative (6) 0.80 0.73 Seeks to understand others (5) 0.99 0.33 0.93 De…”
BackgroundInfluentialSelf-citationThe assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247 · cited 1×
“Identifies and solves problems (2) 0.96 0.93 0.37 Thinks and works independently (14) 0.92 0.91 0.50 Clearly explains reasoning processes (3) 0.86 0.87 0.52 Consistently well-prepared (1) 0.84 0.86 0.44 Seeks responsibility (8) 0.81 0.86 Takes initiative (6) 0.80 0.73 Seeks to understand others (5) 0.99 0.33 0.93 Demo…”
BackgroundInfluentialBrennan, R. L. (2001) · doi:10.1007/978-1-4757-3456-0 · Cited by 1,121
Assessment of clinical competence
Wass, V., Van der Vleuten, C., Shatzer, J., & Jones, R. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04221-5 · Cited by 1,024
Shifting Paradigms: From Flexner to Competencies
Carraccio, C., Wolfsthal, S. D., Englander, R., Ferentz, K., & Martin, C. (2002) · Academic Medicine · doi:10.1097/00001888-200205000-00003 · Cited by 975 · cited 1×
“Identifies and solves problems (2) 0.96 0.93 0.37 Thinks and works independently (14) 0.92 0.91 0.50 Clearly explains reasoning processes (3) 0.86 0.87 0.52 Consistently well-prepared ( 1 ) 0.84 0.86 0.44 Seeks responsibility (8) 0.81 0.86 Takes initiative (6) 0.80 0.73 Seeks to understand others (5) 0.99 0.33 0.93 De…”
BackgroundInfluentialReliability: on the reproducibility of assessment data
Downing, S. M. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01932.x · Cited by 721
Assessing Professional Behavior: Yesterday, Today, and Tomorrow
Arnold, L. (2002) · Academic Medicine · doi:10.1097/00001888-200206000-00006 · Cited by 462
Use of Peer Ratings to Evaluate Physician Performance
Ramsey, P. G. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1993.03500130069034 · Cited by 347
Context, Conflict, and Resolution: A New Conceptual Framework for Evaluating Professionalism
GINSBURG, S., REGEHR, G., HATALA, R., MCNAUGHTON, N., FROHNA, A., HODGES, B., LINGARD, L., & STERN, D. (2000) · Academic Medicine · doi:10.1097/00001888-200010001-00003 · Cited by 271 · cited 1×
“... and solves problems (2) 0.96 0.93 0.37 Thinks and works independently (14) 0.92 0.91 0.50 Clearly explains reasoning processes (3) 0.86 0.87 0.52 Consistently well-prepared (1) 0.84 0.86 0.44 Seeks responsibility (8) 0.81 0.86 Takes initiative (6) 0.80 0.73 Seeks to understand others (5) 0.99 0.33 0.93 Demonstrate…”
BackgroundInfluentialNorcini, J. J. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01536.x · Cited by 243
Rodgers, K. G., & Manifold, C. A. (2002) · Academic Emergency Medicine · doi:10.1197/aemj.9.11.1300 · Cited by 152
Hemmer, P. A., Hawkins, R., Jackson, J. L., & Pangaro, L. N. (2000) · Academic Medicine · doi:10.1097/00001888-200002000-00016 · Cited by 108
Self- and Peer Assessment in a First-Year Communication and Interviewing Course
Rudy, D. W., Fejfar, M. C., Griffith III, C. H., & Wilson, J. F. (2001) · Evaluation & the Health Professions · doi:10.1177/01632780122035000 · Cited by 95
Ramsey, P. G., Carline, J. D., Blank, L. L., & Wenrich, M. D. (1996) · Academic Medicine · doi:10.1097/00001888-199604000-00014 · Cited by 83
Use of peer ratings to evaluate physician performance
Ramsey, P. G. (1993) · JAMA · doi:10.1001/jama.269.13.1655 · Cited by 81
Comprehensive Assessment of Professional Competence: The Rochester Experiment
Epstein, R. M., Dannefer, E. F., Nofziger, A. C., Hansen, J. T., Schultz, S. H., Jospe, N., Connard, L. W., Meldrum, S. C., & Henson, L. C. (2004) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1602_12 · Cited by 78
Self-citationUse of peer evaluation in the assessment of medical students
Arnold, L., Willoughby, L., Calkins, V, Gammon, L., & Eberhart, G. (1981) · Academic Medicine · doi:10.1097/00001888-198101000-00007 · Cited by 78
A pilot study of peer review in residency training
Thomas, P. A., Gebo, K. A., & Hellmann, D. B. (1999) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1999.10148.x · Cited by 76
Performance rating scale for peer and self assessment 1
LINN, B. S., AROSTEGUI, M., & ZEPPA, R. (1975) · Medical Education · doi:10.1111/j.1365-2923.1975.tb01902.x · Cited by 68
DiMatteo, M. R., & DiNicola, D. D. (1981) · Medical Care · doi:10.1097/00005650-198108000-00003 · Cited by 67
Medical shcool evaluation and internship performance
Korman, M., & Stubblefield, R. L. (1971) · Academic Medicine · doi:10.1097/00001888-197108000-00005 · Cited by 60
Comparing peer and faculty evaluations in an internal medicine residency
Rosendaal, G. M. A. V., & Jennett, P. A. (1994) · Academic Medicine · doi:10.1097/00001888-199404000-00014 · Cited by 55 · cited 1×
“Identifies and solves problems (2) 0.96 0.93 0.37 Thinks and works independently (14) 0.92 0.91 0.50 Clearly explains reasoning processes (3) 0.86 0.87 0.52 Consistently well-prepared (1) 0.84 0.86 0.44 Seeks responsibility (8) 0.81 0.86 Takes initiative (6) 0.80 0.73 Seeks to understand others ( 5 ) 0.99 0.33 0.93 De…”
BackgroundInfluentialAsch, E. A., Saltzberg, D., & Kaiser, S. (1998) · Academic Medicine · doi:10.1097/00001888-199805000-00034 · Cited by 44
Using Standardized Patients to Assess Medical Studentsʼ Professionalism
Prislin, M. D., Lie, D., Shapiro, J. F., Boker, J. R., & Radecki, S. E. (2001) · Academic Medicine · doi:10.1097/00001888-200110001-00030 · Cited by 44
Cohen, J. J. (1999) · Academic Medicine · doi:10.1097/00001888-199909000-00014 · Cited by 15 · cited 2×
“Identifies and solves problems (2) 0.96 0.93 0.37 Thinks and works independently (14) 0.92 0.91 0.50 Clearly explains reasoning processes (3) 0.86 0.87 0.52 Consistently well-prepared (1) 0.84 0.86 0.44 Seeks responsibility (8) 0.81 0.86 Takes initiative (6) 0.80 0.73 Seeks to understand others (5) 0.99 0.33 0.93 Demo…”
BackgroundInfluential
Cited by
Assessment in medical education
Epstein, R. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmra054784 · Cited by 1,872
Self-citationDisciplinary Action by Medical Boards and Prior Behavior in Medical School
Papadakis, M. A., Teherani, A., Banach, M. A., Knettler, T. R., Rattner, S. L., Stern, D. T., Veloski, J. J., & Hodgson, C. S. (2005) · New England Journal of Medicine · doi:10.1056/nejmsa052596 · Cited by 840
“Improved systems of evaluation are needed to monitor the development of professional behavior and to document deficiencies.(30) Providing students with feedback guided by evidence may motivate and direct remediation strategies, but the best practices for the remediation of deficiencies in professional behavior need de…”
BackgroundPeer teaching in medical education: twelve reasons to move from theory to practice
Ten Cate, O., & Durning, S. (2007) · Medical Teacher · doi:10.1080/01421590701606799 · Cited by 695
Online Posting of Unprofessional Content by Medical Students
Chretien, K. C. (2009) · JAMA · doi:10.1001/jama.2009.1387 · Cited by 448
Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30
Ross, M. T., & Cameron, H. S. (2007) · Medical Teacher · doi:10.1080/01421590701665886 · Cited by 293
Metadata
- Authors
- Dannefer, E. F., Henson, L. C., Bierer, S. B., Grady‐Weliky, T. A., Meldrum, S., Nofziger, A. C., Barclay, C., & Epstein, R. M.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2005-06-13
- Volume
- 39
- Issue
- 7
- Pages
- 713-722
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2051654635
- Cited by
- 174
- References
- 26
- FWCI
- 8.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.