The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
A Blueprint to Assess Professionalism: Results of a Systematic Review
Abstract
PURPOSE: Assessing professionalism is hampered by varying definitions and these definitions' lack of a clear breakdown of the elements of professionalism into aspects that can be measured. Professionalism is multidimensional, so a combination of assessment tools is required. In this study, conducted during 2007-2008, the authors aimed to match assessment tools to definable elements of professionalism and to identify gaps where professionalism elements are not well addressed by existing assessment tools. METHOD: The authors conducted literature reviews of definitions of professionalism and of relevant assessment tools, clustered the definitions of professionalism into assessable components, and clustered assessment tools of a similar nature. They then created a "blueprint" whereby the elements of professionalism are matched to relevant assessment tools. RESULTS: Five clusters of professionalism were formed: adherence to ethical practice principles, effective interactions with patients and with people who are important to those patients, effective interactions with people working within the health system, reliability, and commitment to autonomous maintenance / improvement of competence in oneself, others, and systems. Nine clusters of assessment tools were identified: observed clinical encounters, collated views of coworkers, records of incidents of unprofessionalism, critical incident reports, simulations, paper-based tests, patients' opinions, global views of supervisor, and self-administered rating scales. CONCLUSIONS: Professionalism can be assessed using a combination of observed clinical encounters, multisource feedback, patients' opinions, paper-based tests or simulations, measures of research and/or teaching activities, and scrutiny of self-assessments compared with assessments by others. Attributes that require more development in their measurement are reflectiveness, advocacy, lifelong learning, dealing with uncertainty, balancing availability to others with care for oneself, and seeking and responding to results of an audit.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966
The Mini-CEX: A Method for Assessing Clinical Skills
Norcini, J. J., Blank, L. L., Duffy, F. D., & Fortna, G. S. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-6-200303180-00012 · Cited by 730
Measuring Patients’ Trust in their Primary Care Providers
Hall, M. A., Zheng, B., Dugan, E., Camacho, F., Kidd, K. E., Mishra, A., & Balkrishnan, R. (2002) · Medical Care Research and Review · doi:10.1177/1077558702059003004 · Cited by 661
Toward a Normative Definition of Medical Professionalism
Swick, H. M. (2000) · Academic Medicine · doi:10.1097/00001888-200006000-00010 · Cited by 660
Medical professionalism in the new millennium: a physicians' charter
(2002) · The Lancet · doi:10.1016/s0140-6736(02)07684-5 · Cited by 482
Assessing Professional Behavior: Yesterday, Today, and Tomorrow
Arnold, L. (2002) · Academic Medicine · doi:10.1097/00001888-200206000-00006 · Cited by 462
OSCE checklists do not capture increasing levels of expertise
Hodges, B., Regehr, G., McNaughton, N., Tiberius, R., & Hanson, M. (1999) · Academic Medicine · doi:10.1097/00001888-199910000-00017 · Cited by 360
Proto‐professionalism: how professionalisation occurs across the continuum of medical education
Hilton, S. R., & Slotnick, H. B. (2005) · Medical Education · doi:10.1111/j.1365-2929.2004.02033.x · Cited by 357
Use of Peer Ratings to Evaluate Physician Performance
Ramsey, P. G. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1993.03500130069034 · Cited by 347
Doctors in society: medical professionalism in a changing world
Wass, V. (2006) · Clinical Medicine · doi:10.7861/clinmedicine.6-1-109 · Cited by 320
Multisource feedback in the assessment of physician competencies
Lockyer, J. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230103 · Cited by 282
Assessing professionalism: a review of the literature
Lynch, D. C., Surdyk, P. M., & Eiser, A. R. (2004) · Medical Teacher · doi:10.1080/01421590410001696434 · Cited by 244
Norcini, J. J. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01536.x · Cited by 243
The development of a scale to measure personal reflection in medical practice and education
Aukes, L. C., Geertsma, J., Cohen-Schotanus, J., Zwierstra, R. P., & Slaets, J. P. J. (2007) · Medical Teacher · doi:10.1080/01421590701299272 · Cited by 230
Professionalism in medical education, an American perspective: from evidence to accountability
Cohen, J. J. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02512.x · Cited by 218
The Professionalism Mini-Evaluation Exercise: A Preliminary Investigation
Cruess, R., McIlroy, J. H., Cruess, S., Ginsburg, S., & Steinert, Y. (2006) · Academic Medicine · doi:10.1097/00001888-200610001-00019 · Cited by 207
Veloski, J. J., Fields, S. K., Boex, J. R., & Blank, L. L. (2005) · Academic Medicine · doi:10.1097/00001888-200504000-00014 · Cited by 203
How to conceptualize professionalism: a qualitative study
Van De Camp, K., Vernooij-Dassen, M. J. F. J., Grol, R. P. T. M., & Bottema, B. J. A. M. (2004) · Medical Teacher · doi:10.1080/01421590400019518 · Cited by 189
Durning, S. J., Cation, L. J., Markert, R. J., & Pangaro, L. N. (2002) · Academic Medicine · doi:10.1097/00001888-200209000-00020 · Cited by 185
Defining medical professionalism: a qualitative study
Wagner, P., Hendrich, J., Moseley, G., & Hudson, V. (2007) · Medical Education · doi:10.1111/j.1365-2929.2006.02695.x · Cited by 164
Use of SPRAT for peer review of paediatricians in training
Archer, J. C., Norcini, J. J., & Davies, H. A. (2005) · BMJ · doi:10.1136/bmj.38447.610451.8f · Cited by 142
Basing the Evaluation of Professionalism on Observable Behaviors: A Cautionary Tale
Ginsburg, S., Regehr, G., & Lingard, L. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00001 · Cited by 131
Early Detection and Evaluation of Professionalism Deficiencies in Medical Students
Papadakis, M. A., Loeser, H., & Healy, K. (2001) · Academic Medicine · doi:10.1097/00001888-200111000-00010 · Cited by 128
Review of instruments for peer assessment of physicians
Evans, R., Elwyn, G. J., & Edwards, A. (2004) · BMJ · doi:10.1136/bmj.328.7450.1240 · Cited by 125
Godkin, M. A., & Savageau, J. A. (2001) · PubMed · Cited by 122
Blackall, G. F., Melnick, S. A., Shoop, G. H., et al. (2007) · Medical Teacher · doi:10.1080/01421590601044984 · Cited by 120
Development of an Instrument to Measure Professionalism
Chisholm, M. A., Cobb, H., Duke, L., McDuffie, C., & Kennedy, W. K. (2006) · American Journal of Pharmaceutical Education · doi:10.5688/aj700485 · Cited by 117
Perceptions of professionalism in medicine: a qualitative study
Jha, V., Bekker, H., Duffy, S., et al. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02567.x · Cited by 113
Discovering professionalism through guided reflection
Stark, P., Roberts, C., Newble, D. I., & Bax, N. (2006) · Medical Teacher · doi:10.1080/01421590600568520 · Cited by 101
Promoting Reflection on Professionalism
Baernstein, A., & Fryer-Edwards, K. A. (2003) · Academic Medicine · doi:10.1097/00001888-200307000-00018 · Cited by 99
Do Global Rating Forms Enable Program Directors to Assess the ACGME Competencies?
Silber, C. G., Nasca, T. J., Paskin, D., Eiger, G., Robeson, M., & Veloski, J. J. (2004) · Academic Medicine · doi:10.1097/00001888-200406000-00010 · Cited by 98
Objectivity in Objective Structured Clinical Examinations
WILKINSON, T. J., FRAMPTON, C. M. A., Thompson-Fawcett, M. W., & Egan, T. G. (2003) · Academic Medicine · doi:10.1097/00001888-200302000-00021 · Cited by 96
Self-citationAssessment of Resident Professionalism Using High‐fidelity Simulation of Ethical Dilemmas
Gisondi, M. A., Smith‐Coggins, R., Harter, P. M., Soltysik, R. C., & Yarnold, P. R. (2004) · Academic Emergency Medicine · doi:10.1197/j.aem.2004.04.005 · Cited by 90
Assessing the mini‐Clinical Evaluation Exercise in comparison to a national specialty examination
Hatala, R. A., Ainslie, M., Kassen, B. O., Mackie, I., & Roberts, J. M. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02566.x · Cited by 81
Using a standardised patient assessment to measure professional attributes
van Zanten, M., Boulet, J. R., Norcini, J. J., & McKinley, D. W. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.02029.x · Cited by 80
Arnold, L., Shue, C. K., Kalishman, S. G., et al. (2007) · Academic Medicine · doi:10.1097/acm.0b013e3180555d4e · Cited by 80
Comprehensive Assessment of Professional Competence: The Rochester Experiment
Epstein, R. M., Dannefer, E. F., Nofziger, A. C., Hansen, J. T., Schultz, S. H., Jospe, N., Connard, L. W., Meldrum, S. C., & Henson, L. C. (2004) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1602_12 · Cited by 79
Shayne, P. H., Gallahue, F. E., Rinnert, S., Anderson, C. L., Hern, G., & Katz, E. (2006) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2006.tb01711.x · Cited by 77
A questionnaire for patients’ evaluations of their physicians’ humanistic behaviors
Weaver, M. J., Ow, C. L., Walker, D. J., & Degenhardt, E. F. (1993) · Journal of General Internal Medicine · doi:10.1007/bf02599758 · Cited by 75
van de Camp, K., Vernooij-Dassen, M. J. F. J., Grol, R. P. T. M., & Bottema, B. J. A. M. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02346.x · Cited by 75
Tamblyn, R. M., Benaroya, S., Snell, L. S., et al. (1994) · Journal of General Internal Medicine · doi:10.1007/bf02600030 · Cited by 73
Performance-based assessment of clinical ethics using an objective structured clinical examination
SINGER, P. A., Robb, A., Cohen, R., Norman, G. R., & Turnbull, J. (1996) · Academic Medicine · doi:10.1097/00001888-199605000-00021 · Cited by 72
Cultural sensitivity training among foreign medical graduates
Majumdar, B., Keystone, & Cuttress, L. A. (1999) · Medical Education · doi:10.1046/j.1365-2923.1999.00291.x · Cited by 71
Defining professionalism in anaesthesiology
Kearney, R. A. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02233.x · Cited by 70
Mazor, K. M., Zanetti, M. L., Alper, E., Hatem, D., Barrett, S., Meterko, V., Gammon, W. L., & Pugnaire, M. P. (2007) · Medical Education · doi:10.1111/j.1365-2929.2006.02692.x · Cited by 70
Kalet, A. L., Sanger, J. J., Chase, J., Keller, A. S., Schwartz, M. D., Fishman, M. L., Garfall, A. L., & Kitay, A. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31815762af · Cited by 68
Promoting an Environment of Professionalism: The University of Chicago “Roadmap”
Humphrey, H. J., Smith, K., Reddy, S. T., Scott, D., Madara, J., & Arora, V. M. (2007) · Academic Medicine · doi:10.1097/01.acm.0000285344.10311.a8 · Cited by 66
Patient perceptions of humanism in physicians: effects on positive health behaviors.
Hauck, F. R., Zyzanski, S. J., Alemagno, S. A., & Medalie, J. H. (1990) · PubMed · Cited by 62
AINSWORTH, M. A., & Szauter, K. M. (2006) · Academic Medicine · doi:10.1097/00001888-200610001-00021 · Cited by 59
Rees, C. E., & Shepherd, M. H. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.02032.x · Cited by 57
Reflective professionalism: interpreting CanMEDS’ “professionalism”: Table 1
Verkerk, M. A., de Bree, M., & Mourits, M. J. E. (2007) · Journal of Medical Ethics · doi:10.1136/jme.2006.017954 · Cited by 57
West, C. P., Huntington, J. L., Huschka, M. M., Novotny, P. J., Sloan, J. A., Kolars, J. C., Habermann, T. M., & Shanafelt, T. D. (2007) · Academic Medicine · doi:10.1097/acm.0b013e3180555fc5 · Cited by 55
The nature of qualitative comments in evaluating professionalism
Frohna, A. Z., & Stern, D. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02234.x · Cited by 53
Initial use of a novel instrument to measure professionalism in surgical residents
Gauger, P. G., Gruppen, L. D., Minter, R. M., Colletti, L. M., & Stern, D. T. (2005) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2004.09.020 · Cited by 51
Understanding doctors: harnessing professionalism
Hughes, G. F. (2008) · Emergency Medicine Journal · doi:10.1136/emj.2008.066118 · Cited by 48
The Assessment of Emergency Physicians by a Regulatory Authority
Lockyer, J., Violato, C., & Fidler, H. (2006) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2006.tb00293.x · Cited by 42
de Haes, J. C. J. M., Oort, F. J., & Hulsman, R. L. (2005) · Medical Teacher · doi:10.1080/01421590500061378 · Cited by 41
Patients' global ratings of student competence. Unreliable contamination or gold standard?
WILKINSON, T. J., & Fontaine, S. (2002) · Medical Education · doi:10.1046/j.1365-2923.2002.01379.x · Cited by 39
Self-citationde Haes, J. D., Oort, F., Oosterveld, P., & ten Cate, O. T. (2001) · Patient Education and Counseling · doi:10.1016/s0738-3991(01)00141-0 · Cited by 35
Assessment of clinical performance: gathering evidence
WILKINSON, T. J. (2007) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2007.01483.x · Cited by 21
Self-citationProblems with using a supervisor's report as a form of summative assessment
WILKINSON, T. J., & Wade, W. (2007) · Postgraduate Medical Journal · doi:10.1136/pgmj.2007.058982 · Cited by 21
Self-citationA Cultural Sensitivity Training Workshop for Psychiatry Residents
LoboPrabhu, S. (2000) · Academic Psychiatry · doi:10.1176/appi.ap.24.2.77 · Cited by 18
Development of an instrument to assess professional behaviour of foreign medical graduates
Tromp, F., Rademakers, J. J. D. J. M., & ten Cate, O. (2007) · Medical Teacher · doi:10.1080/01421590601178014 · Cited by 16
Cited by
Reframing Medical Education to Support Professional Identity Formation
Cruess, R. L., Cruess, S. R., Boudreau, J. D., Snell, L., & Steinert, Y. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000427 · Cited by 1,061
Cruess, R. L., Cruess, S. R., Boudreau, J. D., Snell, L., & Steinert, Y. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000700 · Cited by 1,038
Amending miller’s pyramid to include professional identity formation.
Cruess, R. L., Cruess, S. R., & Steinert, Y. (2016) · Academic Medicine · doi:10.1097/acm.0000000000000913 · Cited by 558
Supporting the development of a professional identity: General principles
Cruess, S. R., Cruess, R. L., & Steinert, Y. (2019) · Medical Teacher · doi:10.1080/0142159x.2018.1536260 · Cited by 490
Assessment of professionalism: Recommendations from the Ottawa 2010 Conference
Hodges, B. D., Ginsburg, S., Cruess, R., Cruess, S., Delport, R., Hafferty, F., Ho, M.-J., Holmboe, E., Holtman, M., Ohbu, S., et al. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.577300 · Cited by 346
Self-citation
Metadata
- Authors
- Wilkinson, T. J., Wade, W. B., & Knock, L. D.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-05
- Volume
- 84
- Issue
- 5
- Pages
- 551-558
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2122895006
- Cited by
- 336
- References
- 64
- FWCI
- 2.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.