The DOI matches its Crossref record.
Evaluating communication skills in the objective structured clinical examination format: reliability and generalizability
Abstract
SUMMARY: In most objective structured clinical examinations (OSCEs), communication skills are assessed as an ‘add‐on’ to history‐taking stations, rather than in stations designed to assess communication skills in the broadest sense. This study investigated the feasibility of developing such stations. In part one, 60 clinical clerks and 36 residents were rated in four 10‐min emotionally charged situations portrayed by standardized patients. Inter‐rater reliability was demonstrated ( r = 0.59–0.63 ) and a highly significant effect of educational level was found. Generalizability between communication stations was low (0.17–0.20). Several explanations for poor generalizability, including poor discrimination as a result of low score variance and the confounding effect of content knowledge, were addressed in part 2. Ninety‐five final‐year medical students participated in an OSCE in which six 10‐min encounters examined the students' ability to manage difficult emotional situations such as fear, anxiety, mania, sadness, confusion and anger. Half the students encountered a patient with moderate emotional symptoms and half an extreme emotional state. For difficult stations, students' scores were lower and standard deviation higher, suggesting that manipulating difficulty increases score variance and potentially discrimination. However, a strong interaction was found between difficulty and station content, and communication scores were highly correlated with content. Scenarios which created major communication difficulties (such as mania) resulted in much larger differences in scores between the easy and difficult versions. Communication OSCE stations can be created with acceptable reliability including difficult cases which address communication skills beyond simple history taking. Nevertheless, a generalizable set of communication skills remains elusive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Assessing Professional Behavior: Yesterday, Today, and Tomorrow
Arnold, L. (2002) · Academic Medicine · doi:10.1097/00001888-200206000-00006 · Cited by 462
A systematic review of the reliability of objective structured clinical examination scores
Brannick, M. T., Erol‐Korkmaz, H. T., & Prewett, M. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04075.x · Cited by 354
Context, Conflict, and Resolution: A New Conceptual Framework for Evaluating Professionalism
GINSBURG, S., REGEHR, G., HATALA, R., MCNAUGHTON, N., FROHNA, A., HODGES, B., LINGARD, L., & STERN, D. (2000) · Academic Medicine · doi:10.1097/00001888-200010001-00003 · Cited by 271
Self-citationWallace, J., Rao, R., & Haslam, R. (2002) · Advances in Psychiatric Treatment · doi:10.1192/apt.8.5.342 · Cited by 126
Metadata
- Authors
- Hodges, B., Turnbull, J., Cohen, R., Bienenstock, A., & Norman, G.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 1996-01
- Volume
- 30
- Issue
- 1
- Pages
- 38-43
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2053038863
- Cited by
- 167
- References
- 0
- FWCI
- 3.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating communication skills in the objective structured clinical examination format: reliability and generalizability. https://app.cochat.ai/papers/10.1111/j.1365-2923.1996.tb00715.x
- The paper
- Hodges, B., Turnbull, J., Cohen, R., Bienenstock, A., & Norman, G. (1996). Evaluating communication skills in the objective structured clinical examination format: reliability and generalizability. Medical Education. https://doi.org/10.1111/j.1365-2923.1996.tb00715.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.