Cited by 26Innovations in Medical EducationClinical Reasoning and Diagnostic SkillsSimulation-Based Education in Healthcare

Impact of integrating objective structured clinical examination into academic student assessment: Large-scale experience in a French medical school

Open access
Matet, Alexandre, Fournel, Ludovic, Gaillard, François, Amar, Laurence, Arlet, Jean-Benoit, Baron, Stéphanie, Bats, Anne-Sophie, Buffel du Vaure, Celine +21 more·2021·PLOS ONE

Abstract

Purpose: Objective structured clinical examinations (OSCE) evaluate clinical reasoning, communication skills, and interpersonal behavior during medical education. In France, clinical training has long relied on bedside clinical practice in academic hospitals. The need for a simulated teaching environment has recently emerged, due to the increasing number of students admitted to medical schools, and the necessity of objectively evaluating practical skills. This study aimed at investigating the relationships between OSCE grades and current evaluation modalities. Methods: Three-hundred seventy-nine 4 th-year students of University-of-Paris Medical School participated to the first large-scale OSCE at this institution, consisting in three OSCE stations (OSCE#1–3). OSCE#1 and #2 focused on cardiovascular clinical skills and competence, whereas OSCE#3 focused on relational skills while providing explanations before planned cholecystectomy. We investigated correlations of OSCE grades with multiple choice (MCQ)-based written examinations and evaluations of clinical skills and behavior (during hospital traineeships); OSCE grade distribution; and the impact of integrating OSCE grades into the current evaluation in terms of student ranking. Results: The competence-oriented OSCE#1 and OSCE#2 grades correlated only with MCQ grades (r = 0.19, P<0.001) or traineeship skill grades (r = 0.17, P = 0.001), respectively, and not with traineeship behavior grades (P>0.75). Conversely, the behavior-oriented OSCE#3 grades correlated with traineeship skill and behavior grades (r = 0.19, P<0.001, and r = 0.12, P = 0.032), but not with MCQ grades (P = 0.09). The dispersion of OSCE grades was wider than for MCQ examinations (P<0.001). When OSCE grades were integrated to the final fourth-year grade with an incremental 10%, 20% or 40% coefficient, an increasing proportion of the 379 students had a ranking variation by ±50 ranks (P<0.001). This ranking change mainly affected students among the mid-50% of ranking. Conclusion: This large-scale French experience showed that OSCE designed to assess a combination of clinical competence and behavioral skills, increases the discriminatory capacity of current evaluations modalities in French medical schools.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0245439

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • This level of specificity not only clarifies expectations but also builds learners' confidence in their ability to improve.

    “This level of specificity not only clarifies expectations but also builds learners' confidence in their ability to improve [79,80].”
  • Objective Structured Clinical Examinations (OSCEs) have become a cornerstone of medical education, offering structured and standardized environments to evaluate clinical skills systematically.

    “Objective Structured Clinical Examinations (OSCEs) have become a cornerstone of medical education, offering structured and standardized environments to evaluate clinical skills systematically [79,80,97].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Matet, A., Fournel, L., Gaillard, F., Amar, L., Arlet, J.-B., Baron, S., Bats, A.-S., Buffel du Vaure, C., Charlier, C., De Lastours, V., Faye, A., Jablon, E., Kadlub, N., Leguen, J., Lebeaux, D., Malmartel, A., Mirault, T., Planquette, B., Régent, A., Thebault, J.-L., Dinh, A. T., Nuzzo, A., Turc, G., Friedlander, G., Ruszniewski, P., Badoual, C., Ranque, B., Oualha, M., & Courbebaisse, M.
Affiliations
  • Inserm (FR)
  • Assistance Publique – Hôpitaux de Paris (FR)
  • Université Paris Cité (FR)
  • Hôpital Necker-Enfants Malades (FR)
  • Centre National de la Recherche Scientifique (FR)
Corresponding author
Matet, Alexandre
Venue
PLOS ONE
Published
2021-01-14
Volume
16
Issue
1
Pages
e0245439
ISSN
1932-6203 (ISSN-L)
OpenAlex
W3121048865
Cited by
26
References
32
Citations by year
2026: 4 · 2025: 5 · 2024: 5 · 2023: 8 · 2022: 3 · 2021: 1
FWCI
3.68
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • HAL (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Agence Nationale de la Recherche (ANR-10-LABX-0017)
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
  • Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
  • Health Sciences › Medicine › Physiology › Simulation-Based Education in Healthcare
Keywords
OSCE, medical student assessment, clinical competence assessment, clinical reasoning, social skills, multiple-choice tests, student ranking
MeSH terms
Clinical Competence, Education, Medical, Educational Measurement, France, Humans, Schools, Medical, Students, Medical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review