Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.

Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37

Open access

Abstract

BACKGROUND: In the 11 years since its development at McMaster University Medical School, the multiple mini-interview (MMI) has become a popular selection tool. We aimed to systematically explore, analyze and synthesize the evidence regarding MMIs for selection to undergraduate health programs. METHODS: The review protocol was peer-reviewed and prospectively registered with the Best Evidence Medical Education (BEME) collaboration. Thirteen databases were searched through 34 terms and their Boolean combinations. Seven key journals were hand-searched since 2004. The reference sections of all included studies were screened. Studies meeting the inclusion criteria were coded independently by two reviewers using a modified BEME coding sheet. Extracted data were synthesized through narrative synthesis. RESULTS: A total of 4338 citations were identified and screened, resulting in 41 papers that met inclusion criteria. Thirty-two studies report data for selection to medicine, six for dentistry, three for veterinary medicine, one for pharmacy, one for nursing, one for rehabilitation, and one for health science. Five studies investigated selection to more than one profession. MMIs used for selection to undergraduate health programs appear to have reasonable feasibility, acceptability, validity, and reliability. Reliability is optimized by including 7-12 stations, each with one examiner. The evidence is stronger for face validity, with more research needed to explore content validity and predictive validity. In published studies, MMIs do not appear biased against applicants on the basis of age, gender, or socio-economic status. However, applicants of certain ethnic and social backgrounds did less well in a very small number of published studies. Performance on MMIs does not correlate strongly with other measures of noncognitive attributes, such as personality inventories and measures of emotional intelligence. DISCUSSION: MMI does not automatically mean a more reliable selection process but it can do, if carefully designed. Effective MMIs require careful identification of the noncognitive attributes sought by the program and institution. Attention needs to be given to the number of stations, the blueprint and examiner training. CONCLUSION: More work is required on MMIs as they may disadvantage groups of certain ethnic or social backgrounds. There is a compelling argument for multi-institutional studies to investigate areas such as the relationship of MMI content to curriculum domains, graduate outcomes, and social missions; relationships of applicants' performance on different MMIs; bias in selecting applicants of minority groups; and the long-term outcomes appropriate for studies of predictive validity.

Overview

Integrity signals

Registry

Crossref · 10.3109/0142159x.2016.1158799

Cites

82 of 82 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 82 references

Research works printed but not linked: 4

  1. Dhalla IA, 2002, Can Med Assoc J, 166, 1029
  2. Meredith KE, 1982, J Med Educ, 57, 743
  3. Nayer M., 1992, Physiother Can, 44, 41
  4. Raghavan M, 2013, Rural Remote Health., 13, 2362

Cited by

See all 139

Metadata

Authors
Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B.
Affiliations
  • University Hospitals of North Midlands NHS Trust (GB)
  • Keele University (GB)
  • University of Tasmania (AU)
  • University of British Columbia (CA)
Corresponding author
Rees, Eliot L.
Venue
Medical Teacher
Published
2016-04-06
Volume
38
Issue
5
Pages
443-455
ISSN
  • 0142-159X (ISSN-L)
  • 1466-187X
OpenAlex
W2329538042
Cited by
139
References
82
Citations by year
2026: 5 · 2025: 9 · 2024: 7 · 2023: 12 · 2022: 16 · 2021: 14 · 2020: 13 · 2019: 20 · 2018: 27 · 2017: 12 · 2016: 4
FWCI
3.10
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Medical Teacher (publishedVersion)
  • PubMed (publishedVersion)
  • ResearchOnline at James Cook University (James Cook University) (acceptedVersion)
  • eCite Digital Repository (University of Tasmania) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
Topics
  • Social Sciences › Education › Medical Education and Admissions
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Gender Studies › Diversity and Career in Medicine
Keywords
multiple mini-interviews, postgraduate admission, medical student selection, pharmacy, predictive validity, face validity, content validity, reliability statistics, examiner training, ethnic prejudice, socioeconomic status, emotional intelligence, personality tests
MeSH terms
Choice Behavior, Education, Medical, Undergraduate, Humans, Interviews as Topic, School Admission Criteria, Databases, Factual, Guidelines as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37. https://app.cochat.ai/papers/10.3109/0142159x.2016.1158799
The paper
Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B. (2016). Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37. Medical Teacher. https://doi.org/10.3109/0142159x.2016.1158799

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.