The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37
Open accessAbstract
BACKGROUND: In the 11 years since its development at McMaster University Medical School, the multiple mini-interview (MMI) has become a popular selection tool. We aimed to systematically explore, analyze and synthesize the evidence regarding MMIs for selection to undergraduate health programs. METHODS: The review protocol was peer-reviewed and prospectively registered with the Best Evidence Medical Education (BEME) collaboration. Thirteen databases were searched through 34 terms and their Boolean combinations. Seven key journals were hand-searched since 2004. The reference sections of all included studies were screened. Studies meeting the inclusion criteria were coded independently by two reviewers using a modified BEME coding sheet. Extracted data were synthesized through narrative synthesis. RESULTS: A total of 4338 citations were identified and screened, resulting in 41 papers that met inclusion criteria. Thirty-two studies report data for selection to medicine, six for dentistry, three for veterinary medicine, one for pharmacy, one for nursing, one for rehabilitation, and one for health science. Five studies investigated selection to more than one profession. MMIs used for selection to undergraduate health programs appear to have reasonable feasibility, acceptability, validity, and reliability. Reliability is optimized by including 7-12 stations, each with one examiner. The evidence is stronger for face validity, with more research needed to explore content validity and predictive validity. In published studies, MMIs do not appear biased against applicants on the basis of age, gender, or socio-economic status. However, applicants of certain ethnic and social backgrounds did less well in a very small number of published studies. Performance on MMIs does not correlate strongly with other measures of noncognitive attributes, such as personality inventories and measures of emotional intelligence. DISCUSSION: MMI does not automatically mean a more reliable selection process but it can do, if carefully designed. Effective MMIs require careful identification of the noncognitive attributes sought by the program and institution. Attention needs to be given to the number of stations, the blueprint and examiner training. CONCLUSION: More work is required on MMIs as they may disadvantage groups of certain ethnic or social backgrounds. There is a compelling argument for multi-institutional studies to investigate areas such as the relationship of MMI content to curriculum domains, graduate outcomes, and social missions; relationships of applicants' performance on different MMIs; bias in selecting applicants of minority groups; and the long-term outcomes appropriate for studies of predictive validity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The multiple mini interview (MMI) format has been widely adopted in medical school admissions and can assess a range of nonacademic skills, such as communication, ethical reasoning, teamwork, and empathy [1-5].”
From AI-Generated Multiple Mini Interview (MMI) Stations for Medical School Admissions: Psychometric Evaluation (2026) · cites this paper as [4]
In the citing paper
“The latest article included in the systemic review was in 2014”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as [7]
In the citing paper
“but applicants of certain ethnic and social backgrounds demonstrated low performance in a very small number of published studies.7”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as [7]
In the citing paper
“it only focused on the utility of MMI in health profession education.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as [7]
In the citing paper
“A recent systematic review revealed that MMIs used for the selection of undergraduate health programs appear to have reasonable feasibility, acceptability, validity, and reliability.7”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as [7]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Salovey, P., & Mayer, J. D. (1990) · Imagination, Cognition and Personality · doi:10.2190/dugg-p24e-52wk-6cdg · Cited by 10,484
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,299
Standards for Educational and Psychological Testing.
García, E. J. (2017) · Revista Española de Pedagogía · doi:10.22550/2174-0909.3051 · Cited by 2,217
Diversity and Higher Education: Theory and Impact on Educational Outcomes
Gurin, P., Dey, E., Hurtado, S., & Gurin, G. (2002) · Harvard Educational Review · doi:10.17763/haer.72.3.01151786u134n051 · Cited by 1,975 · cited 1×
“This diversity has been shown to increase learning, change attitudes, and increase health care provision over time to underserved populations (Gurin et al. 2002; Whitla et al. 2003).”
BackgroundThe assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
A contemplated revision of the NEO Five-Factor Inventory
McCrae, R. R., & Costa, P. T. (2004) · Personality and Individual Differences · doi:10.1016/s0191-8869(03)00118-1 · Cited by 1,153
TRAINING AND DEVELOPMENT HANDBOOK.
Craig, R. L., & Bittel, L. R. (1967) · CERN Document Server (European Organization for Nuclear Research) · Cited by 926
Liaison Committee on Medical Education: Past Successes, Future Challenges
Schwarz, M. R. (1992) · JAMA · doi:10.1001/jama.1992.03490090033010 · Cited by 916
Reeves, M. (1993) · Cited by 903
Research works printed but not linked: 4
- Dhalla IA, 2002, Can Med Assoc J, 166, 1029
- Meredith KE, 1982, J Med Educ, 57, 743
- Nayer M., 1992, Physiother Can, 44, 41
- Raghavan M, 2013, Rural Remote Health., 13, 2362
Cited by
Medical student wellbeing – a consensus statement from Australia and New Zealand
Kemp, S., Hu, W. C. Y., Bishop, J., Forrest, K., Hudson, J. N., Wilson, I. G., Teodorczuk, A., Rogers, G. D., Roberts, C., & Wearn, A. M. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1505-2 · Cited by 100
What we measure … and what we should measure in medical education
Boulet, J. R., & Durning, S. J. (2018) · Medical Education · doi:10.1111/medu.13652 · Cited by 80
Knowledge syntheses in medical education: A bibliometric analysis
Maggio, L. A., Costello, J. A., Norton, C. J., Driessen, E. W., & Artino, A. R. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00626-9 · Cited by 96
The UK medical education database (UKMED) what is it? Why and how might you use it?
Dowell, J. S., Cleland, J., Fitzpatrick, S., McManus, I. C., Nicholson, S., Oppé, T. E., Petty-Saphon, K., King, O. S., Smith, D. T., Thornton, S., et al. (2018) · BMC Medical Education · doi:10.1186/s12909-017-1115-9 · Cited by 65
Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review
Yusoff, M. S. B. (2019) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2019.03.006 · Cited by 57
Metadata
- Authors
- Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B.
- Affiliations
- University Hospitals of North Midlands NHS Trust (GB)
- Keele University (GB)
- University of Tasmania (AU)
- University of British Columbia (CA)
- Corresponding author
- Rees, Eliot L.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2016-04-06
- Volume
- 38
- Issue
- 5
- Pages
- 443-455
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2329538042
- Cited by
- 139
- References
- 82
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 7 · 2023: 12 · 2022: 16 · 2021: 14 · 2020: 13 · 2019: 20 · 2018: 27 · 2017: 12 · 2016: 4
- FWCI
- 3.10
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- Locations
- Medical Teacher (publishedVersion)
- PubMed (publishedVersion)
- ResearchOnline at James Cook University (James Cook University) (acceptedVersion)
- eCite Digital Repository (University of Tasmania) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Medical Education and Admissions
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- multiple mini-interviews, postgraduate admission, medical student selection, pharmacy, predictive validity, face validity, content validity, reliability statistics, examiner training, ethnic prejudice, socioeconomic status, emotional intelligence, personality tests
- MeSH terms
- Choice Behavior, Education, Medical, Undergraduate, Humans, Interviews as Topic, School Admission Criteria, Databases, Factual, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37. https://app.cochat.ai/papers/10.3109/0142159x.2016.1158799
- The paper
- Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B. (2016). Evidence regarding the utility of multiple mini-interview (MMI) for selection to undergraduate health programs: A BEME systematic review: BEME Guide No. 37. Medical Teacher. https://doi.org/10.3109/0142159x.2016.1158799
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.