The Reliability and Acceptability of the Multiple Mini-Interview as a Selection Instrument for Postgraduate Admissions
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Background The Multiple Mini-Interview (MMI) is useful in selecting undergraduate medical trainees. Postgraduate applicant pools have smaller numbers of more homogeneous candidates that must be actively recruited while being assessed. This paper reports on the MMI's use in assessing residency candidates. Method Canadian and international medical graduates to three residency programs--obstetrics-gynecology and pediatrics (McMaster University) and internal medicine (University of Alberta)--underwent the MMI for residency selection (n = 484) in 2008 and 2009. Reliability was determined and candidates and interviewers completed an exit survey assessing acceptability. Results Overall reliability of the MMI was acceptable, ranging from 0.55 to 0.72. Using 10 stations would increase reliability to 0.64-0.79. Eighty-eight percent of candidates believed they could accurately portray themselves, while 90% of interviewers believed they could reasonably judge candidates' abilities. Conclusions The MMI provides a reliable way to assess residency candidates that is acceptable to both candidates and assessors across a variety of programs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Estimating overall reliability for 10-station, the range of reliability would increase to 0.64–0.79”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Dore K. L. et al., (25) 2010
In the citing paper
“77% indicated that specialized medical knowledge was not needy to complete the stations.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Dore K. L. et al., (25) 2010
In the citing paper
“While 90% of interviewers believed they could reasonably judge candidates' abilities.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Dore K. L. et al., (25) 2010
In the citing paper
“88% candidates believed they could accurately portray themselves during the MMI”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Dore K. L. et al., (25) 2010
In the citing paper
“Overall reliability of the 7-station MMI across all years and program was at least moderately acceptable, 0.55–0.72”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Dore K. L. et al., (25) 2010
Citations
Cites
Assessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617
Self-citationPredictive validity of the multiple mini-interview for selecting medical trainees
Eva, K. W., Reiter, H. I., Trinh, K., Wasi, P., Rosenfeld, J., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03407.x · Cited by 267
Self-citationThe ability of the multiple mini-interview to predict preclerkship performance in medical school
Eva, K. W., Reiter, H. I., Rosenfeld, J., & Norman, G. R. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00012 · Cited by 225
Self-citationChanges in students' moral development during medical school: a cohort study.
Patenaude, J., Niyonsenga, T., & Fafard, D. (2003) · PubMed · Cited by 207
Assessment of empathy in different years of internal medicine training
Mangione, S., Kane, G. C., Caruso, J. W., Gonnella, J. S., Nasca, T. J., & Hojat, M. (2002) · Medical Teacher · doi:10.1080/01421590220145725 · Cited by 112
The relationship between criteria used to select residents and performance during residency
Papp, K. K., Polk, H. C., & David Richardson, J. (1997) · The American Journal of Surgery · doi:10.1016/s0002-9610(96)00389-3 · Cited by 78
Resident selection: applicant selection criteria compared with performance.
Erlandson, E. E., Calhoun, J. G., Barrack, F. M., Hull, A. L., Youmans, L. C., Davis, W. K., & Bartlett, R. H. (1982) · PubMed · Cited by 57
Preferences of program directors for evaluation of candidates for postgraduate training.
Provan, J. L., & Cuttress, L. A. (1995) · Europe PMC (PubMed Central) · Cited by 52
Hojat, M., Gonnella, J. S., Veloski, J. J., & Erdmann, J. B. (1993) · Academic Medicine · doi:10.1097/00001888-199302000-00035 · Cited by 44
Research works printed but not linked: 5
- &NA;, 1996, Ann R Coll Physicians Surg Can, 29, 206
- Patenaude, 2003, CMAJ, 168, 840
- Provan, 1995, CMAJ, 153, 919
- Erlandson, 1982, Surgery, 92, 270
- Harden, 1979, Med Educ, 13, 41
Cited by
How effective are selection methods in medical education? A systematic review
Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016) · Medical Education · doi:10.1111/medu.12817 · Cited by 481
Daniel, M., Gordon, M., Patricio, M., Hider, A., Pawlik, C., Bhagdev, R., Ahmad, S., Alston, S., Park, S., Pawlikowska, T., et al. (2021) · Medical Teacher · doi:10.1080/0142159x.2020.1864310 · Cited by 246
“multiple mini-interviews and situational judgement tests) (Dore et al. 2010; Patterson et al. 2016).”
BackgroundPau, A., Jeevaratnam, K., Chen, Y. S., Fall, A. A., Khoo, C., & Nadarajah, V. D. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.829912 · Cited by 195
Use of the Interview in Resident Candidate Selection: A Review of the Literature
Stephenson-Famy, A., Houmard, B. S., Oberoi, S., Manyak, A., Chiang, S., & Kim, S. (2015) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-14-00236.1 · Cited by 166
Multiple mini-interviews: same concept, different approaches
Knorr, M., & Hissbach, J. (2014) · Medical Education · doi:10.1111/medu.12535 · Cited by 110
Metadata
- Authors
- Dore, K. L., Kreuger, S., Ladhani, M., Rolfson, D., Kurtz, D., Kulasegaram, K., Cullimore, A. J., Norman, G. R., Eva, K. W., Bates, S., & Reiter, H. I.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Dore, Kelly L.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-10
- Volume
- 85
- Issue
- 10 Suppl
- Pages
- S60-S63
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W1999444165
- Cited by
- 98
- References
- 15
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 6 · 2023: 7 · 2022: 3 · 2021: 8 · 2020: 10 · 2019: 6 · 2018: 9 · 2017: 4 · 2016: 12 · 2015: 9 · 2014: 10 · 2013: 7 · 2012: 1
- FWCI
- 3.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Medical Education and Admissions
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- multiple mini-interviews, residency selection, graduate medical education, interview reliability, acceptability, international medical graduates, interviewer perceptions, self-presentation, obstetrics and gynecology residency, pediatric residency, internal medicine residency
- MeSH terms
- Adult, Alberta, College Admission Test, Decision Making, Education, Medical, Graduate, Female, Foreign Medical Graduates, Gynecology, Humans, Internship and Residency, Interview, Psychological, Interviews as Topic, Male, Obstetrics, Pediatrics, Professional Competence, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Reliability and Acceptability of the Multiple Mini-Interview as a Selection Instrument for Postgraduate Admissions. https://app.cochat.ai/papers/10.1097/acm.0b013e3181ed442b
- The paper
- Dore, K. L., Kreuger, S., Ladhani, M., Rolfson, D., Kurtz, D., Kulasegaram, K., Cullimore, A. J., Norman, G. R., Eva, K. W., Bates, S., & Reiter, H. I. (2010). The Reliability and Acceptability of the Multiple Mini-Interview as a Selection Instrument for Postgraduate Admissions. Academic Medicine. https://doi.org/10.1097/acm.0b013e3181ed442b
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.