Should Efforts in Favor of Medical Student Diversity Be Focused During Admissions or Farther Upstream?
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
PURPOSE: Traditional medical school admissions assessment tools may be limiting diversity. This study investigates whether the Multiple Mini-Interview (MMI) is diversity-neutral and, if so, whether applying it with greater weight would dilute the anticipated negative impact of diversity-limiting admissions measures. METHOD: Interviewed applicants to six medical schools in 2008 and 2009 underwent MMI. Predictor variables of MMI scores, grade point average (GPA), and Medical College Admission Test (MCAT) scores were correlated with diversity measures of age, gender, size of community of origin, income level, and self-declared aboriginal status. A subset of the data was then combined with variable weight assigned to predictor variables to determine whether weighting during the applicant selection process would affect diversity among chosen applicants. RESULTS: MMI scores were unrelated to gender, size of community of origin, and income level. They correlated positively with age and negatively with aboriginal status. GPA and MCAT correlated negatively with age and aboriginal status, GPA correlated positively with income level, and MCAT correlated positively with size of community of origin. Even extreme combinations of MMI and GPA weightings failed to increase diversity among applicants who would be selected on the basis of weighted criteria. CONCLUSIONS: MMI could not neutralize the diversity-limiting properties of academic scores as selection criteria to interview. Using academic scores in this way causes range restriction, counteracting attempts to enhance diversity using downstream admissions selection measures such as MMI. Diversity efforts should instead be focused upstream. These results lend further support for the development of pipeline programs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There was a positive correlation between MMI scores and age (P < 0.05); the correlation was neutral with respect to gender, size of community of origin and income level, and there was a negative correlation (P < 0.05) for those with self-declared aboriginal status.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Reiter H. I. et al., (67) 2012
In the citing paper
“GPA and MCAT correlated negatively with age and aboriginal status, GPA correlated positively with income level, and MCAT correlated positively with size of community of origin.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Reiter H. I. et al., (67) 2012
Citations
Cites
Ecological Correlations and the Behavior of Individuals
Robinson, W. S. (1950) · American Sociological Review · doi:10.2307/2087176 · Cited by 4,513
Assessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617
Self-citationValidity of the Medical College Admission Test for predicting medical school performance
Julian, E. R. (2005) · Academic Medicine · doi:10.1097/00001888-200510000-00010 · Cited by 319
Predictive validity of the multiple mini-interview for selecting medical trainees
Eva, K. W., Reiter, H. I., Trinh, K., Wasi, P., Rosenfeld, J., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03407.x · Cited by 267
Self-citationMultiple mini-interviews predict clerkship and licensing examination performance
Reiter, H. I., Eva, K. W., Rosenfeld, J., & Norman, G. R. (2007) · Medical Education · doi:10.1111/j.1365-2929.2007.02709.x · Cited by 235
Self-citationEvaluating the Predictive Validity of MCAT Scores across Diverse Applicant Groups
Koenig, J. A., Sireci, S. G., & Wiley, A. (1998) · Academic Medicine · doi:10.1097/00001888-199810000-00021 · Cited by 106
Hofmeister, M., Lockyer, J., & Crutcher, R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03380.x · Cited by 73
Self-citationZiv, A., Rubin, O., Moshinsky, A., Gafni, N., Kotler, M., Dagan, Y., Lichtenberg, D., Mekori, Y. A., & Mittelman, M. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03161.x · Cited by 72
Non-association between Neo-5 personality tests and multiple mini-interview
Kulasegaram, K., Reiter, H. I., Wiesner, W., Hackett, R. D., & Norman, G. R. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9209-8 · Cited by 41
Self-citation
Research works printed but not linked: 1
- Harden, 1979, Med Educ, 13, 41
Cited by
Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B. (2016) · Medical Teacher · doi:10.3109/0142159x.2016.1158799 · Cited by 139
“Uijtdehaage et al. (2011) found no difference in MMI score for (self-reported) economically disadvantaged applicants; findings from Reiter et al. (2012) corroborate this.”
BackgroundResultInfluentialPuddey, I. B., Playford, D. E., & Mercer, A. (2017) · BMC Medical Education · doi:10.1186/s12909-016-0842-7 · Cited by 132
“In a Canadian study of entrants to 6 medical schools [32] the addition of a multiple mini-interview score and the score from the Medical College Admission Test failed to neutralise the diversity limiting effect of selection based on the grade point average from previous tertiary studies.”
2018 Ottawa consensus statement: Selection and recruitment to the healthcare professions
Patterson, F., Roberts, C., Hanson, M. D., Hampe, W., Eva, K. W., Ponnamperuma, G. G., Magzoub, M. E., Tekian, A. S., & Cleland, J. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1498589 · Cited by 141
Self-citationMultiple mini-interviews: same concept, different approaches
Knorr, M., & Hissbach, J. (2014) · Medical Education · doi:10.1111/medu.12535 · Cited by 110
“…MCAT Verbal r = 0.10 (NS) Jerant et al. (2012)45,‡ University of California Davis, USA (Med) 2010–2011 MCAT Verbal b = 0.44 (p = 0.03) MCAT Physical b = 0.22 (p = 0.31) MCAT Biological b = 0.34 (p = 0.13) Reiter et al. (2012)9 Canada (6 different universities) (Med) 2008–2009 MCAT Overall r…”
BackgroundInfluentialThe interaction of socio‐economic status and gender in widening participation in medicine
Griffin, B., & Hu, W. C. Y. (2014) · Medical Education · doi:10.1111/medu.12480 · Cited by 106
Wouters, A., Croiset, G., Isik, U., & Kusurkar, R. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014779 · Cited by 93
Predicting academic outcomes in an Australian graduate entry medical programme
Puddey, I. B., & Mercer, A. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-31 · Cited by 65
Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review
Yusoff, M. S. B. (2019) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2019.03.006 · Cited by 57
Lessons learned from 15 years of non‐grades‐based selection for medical school
Stegers‐Jager, K. M. (2017) · Medical Education · doi:10.1111/medu.13462 · Cited by 68
Addressing the Diversity–Validity Dilemma Using Situational Judgment Tests
Juster, F. R., Baum, R. C., Zou, C., Risucci, D. A., Ly, A. T., Reiter, H., Miller, D. D., & Dore, K. L. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002769 · Cited by 67
Self-citationMedical student selection criteria as predictors of intended rural practice following graduation
Puddey, I. B., Mercer, A., Playford, D. E., Pougnault, S., & Riley, G. J. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-218 · Cited by 44
Mian, O., Hogenbirk, J. C., Marsh, D. C., Prowse, O., Cain, M., & Warry, W. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002636 · Cited by 42
Puddey, I. B., & Mercer, A. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-155 · Cited by 42
Ethnic and social disparities in performance on medical school selection criteria
Stegers‐Jager, K. M., Steyerberg, E. W., Lucieer, S. M., & Themmen, A. P. N. (2014) · Medical Education · doi:10.1111/medu.12536 · Cited by 43
Terregino, C. A., McConnell, M., & Reiter, H. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000960 · Cited by 44
Self-citationHenderson, M. C., Kelly, C., Griffin, E., Hall, T. R., Jerant, A. F., Peterson, E. M., Rainwater, J. A., Sousa, F. J., Wofsy, D., & Franks, P. J. (2017) · Academic Medicine · doi:10.1097/acm.0000000000002041 · Cited by 43
Simone, K., Ahmed, R. A., Konkin, J., Campbell, S., Hartling, L., & Oswald, A. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1473562 · Cited by 37
Diversity of the physician workforce: Specialty choice decisions during medical school
Burkhardt, J., DesJardins, S. L., & Gruppen, L. D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259434 · Cited by 38
Impact of sociodemographic characteristics of applicants in multiple mini-interviews
Leduc, J., Rioux, R., Gagnon, R. J., Bourdy, C., & Dennis, A. A. (2016) · Medical Teacher · doi:10.1080/0142159x.2017.1270431 · Cited by 38
“These included East, South and Southeast Asia as “Asia” (Office of Minority Health – U.S. Department of Health and Human Services 2014), North Africa and Middle East, which are traditionally associated with people of Arab origins (Asi & Beaulieu 2013), Europe, and North America.”
BackgroundMethodInfluentialTwelve tips for constructing a multiple mini-interview
Eva, K. W., Macala, C., & Fleming, B. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1429586 · Cited by 27
Self-citationReiter, H., & Eva, K. W. (2017) · Academic Medicine · doi:10.1097/acm.0000000000002042 · Cited by 24
Self-citationWidening participation in medicine: what, why and how?
Patterson, R. R., & Price, J. (2017) · MedEdPublish · doi:10.15694/mep.2017.000184 · Cited by 30
“Initiatives aimed at WP may be ‘ too late ’ when aimed at application processes, however ensuring WP applicants who do apply for medicine are not disadvantaged by the process is essential (Brown & Garlick, 2006; O ’ Neill et al., 2013; Reiter et al., 2012).”
BackgroundAdmissions experiences of aspiring physicians from low‐income backgrounds
Freitas, C. D., Buckley, R., Klimo, R., Daniel, J. M., Mountjoy, M. L., & Vanstone, M. G. (2021) · Medical Education · doi:10.1111/medu.14462 · Cited by 27
Diversity Efforts, Admissions, and National Rankings: Can We Align Priorities?
Heller, C. A., Rúa, S. M. H., Mazumdar, M., Moon, J. E., Bardes, C. L., & Gotto, A. M. (2014) · Teaching and Learning in Medicine · doi:10.1080/10401334.2014.910465 · Cited by 27
Multiple mini-interview scores of medical school applicants with and without rural attributes
Raghavan, M., Martin, B., Burnett, M., Aoki, F., Christensen, H., MacKalski, B., Young, D., & Ripstein, I. (2013) · Rural and Remote Health · doi:10.22605/rrh2362 · Cited by 21
The influence of income on medical school admissions in Canada: a retrospective cohort study
Pitre, T., Thomas, A. W., Evans, K., Jones, A., Mountjoy, M. L., & Costa, A. P. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02126-0 · Cited by 28
“keeping with an established literature that success in these exams correlates with income [14, 15].”
BackgroundMultiple Mini Interviews for Selection of Dental Students: Influence of Gender and Starting Station
Barbour, M. E., & Sandy, J. R. (2014) · Journal of Dental Education · doi:10.1002/j.0022-0337.2014.78.4.tb05710.x · Cited by 19
Is Canada Ready for Nationwide Collaboration on Medical School Admissions Practices and Policies?
Hanson, M. D., Moineau, G., Kulasegaram, K., & Hammond, R. R. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001286 · Cited by 19
Knorr, M., Meyer, H., Sehner, S., Hampe, W., & Zimmermann, S. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1674-z · Cited by 18
Affirmative action programmes in postgraduate medical and surgical training—A narrative review
Koea, J., Rahiri, J., & Ronald, M. (2020) · Medical Education · doi:10.1111/medu.14350 · Cited by 15
Kulasegaram, K. M., Grierson, L., Barber, C., Chahine, S., Chou, F. C., Cleland, J., Ellis, R., Holmboe, E. S., Pusic, M. V., Schumacher, D. J., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2023.2298762 · Cited by 17
“Tremendous research benefit is gained by creating big data through linkages of smaller data sets held by various programs or organizations (Reiter et al. 2012; O’Mara et al. 2015; Grierson et al. 2017; Schumacher et al. 2020).”
BackgroundKelly, M., & O’Flynn, S. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9728-z · Cited by 14
“This is similar to gender patterns with UKCAT (James et al. 2010; Lambe et al. 2012; Tiffin et al. 2012, 2014), GAMSAT (Puddey and Mercer 2014), MCAT (Collin et al. 278 M. E. Kelly, S. O’Flynn 2009), UMAT (Puddey and Mercer 2013) and BMAT (Emery et al. 2011).”
MethodInfluentialMultiple mini-interviews as a selection tool for initial teacher education admissions
Metsäpelto, R., Utriainen, J., Poikkeus, A., Muotka, J. S., Tolvanen, A. J., & Warinowski, A. (2022) · Teaching and Teacher Education · doi:10.1016/j.tate.2022.103660 · Cited by 27
Does the Multiple Mini-Interview Address Stakeholder Needs? An Applicant's Perspective
Phillips, A. W., & Garmel, G. M. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.01.021 · Cited by 11
Evidence-Based Practices for Interviewing Graduate Medical Education Applicants: A Systematic Review
Lin, J. C. H., Hu, D. J., Scott, I. U., & Greenberg, P. B. (2024) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-23-00115.1 · Cited by 9
Ellison, H. B., Grabowski, C. J., Schmude, M., Costa, J. B., Naemi, B., Schmidt, M., Patel, D., & Westervelt, M. J. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005548 · Cited by 10
Baker, K. D., Sabo, R., Rawls, M., Feldman, M., & Santen, S. A. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1687867 · Cited by 8
“…are also inconsistent; while some studies have found female applicants receive more favorable scores on the MMI (Harris and Owen 2007; Leduc et al. 2017; Ross et al. 2017), others have found no gender effect (Hecker et al. 2009; O’Brien et al. 2011; Uijtdehaage et al. 2011; Reiter et al. 2012).”
ResultBurkhardt, J., DesJardins, S. L., Teener, C. A., Gay, S. E., & Santen, S. A. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001188 · Cited by 8
Shipeolu, L., Matthieu, J., Mahmood, F., & Okafor, I. (2020) · Canadian Medical Education Journal · doi:10.36834/cmej.70616 · Cited by 7
Kratzke, I. M., Kapadia, M. R., Egawa, F., & Beaty, J. S. (2021) · Surgical Clinics of North America · doi:10.1016/j.suc.2021.05.010 · Cited by 8
Performance of Black and Indigenous applicants in a medical school admissions process
Girgulis, K., Rideout, A. L., & Rashid, M. (2021) · Canadian Medical Education Journal · doi:10.36834/cmej.72121 · Cited by 7
“11 Thus, efforts to increase URIM enrolment may need to be further “upstream” in the medical school admissions process, such as recruiting a greater number of diverse applicants.”
Brisebois, N., & Cardinal, N. (2024) · Canadian Medical Association Journal · doi:10.1503/cmaj.231272 · Cited by 7
Gender Might Be Factor for Student Admission in Two Brazilian Medical Schools
Beraldi, G. H., Filho, J. C. G., Nunes, M. D. P. T., & Gannam, S. (2015) · Revista Brasileira de Educação Médica · doi:10.1590/1981-52712015v39n2e00162014 · Cited by 3
Evidence of Differential Attainment in Canadian Medical School Admissions: A Scoping Review
Ngo, T.-A., Choi, J., McIntosh, A., Elma, A., & Grierson, L. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005836 · Cited by 4
Parsons, W. L., McHugh, J., & Yi, Y. (2018) · MedEdPublish · doi:10.15694/mep.2018.0000272.1 · Cited by 4
Interviews, Multiple Mini-Interviews, and Selection Centers
Knorr, M., Hissbach, J. C., & Hampe, W. (2018) · Springer eBooks · doi:10.1007/978-3-319-94971-0_5 · Cited by 6
Demographic disparities in dental school selection: An analysis of current UK practices
Cunningham, C., Kiezebrink, K., Greatrix, R., Patterson, F., & Vieira, R. (2023) · European Journal Of Dental Education · doi:10.1111/eje.12914 · Cited by 4
Mahmood, F., Oguntala, J. O., Henoud, C., Pierre-Louis, L. L., Fuad, A., & Okafor, I. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04004-x · Cited by 3
Sabesan, V., Young, L., Carlisle, K., Vangaveti, V., Vu, T., Erp, A. V., & Kapur, N. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2195969 · Cited by 3
Kliska, E., MacLean, A., & Farrugia, P. (2024) · Canadian Medical Education Journal · doi:10.36834/cmej.75199 · Cited by 3
“13,54,55 Subsequently altering the weighting of admission tools later in the process to reduce their disadvantage to underrepresented groups misses the plot; 13 by using minimum admission requirements, a large number of applicants have self-selected out of the running by the time…”
BackgroundMultiple Mini Interview as a Selection Tool for Initial Teacher Education AdmissionsPreprint
Metsäpelto, R., Utriainen, J., Poikkeus, A., Muotka, J. S., Tolvanen, A. J., & Warinowski, A. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ph5t8 · Cited by 2
The Experience of Using CASPer at One College of Veterinary Medicine in the United States
Raghavan, M., Salisbury, S., Weisman, J. L., & Stout, L. (2025) · Journal of Veterinary Medical Education · doi:10.3138/jvme-2024-0136 · Cited by 1
The Predictive Validity of Pre-Admission Measures on Podiatric Medical School Performance
Smith, K. M. (2014) · Lincoln (University of Nebraska) · Cited by 2
Medical University admission test: a confirmatory factor analysis of the results
Luschin-Ebengreuth, M., Dimai, H. P., Ithaler, D., Neges, H. M., & Reibnegger, G. J. (2015) · Wiener klinische Wochenschrift · doi:10.1007/s00508-015-0911-7 · Cited by 3
Sullivan, G. (2015) · OpenSIUC (Southern Illinois University Carbondale)
Brisebois, N., & Cardinal, N. (2024) · Canadian Medical Association Journal · doi:10.1503/cmaj.231272-f
Leveling the playing field: evaluating measurement equivalence in MMIs between genders
Szkwara, J. M., Bannatyne, A. J., Asıl, M., Craig, B. M., Stokes-Parish, J. B., & Bishop, J. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1639532
A Foucauldian reading of the multiple mini-interview tool used in Canadian physiotherapy admissions
Otubusen, O., & Thille, P. (2025) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2025.2571798 · Cited by 1
“It was created in 2001 (Reiter et al., 2012) and first implemented in 2004 at Canada’s McMaster University School of Medicine (Eva, Rosenfeld, Reiter, and Norman, 2004).”
Pitre, T., Thomas, A., Evans, K., Jones, A., Mountjoy, M. L., & Costa, A. P. (2020) · Figshare · doi:10.6084/m9.figshare.12599370
Kiani, H., Wadhwani, A., D’Mello, K., Ngungu, J., de Ribaupierre, S., Kim, G., & Kirpalani, A. (2026) · Medical Science Educator · doi:10.1007/s40670-026-02740-5
Kwong, Z., Patel, E., Kona, C. R., Bahierathan, K., Rodio, L. A., Morrison, S. L., Bena, J., & Yepes-Rios, M. (2026) · Journal of the National Medical Association · doi:10.1016/j.jnma.2026.06.003
Metadata
- Authors
- Reiter, H. I., Lockyer, J., Ziola, B., Courneya, C.-A., & Eva, K.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Reiter, Harold I.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-04
- Volume
- 87
- Issue
- 4
- Pages
- 443-448
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2033344238
- Cited by
- 61
- References
- 14
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 6 · 2023: 4 · 2022: 1 · 2021: 4 · 2020: 5 · 2019: 5 · 2018: 5 · 2017: 6 · 2016: 5 · 2015: 4 · 2014: 9 · 2013: 2
- FWCI
- 4.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Medical Education and Admissions
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- medical school admissions, multiple mini-interviews, range restriction, applicant selection, pipeline programs, socioeconomic status, gender diversity, grade point average, MCAT scores
- MeSH terms
- Canada, College Admission Test, Female, Humans, Interviews as Topic, Male, School Admission Criteria, Schools, Medical, Students, Medical, Cultural Diversity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.