The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
A Cost Efficiency Comparison Between The Multiple Mini-Interview and Traditional Admissions Interviews
Abstract
A major expense for most professional training programs, both financially and in terms of human resources, is the interview process used to make admissions decisions. Still, most programs view this as a necessary cost given that the personal interview provides an opportunity to recruit potential candidates, showing them what the program has to offer, and to try and gather more information about the candidates to ensure that those selected live up to the espoused values of the institution. We now have five years worth of experience with a Multiple Mini-Interview (MMI) process that, unlike traditional panel interviews, uses the OSCE model to have candidates interact with a larger number of interviewers. We have found that the MMI is more reliable and has better predictive power than our traditional panel interviews. Still, the extent to which any measurement is valuable depends also on the feasibility of use. In this paper we report on an exploration of the cost effectiveness of the MMI as compared to standard panel-based interviews by considering the generation of interview material, human resource (i.e., interviewer and support staff) use, infrastructure requirements, and other miscellaneous expenses. Our conclusion is that the MMI requires greater preparatory efforts and a larger number of rooms to carry out the interviews relative to panel-based interviews, but that these cost disadvantages are offset by the MMI requiring fewer person-hours of effort. The absolute costs wil…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
(2020) · Journal of Medical Education · doi:10.5812/jme · Cited by 3,490
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · cited 2×
“…we have chosen to follow the advice of Dawes who has shown conclusively that actuarial models of decision-making in which a weighting scheme is derived and utilized outperform committee-based decisions in which each file is presented in narrative form and consensus sought (Dawes et al., 1989).”
MethodAssessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509 · cited 1×
“The MMI is an adaptation of the Objective Structured Clinical Evaluation (OSCE)(Harden and Gleeson, 1979) and shares some of its characteristics.”
MethodAn admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617 · cited 9×
“Whereas candidates themselves see only a paragraph of text outlining the focus of each MMI station (see references Eva et al., 2004a, b for examples), assessors are provided with considerably more information.”
BackgroundResultSelf-citationWiesner, W. H., & Cronshaw, S. F. (1988) · Journal of Occupational Psychology · doi:10.1111/j.2044-8325.1988.tb00467.x · Cited by 386 · cited 3×
“The one resource requirement that separates the MMI from less structured personal interviews is that stations must be authored in advance; this difference may be smaller at institutions that have followed the advice to use structured interviews by providing interviewers with specific questions to ask each interviewee…”
BackgroundInfluentialOSCE checklists do not capture increasing levels of expertise
Hodges, B., Regehr, G., McNaughton, N., Tiberius, R., & Hanson, M. (1999) · Academic Medicine · doi:10.1097/00001888-199910000-00017 · Cited by 360 · cited 1×
“Rather, we have adopted the lesson learned from the educational community’s experience with OSCEs that suggests subjective global judgments are as reliable, but more valid than more objective checklist scoring (Hodges et al., 1999).”
MethodValidity of the Medical College Admission Test for predicting medical school performance
Julian, E. R. (2005) · Academic Medicine · doi:10.1097/00001888-200510000-00010 · Cited by 319 · cited 2×
“The number and availability of resulting data points make it relatively easy to measure academic achievement; the predictive capacity of grade point average (GPA)(Kulatunga-Moruzi and Norman, 2002) and aptitude tests like the Medical College Admissions Test (MCAT)(Julian, 2005) makes it wise to do so.”
BackgroundMultiple mini-interviews predict clerkship and licensing examination performance
Reiter, H. I., Eva, K. W., Rosenfeld, J., & Norman, G. R. (2007) · Medical Education · doi:10.1111/j.1365-2929.2007.02709.x · Cited by 235
Self-citationThe ability of the multiple mini-interview to predict preclerkship performance in medical school
Eva, K. W., Reiter, H. I., Rosenfeld, J., & Norman, G. R. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00012 · Cited by 225 · cited 5×
“The MMI, in contrast, has been shown to be more predictive of performance within medical school than traditional interviews (Eva et al., 2004c; Reiter et al. (submitted)).”
BackgroundResultSelf-citationKulatunga Moruzi, C., & Norman, G. R. (2002) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1401_9 · Cited by 179 · cited 2×
“The number and availability of resulting data points make it relatively easy to measure academic achievement; the predictive capacity of grade point average (GPA)( Kulatunga-Moruzi and Norman, 2002 ) and aptitude tests like the Medical College Admissions Test (MCAT)(Julian, 2005) makes it wise to do so.”
Background
Cited by
How effective are selection methods in medical education? A systematic review
Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016) · Medical Education · doi:10.1111/medu.12817 · Cited by 481
Prideaux, D., Roberts, C., Eva, K., Centeno, A., Mccrorie, P., Mcmanus, C., Patterson, F., Powis, D., Tekian, A., & Wilkinson, D. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.551560 · Cited by 221
“2009) and that, while the MMI may require more physical space, it requires fewer planning hours (Rosenfeld et al. 2008).”
BackgroundSelf-citationPau, A., Jeevaratnam, K., Chen, Y. S., Fall, A. A., Khoo, C., & Nadarajah, V. D. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.829912 · Cited by 195
“Therefore the initial preparatory costs to develop the MMI are likely to be high (Rosenfeld et al. 2008).”
BackgroundRees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B. (2016) · Medical Teacher · doi:10.3109/0142159x.2016.1158799 · Cited by 139
Eva, K. W., Reiter, H. I., Rosenfeld, J., Trinh, K., Wood, T. J., & Norman, G. R. (2012) · JAMA · doi:10.1001/jama.2012.36914 · Cited by 130
Self-citation
Metadata
- Authors
- Rosenfeld, J. M., Reiter, H. I., Trinh, K., & Eva, K. W.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Eva, Kevin W.
- Venue
- Advances in Health Sciences Education
- Published
- 2006-09-29
- Volume
- 13
- Issue
- 1
- Pages
- 43-58
- ISSN
- 1382-4996 (ISSN-L)
- 1573-1677
- OpenAlex
- W2006398912
- Cited by
- 88
- References
- 21
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 4 · 2022: 2 · 2021: 5 · 2020: 5 · 2019: 6 · 2018: 6 · 2017: 3 · 2016: 7 · 2015: 10 · 2014: 14 · 2013: 5 · 2012: 7
- FWCI
- 1.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Advances in Health Sciences Education (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Medical Education and Admissions
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- multiple mini-interviews, admission interviews, cost-effectiveness, panel interviews, predictive validity, professional training programs
- MeSH terms
- Humans, Interpersonal Relations, Interviews as Topic, School Admission Criteria, Schools, Medical, Reproducibility of Results, Observer Variation, Models, Educational
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Cost Efficiency Comparison Between The Multiple Mini-Interview and Traditional Admissions Interviews. https://app.cochat.ai/papers/10.1007/s10459-006-9029-z
- The paper
- Rosenfeld, J. M., Reiter, H. I., Trinh, K., & Eva, K. W. (2008). A Cost Efficiency Comparison Between The Multiple Mini-Interview and Traditional Admissions Interviews. Advances in Health Sciences Education. https://doi.org/10.1007/s10459-006-9029-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.