Validity evidence of a multiple mini interview for selection of medical students: universiti sains Malaysia experience
Open accessAbstract
Introduction: Student selection is important for selecting the best candidates into medical courses.The Multiple Mini Interview (MMI) is a valid selection tool for the task.The School of Medical Sciences (SMS), Universiti Sains Malaysia (USM) has employed MMI as a medical admission tool to select potential candidates into its medical program.Objective: This paper described the implementation of the MMI and reported the preliminary evaluation data on its validity evidence.Method: A 9-station MMI (with 5 manned and 4 rest stations) was employed for the 2015 student selection exercise.Interview data were analysed and questionnaire surveys were administered to both interviewers and candidates.Validity, reliability, feasibility and acceptability were determined.Results: Unidimensional construct on confirmatory factor analysis (CFA) and interviewer comments provided evidence of construct validity.Overall reliability was 0.94, good enough for high-stakes decisions.Interviewers and candidates' comments on feasibility and acceptability were also generally positive.The consistency of the difficulty and discrimination indices of similar stations between sessions was identified as among the areas for improvement.Conclusions: We are cautiously optimistic regarding the utility of the MMI in the SMS; future improvements are planned but the present implementation seems sufficient for the stated purposes.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314 · see citing works
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190 · see citing works
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200 · see citing works
Hanrahan, G. (2008) · CRC Press eBooks · doi:10.1201/9781420067972-10 · Cited by 8,196 · see citing works
Marsh, H. W., & Hocevar, D. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.3.562 · Cited by 3,419 · see citing works
A New Incremental Fit Index for General Structural Equation Models
Bollen, K. A. (1989) · Sociological Methods & Research · doi:10.1177/0049124189017003004 · Cited by 3,008 · see citing works
Streiner, D. L., & Norman, G. R. (2008) · doi:10.1093/acprof:oso/9780199231881.001.0001 · Cited by 2,631 · see citing works
The Egyptian Labor Market in an Era of RevolutionPreprint
Assaad, R. A., & Krafft, C. (2015) · RePEc: Research Papers in Economics · doi:10.1093/acprof · Cited by 2,454 · see citing works
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434 · see citing works
Reliability: on the reproducibility of assessment data
Downing, S. M. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01932.x · Cited by 721 · see citing works
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617 · see citing works
Assessing Personal Qualities in Medical School Admissions
Albanese, M. A., Snow, M. H., Skochelak, S. E., Huggett, K. N., & Farrell, P. M. (2003) · Academic Medicine · doi:10.1097/00001888-200303000-00016 · Cited by 335 · see citing works
Assessment in Health Professions Education
Downing, S. M., & Yudkowsky, R. (2009) · Routledge eBooks · doi:10.4324/9780203880135 · Cited by 328 · see citing works
Predictive validity of the multiple mini-interview for selecting medical trainees
Eva, K. W., Reiter, H. I., Trinh, K., Wasi, P., Rosenfeld, J., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03407.x · Cited by 267 · see citing works
Multiple mini-interviews predict clerkship and licensing examination performance
Reiter, H. I., Eva, K. W., Rosenfeld, J., & Norman, G. R. (2007) · Medical Education · doi:10.1111/j.1365-2929.2007.02709.x · Cited by 235 · see citing works
The ability of the multiple mini-interview to predict preclerkship performance in medical school
Eva, K. W., Reiter, H. I., Rosenfeld, J., & Norman, G. R. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00012 · Cited by 225 · see citing works
Pau, A., Jeevaratnam, K., Chen, Y. S., Fall, A. A., Khoo, C., & Nadarajah, V. D. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.829912 · Cited by 195 · see citing works
Eva, K. W., Reiter, H. I., Rosenfeld, J., Trinh, K., Wood, T. J., & Norman, G. R. (2012) · JAMA · doi:10.1001/jama.2012.36914 · Cited by 130 · see citing works
Eva, K. W., Reiter, H., Rosenfeld, J. M., & Norman, G. R. (2004) · Academic Medicine · doi:10.1097/00001888-200406000-00021 · Cited by 112 · see citing works
Dore, K. L., Kreuger, S., Ladhani, M., Rolfson, D., Kurtz, D., Kulasegaram, K., Cullimore, A. J., Norman, G. R., Eva, K. W., Bates, S., et al. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed442b · Cited by 98 · see citing works
Rosenfeld, J. M., Reiter, H. I., Trinh, K., & Eva, K. W. (2008) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9029-z · Cited by 88 · see citing works
The multiple mini-interview in the UK context: 3 years of experience at Dundee
Dowell, J., Lynch, B., Till, H., Kumwenda, B., & Husbands, A. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652706 · Cited by 74 · see citing works
Hofmeister, M., Lockyer, J., & Crutcher, R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03380.x · Cited by 73 · see citing works
Brownell, K., Lockyer, J., Collin, T., & Lemay, J.-F. (2007) · Medical Teacher · doi:10.1080/01421590701311713 · Cited by 72 · see citing works
Where Judgement Fails: Pitfalls in the Selection Process for Medical Personnel
Eva, K. W., & Reiter, H. (2004) · Advances in Health Sciences Education · doi:10.1023/b:ahse.0000027479.14637.6c · Cited by 64 · see citing works
Cameron, A. J., & MacKeigan, L. D. (2012) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe76110 · Cited by 63 · see citing works
Reiter, H. I., Salvatori, P., Rosenfeld, J., Trinh, K., & Eva, K. W. (2006) · Medical Education · doi:10.1111/j.1365-2929.2005.02348.x · Cited by 47 · see citing works
Perkins, A., Burton, L., Dray, B., & Elcock, K. (2013) · Nurse Education Today · doi:10.1016/j.nedt.2012.04.023 · Cited by 46 · see citing works
Eva, K. W., & Macala, C. (2014) · Medical Education · doi:10.1111/medu.12402 · Cited by 39 · see citing works
An evaluation of the multiple mini-interview as a selection tool for dental students
McAndrew, R., & Ellis, J. (2012) · British Dental Journal · doi:10.1038/sj.bdj.2012.267 · Cited by 39 · see citing works
Fraga, J. D., Oluwasanjo, A., Wasser, T., Donato, A., & Alweis, R. (2013) · Journal of Community Hospital Internal Medicine Perspectives · doi:10.3402/jchimp.v3i3-4.21362 · Cited by 23 · see citing works
Ahmed, A., Qayed, K. I., Abdulrahman, M., Tavares, W., & Rosenfeld, J. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.907875 · Cited by 19 · see citing works
Yusoff, M. S. B., & Arifin, W. N. (2015) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2015.08.005 · Cited by 19 · see citing works
Self-citationMedical Education Department Roles and Initiatives towards Achieving APEX Agenda
Yusoff, M. S. B., Rahim, A. F. A., & Ja'afar, R. (2014) · Education in Medicine Journal · doi:10.5959/eimj.v6i2.261 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 7
- [2]2. Yusoff MSB, Rahim AFA, Baba AA, Esa AR. Medical student selection process and its pre-admission scores association with the new students' academic performance in Universiti Sains Malaysia. Int Med J. 2011;18(4):329-33.
- [5]5. Eva KW, Rosenfeld J, Reiter HI, Norman GR. An admissions OSCE: the multiple mini-interview. Medical Education. 2004;38(3):314-26. doi: 10.1046/j.1365- 2923.2004.01776.x. · DOI
- [9]9. Reiter HI, Salvatori P, Rosenfeld J, Trinh K, Eva KW. The effect of defined violations of test security on admissions outcomes using multiple mini-interviews. Med Educ. 2006;40(1):36-42. doi: 10.1111/j.1365- 2929.2005.02348.x. · DOI
- [23]23. Bentler PM. Comparative fit indexes in structural models. Psychological Bulletin. 1990;107(2):238. doi: 10.1037/0033- 2909.107.2.238. · DOI
- [24]24. Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin. 1980;88(3):588. doi: 10.1037/0033- 2909.88.3.588. · DOI
- [29]29. Zainudin A. Structural equation modeling using AMOS graphic. Shah Alam: UiTM Press; 2012.
- [36]36. Dore KL, Kreuger S, Ladhani M, Rolfson D, Kurtz D, Kulasegaram K, et al. The reliability and acceptability of the multiple mini-interview as a selection instrument for postgraduate admissions. Acad Med. 2010;85(10 Suppl):S60-3. doi: 10.1097/ ACM.0b013e3181ed442b.
Cited by
Sorted by citations
Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review
Yusoff, M. S. B. (2019) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2019.03.006 · Cited by 57 · see citing works
“, (47) 2014 Observational Study Dubai Health Authority, United Arab Emirates N 1⁄4 187 candidates Dubai Residency Training Program Family Medicine Explore the implementation of MMI in different cultural settings A MMI with 8 stations, produced absolute and relative reliability of 0.”
BackgroundSelf-citation<p>Multiple Mini-Interviews: Current Perspectives on Utility and Limitations</p>
Ali, S., Sadiq Hashmi, M. S., Umair, M., Beg, M. A., & Huda, N. (2019) · Advances in Medical Education and Practice · doi:10.2147/amep.s181332 · Cited by 32 · see citing works
Pang, N. T. P., Kadir, F. B. M., Kamu, A., Ho, C. M., Loo, J. L., Ahmedy, F. B., & Jeffree, M. S. (2021) · Annals of Medicine and Surgery · doi:10.1016/j.amsu.2021.103019 · Cited by 2 · see citing works
Alkinani, A. A., Rohana, A., Hasan, R., Ahmad, W. M. A. W., & Al-badri, S. A. F. A.-B. (2024) · Cureus · doi:10.7759/cureus.71710 · Cited by 2 · see citing works
Ezeala, C. C., Ezeala, M. O., Shaikh, V., Akapelwa, T. M., Phiri, S. B., Kamvuma, K. M., Mulemena, J. A., Mushabati, F., Chanda, W., & Sijumbila, G. (2020) · Medical Journal of Zambia · doi:10.55320/mjz.47.3.703 · Cited by 2 · see citing works
Rahim, A. F. A., Pa, M. N. M., Mohammad, J. A.-M., Baharuddin, K. A., Yusoff, M. S. B., Ismail, M. A.-A., & Zin, N. A. M. (2020) · Education in Medicine Journal · doi:10.21315/eimj2020.12.4.5 · Cited by 2 · see citing works
Self-citationAdam, S. K., Hod, R., Mahayidin, H., Ahmad, Z., & Salihan, S. (2024) · Education in Medicine Journal · doi:10.21315/eimj2024.16.s1.1 · Cited by 1 · see citing works
Alam, F., Az-Zahraa, F., Idris, F. I., & Rahman, H. A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0314778 · Cited by 1 · see citing works
Yusoff, M. S. B. (2020) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2020.08.011 · Cited by 1 · see citing works
Self-citationAli, S. S., Hashmi, M. S. S., & Shoaib, S. H. (2020) · BIOMEDICA · doi:10.24911/biomedica/5-137
- Authors
- Abdul Rahim, A. F., & Yusoff, M. S. B.
- Affiliations
- Universiti Sains Malaysia (MY)
- Venue
- Education in Medicine Journal
- Publisher
- Universiti Sains Malaysia
- Published
- 2016-06-30
- Volume
- 8
- Issue
- 2
- ISSN
- 2180-1932 (ISSN-L)
- OpenAlex
- W2490181384
- Cited by
- 10
- References
- 32
- Citations by year
- 2024: 3 · 2021: 1 · 2020: 4 · 2019: 2
- FWCI
- 0.66
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Education in Medicine Journal (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- multiple mini-interviews, medical student selection, medical school admissions, construct validity, reliability statistics, feasibility, acceptability, item difficulty and discrimination, Universiti Sains Malaysia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
