CoChat
Sign Up
Cited by 61Medical Education and AdmissionsInnovations in Medical EducationEmployer Branding and e-HRM

Internet-based multiple mini-interviews for candidate selection for graduate entry programmes

Open access
Tiller, David, O'Mara, Deborah, Rothnie, Imogene, Dunn, Stewart, Lee, Lily, Roberts, Chris·2013·Medical Education
DOI 10.1111/medu.12224
Open this paper in CoChat — free accountOpen PDF

Abstract

Context: Multiple mini‐interviews (MMIs) have been used by The University of Sydney graduate medical and dental programmes since 2006. In 2011, interviews with international candidates were conducted using Skype ( iMMI ), whereas interviews with local candidates were conducted in person. We determined whether the MMI scores derived from both methods were comparable. We describe the feasibility, acceptability and cost‐effectiveness of the iMMI . Methods: We compared 2011 international student internet‐based iMMI results with data from 2009 international student MMIs and 2011 local student MMIs. Analyses of variance ( anova s) were used to investigate equivalence of the two formats by exploring whether the medium of interviewing resulted in significantly different mean scores and variance for the in‐person MMI and the iMMI . Acceptability of the process was informed by feedback surveys from interviewers and candidates, and cost savings were estimated. Results: No significant difference was found between the 2011 iMMI scores for international candidates and MMI scores in 2009 (p > 0.05). There was no significant difference between the MMI scores for local and international candidates in 2011 (p > 0.05); the MMI scores for international candidates had greater variation (p < 0.01). Using generalisability theory, the reliability of the nine‐question iMMI was 0.76 and for the MMI was 0.70. Delivery of the iMMI occurred smoothly and candidates and interviewers gave positive feedback on its format and delivery. Cost savings have been estimated to be over AU$50 000, representing an 84% saving. Conclusions: We believe this is the first study reporting an internet‐based MMI for a high stakes interview. We have shown that interviewers were able to make valid and reliable decisions about candidates through the iMMI in a process that was acceptable to participants, producing comparable results to the in‐person MMI with a saving of resources. The slightly wider variance in iMMI scores warrants further investigation.

Integrity signals

Registry

Crossref · 10.1111/medu.12224

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In Tiller et al. (2013), there was no significant difference between MMI scores for local and international candidates in 2011 (p>0.05); the MMI scores for international candidates had greater variation (p<0.01).

    “No significant difference between the MMI scores for local and international candidates in 2011 (p > 0.05); the MMI scores for international candidates had greater variation (p < 0.01)”

    From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Tiller D. et al., (46) 2013

  • In Tiller et al. (2013), interviewer satisfaction with iMMI circuits and technology was rated highly, with 61 (78%) giving the two most positive ratings for the interview process and 71% for satisfaction with the technology.

    “Interviewer satisfaction (iMMI circuits and the technology): rated highly with 61 (78%) giving the two most positive ratings for the interview process, 71% for satisfaction with the technology”

    From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Tiller D. et al., (46) 2013

  • In Tiller et al. (2013), comparison of MMI and iMMI scores for international candidates in 2009 and 2011 respectively showed no significant difference in variance (p=0.338).

    “Comparison of MMI and iMMI scores for international candidates in 2009 and 2011, respectively, was no significant in terms of variance (p = 0.338)”

    From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Tiller D. et al., (46) 2013

  • In Tiller et al. (2013), estimated administrative cost of conducting iMMIs was AU$10,145, representing a saving of AU$51,742 or 84% from estimated cost when conducting in Vancouver in 2009 (AU$61,887).

    “Estimated administrative cost of conducting the iMMIs was AU$10 145, representing a saving of AU$51 742 or 84% from estimated cost when conducting in Vancouver in 2009 (AU$61 887)”

    From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Tiller D. et al., (46) 2013

  • In Tiller et al. (2013), the reliability of the nine-question iMMI was 0.76 and for MMI was 0.70.

    “The reliability of the nine-question iMMI was 0.76 and for MMI was 0.70”

    From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Tiller D. et al., (46) 2013

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Related

Authors
Tiller, D., O'Mara, D., Rothnie, I., Dunn, S., Lee, L., & Roberts, C.
Affiliations
The University of Sydney (AU)
Corresponding author
Tiller, David
ORCID
Venue
Medical Education
Publisher
Wiley
Published
2013-07-10
Volume
47
Issue
8
Pages
801-810
ISSN
  • 0308-0110 (ISSN-L)
  • 1365-2923
DOI
10.1111/medu.12224
OpenAlex
W2124941788
Cited by
61
References
21
Citations by year
2025: 1 · 2024: 6 · 2023: 6 · 2022: 8 · 2021: 9 · 2020: 11 · 2019: 3 · 2018: 6 · 2017: 2 · 2016: 4 · 2015: 3 · 2014: 2
FWCI
3.08
Type
journal article
Language
en
Open access
Licence
onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations
  • Medical Education (publishedVersion)
  • PubMed (publishedVersion)
Funders
University of Sydney
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Employer Branding and e-HRM
Keywords
multiple mini-interviews, Skype, international students, graduate entry medicine, dental education, candidate selection, generalizability theory, interview reliability, cost-effectiveness, acceptability
MeSH terms
Analysis of Variance, College Admission Test, Education, Medical, Graduate, Humans, School Admission Criteria, Internet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review