The validity of a behavioural multiple-mini-interview within an assessment centre for selection into specialty training
Open accessAbstract
BACKGROUND: Entry into specialty training was determined by a National Assessment Centre (NAC) approach using a combination of a behavioural Multiple-Mini-Interview (MMI) and a written Situational Judgement Test (SJT). We wanted to know if interviewers could make reliable and valid decisions about the non-cognitive characteristics of candidates with the purpose of selecting them into general practice specialty training using the MMI. Second, we explored the concurrent validity of the MMI with the SJT. METHODS: A variance components analysis estimated the reliability and sources of measurement error. Further modelling estimated the optimal configurations for future MMI iterations. We calculated the relationship of the MMI with the SJT. RESULTS: Data were available from 1382 candidates, 254 interviewers, six MMI questions, five alternate forms of a 50-item SJT, and 11 assessment centres. For a single MMI question and one assessor, 28% of the variance between scores was due to candidate-to-candidate variation. Interviewer subjectivity, in particular the varying views that interviewer had for particular candidates accounted for 40% of the variance in scores. The generalisability co-efficient for a six question MMI was 0.7; to achieve 0.8 would require ten questions. A disattenuated correlation with the SJT (r = 0.35), and in particular a raw score correlation with the subdomain related to clinical knowledge (r = 0.25) demonstrated evidence for construct and concurrent validity. Less than two per cent of candidates would have failed the MMI. CONCLUSION: The MMI is a moderately reliable method of assessment in the context of a National Assessment Centre approach. The largest source of error relates to aspects of interviewer subjectivity, suggesting enhanced interviewer training would be beneficial. MMIs need to be sufficiently long for precise comparison for ranking purposes. In order to justify long term sustainable use of the MMI in a postgraduate assessment centre approach, more theoretical work is required to understand how written and performance based test of non-cognitive attributes can be combined, in a way that achieves acceptable generalizability, and has validity.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In Roberts et al. (2014), the generalizability coefficient for a six-question MMI was 0.7; to achieve 0.8 would require ten questions.
“The generalizability co-efficient for a six question MMI was 0.7; to achieve 0.8 would require ten questions.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Roberts C. et al., (58) 2014
In Roberts et al. (2014), for a single MMI question and one assessor, 28% of the variance between scores was due to candidate-to-candidate variation.
“For a single MMI question and one assessor, 28% of the variance between scores was due to candidate-to-candidate variation.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Roberts C. et al., (58) 2014
In Roberts et al. (2014), the varying views that interviewers had for particular candidates accounted for 40% of the variance in scores.
“The varying views that interviewer had for particular candidates accounted for 40% of the variance in scores.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Roberts C. et al., (58) 2014
In Roberts et al. (2014), a disattenuated correlation with the SJT (r=0.35), and a raw score correlation with the subdomain related to clinical knowledge (r=0.25), demonstrated evidence for construct and concurrent validity.
“A disattenuated correlation with the SJT (r = 0.35), and in particular a raw score correlation with the subdomain related to clinical knowledge (r = 0.25) demonstrated evidence for construct and concurrent validity.”
From Multiple Mini Interview as an admission tool in higher education: Insights from a systematic review (2019) · cites this paper as Roberts C. et al., (58) 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039 · see citing works
The proof and measurement of association between two things.
Spearman, C. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyq191 · Cited by 7,777 · see citing works
Validity: on the meaningful interpretation of assessment data
Downing, S. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01594.x · Cited by 1,434 · see citing works
The proof and measurement of association between two things. By C. Spearman, 1904.
Spearman, C. (1987) · PubMed · Cited by 1,023 · see citing works
Disciplinary Action by Medical Boards and Prior Behavior in Medical School
Papadakis, M. A., Teherani, A., Banach, M. A., Knettler, T. R., Rattner, S. L., Stern, D. T., Veloski, J. J., & Hodgson, C. S. (2005) · New England Journal of Medicine · doi:10.1056/nejmsa052596 · Cited by 840 · see citing works
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617 · see citing works
Latham, G. P., Saari, L. M., Pursell, E. D., & Campion, M. A. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.4.422 · Cited by 374 · see citing works
Predictive validity of the multiple mini-interview for selecting medical trainees
Eva, K. W., Reiter, H. I., Trinh, K., Wasi, P., Rosenfeld, J., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03407.x · Cited by 267 · see citing works
Multiple mini-interviews predict clerkship and licensing examination performance
Reiter, H. I., Eva, K. W., Rosenfeld, J., & Norman, G. R. (2007) · Medical Education · doi:10.1111/j.1365-2929.2007.02709.x · Cited by 235 · see citing works
The ability of the multiple mini-interview to predict preclerkship performance in medical school
Eva, K. W., Reiter, H. I., Rosenfeld, J., & Norman, G. R. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00012 · Cited by 225 · see citing works
Lievens, F., & Patterson, F. (2011) · Journal of Applied Psychology · doi:10.1037/a0023496 · Cited by 194 · see citing works
Workplace-based assessment: raters’ performance theories and constructs
Govaerts, M., van de Wiel, M. W. J., Schuwirth, L., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9376-x · Cited by 181 · see citing works
Evaluations of situational judgement tests to assess non‐academic attributes in selection
Patterson, F., Ashworth, V., Zibarras, L., Coan, P., Kerrin, M., & O'Neill, P. A. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04336.x · Cited by 165 · see citing works
Roberts, C., Walton, M., Rothnie, I., Crossley, J., Lyon, P., Kumar, K., & Tiller, D. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03018.x · Cited by 121 · see citing works
Self-citationA competency model for general practice: implications for selection, training, and development.
Patterson, F., Ferguson, E., Lane, P., Farrell, K., Martlew, J., & Wells, A. (2000) · Europe PMC (PubMed Central) · Cited by 114 · see citing works
Exploring the role of first impressions in rater-based assessments
Wood, T. J. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-013-9453-9 · Cited by 112 · see citing works
Eva, K. W., Reiter, H., Rosenfeld, J. M., & Norman, G. R. (2004) · Academic Medicine · doi:10.1097/00001888-200406000-00021 · Cited by 112 · see citing works
Exploring the impact of mental workload on rater-based assessments
Tavares, W., & Eva, K. W. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9370-3 · Cited by 112 · see citing works
Harris, S., & Owen, C. (2007) · Medical Education · doi:10.1111/j.1365-2929.2007.02682.x · Cited by 101 · see citing works
Dore, K. L., Kreuger, S., Ladhani, M., Rolfson, D., Kurtz, D., Kulasegaram, K., Cullimore, A. J., Norman, G. R., Eva, K. W., Bates, S., et al. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed442b · Cited by 98 · see citing works
From test validity to construct validity … and back?
Colliver, J. A., Conlee, M. J., & Verhulst, S. J. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04194.x · Cited by 96 · see citing works
Rosenfeld, J. M., Reiter, H. I., Trinh, K., & Eva, K. W. (2008) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9029-z · Cited by 88 · see citing works
Patterson, F., Ferguson, E., Norfolk, T., & Lane, P. (2005) · BMJ · doi:10.1136/bmj.330.7493.711 · Cited by 81 · see citing works
Guiton, G., Hodgson, C. S., Delandshere, G., & Wilkerson, L. (2004) · Advances in Health Sciences Education · doi:10.1023/b:ahse.0000038174.87790.7b · Cited by 80 · see citing works
Patterson, F., Baron, H., Carr, V. W., Plint, S., & Lane, P. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03238.x · Cited by 78 · see citing works
‘I’m pickin' up good regressions': the governance of generalisability analyses
Crossley, J., Russell, J., Jolly, B. C., Ricketts, C., Roberts, C., Schuwirth, L., & Norcini, J. J. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02843.x · Cited by 77 · see citing works
Self-citationOSCE performance evaluations made by standardized patients
Regehr, G., Freeman, R., Robb, A., Missiha, N., & Heisey, R. (1999) · Academic Medicine · doi:10.1097/00001888-199910000-00064 · Cited by 76 · see citing works
Verhoeven, B. H., Hamers, J. G. H. C., Scherpbier, A. J. J. A., Hoogenboom, R. J. I., & van der Vleuten, C. P. M. (2000) · Medical Education · doi:10.1046/j.1365-2923.2000.00566.x · Cited by 76 · see citing works
Multiple mini-interviews: opinions of candidates and interviewers
Humphrey, S., Dowson, S., Wall, D., Diwakar, V., & Goodyear, H. M. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02972.x · Cited by 74 · see citing works
Brownell, K., Lockyer, J., Collin, T., & Lemay, J.-F. (2007) · Medical Teacher · doi:10.1080/01421590701311713 · Cited by 72 · see citing works
Roberts, C., Rothnie, I., Zoanetti, N., & Crossley, J. (2010) · Medical Education · doi:10.1111/j.1365-2923.2010.03689.x · Cited by 59 · see citing works
Self-citationUijtdehaage, S., Doyle, L. “., & Parker, N. (2011) · Academic Medicine · doi:10.1097/acm.0b013e3182223ab7 · Cited by 57 · see citing works
A comparison of multiple mini-interviews and structured interviews in a UK setting
O’Brien, A., Harvey, J., Shannon, M., Lewis, K., & Valencia, O. (2011) · Medical Teacher · doi:10.3109/0142159x.2010.541532 · Cited by 55 · see citing works
Preferences of program directors for evaluation of candidates for postgraduate training.
Provan, J. L., & Cuttress, L. A. (1995) · PubMed · Cited by 49 · see citing works
Roberts, C., Zoanetti, N., & Rothnie, I. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03292.x · Cited by 49 · see citing works
Self-citationThe acceptability of the multiple mini interview for resident selection.
(2008) · PubMed · Cited by 49 · see citing works
Reiter, H. I., Salvatori, P., Rosenfeld, J., Trinh, K., & Eva, K. W. (2006) · Medical Education · doi:10.1111/j.1365-2929.2005.02348.x · Cited by 47 · see citing works
Alwan, I. A. A., Kushi, M. A., Tamim, H., Magzoub, M. E., & Elzubeir, M. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9380-1 · Cited by 41 · see citing works
Dore, K. L., Hanson, M. D., Reiter, H., Blanchard, M., Deeth, K., & Eva, K. W. (2006) · Academic Medicine · doi:10.1097/01.acm.0000236537.42336.f0 · Cited by 35 · see citing works
Rater and occasion impacts on the reliability of pre‐admission assessments
Axelson, R. D., & Kreiter, C. D. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03537.x · Cited by 35 · see citing works
Yen, W., Hovey, R., Hodwitz, K., & Zhang, S. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9241-8 · Cited by 22 · see citing works
Can knowledge tests and situational judgement tests predict selection centre performance?
Ahmed, H., Rhydderch, M., & Matthews, P. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04303.x · Cited by 20 · see citing works
Selection into specialist training programs: an approach from general practice
Roberts, C., & Togno, J. (2011) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2011.tb04177.x · Cited by 12 · see citing works
Self-citationHalpern, N., Bentov-Gofrit, D., Matot, I., & Abramowitz, M. Z. (2011) · PubMed · Cited by 8 · see citing works
Townsend, P. D., Christensen, M. G., Kreiter, C. D., & zumBrunnen, J. R. (2010) · Teaching and Learning in Medicine · doi:10.1080/10401330903445737 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Patterson, F., Zibarras, L., & Ashworth, V. (2015) · Medical Teacher · doi:10.3109/0142159x.2015.1072619 · Cited by 236 · see citing works
Situational judgement test validity for selection: A systematic review and meta‐analysis
Webster, E. S., Paton, L. W., Crampton, P. E. S., & Tiffin, P. A. (2020) · Medical Education · doi:10.1111/medu.14201 · Cited by 120 · see citing works
Patterson, F., Rowett, E., Hale, R., GRANT, M. M., Roberts, C., Cousans, F., & Martin, S. (2016) · BMC Medical Education · doi:10.1186/s12909-016-0606-4 · Cited by 68 · see citing works
Self-citationRoberts, C., Khanna, P., Rigby, L., Bartle, E. K., Llewellyn, A., Gustavs, J., Newton, L., Newcombe, J. P., Davies, M. W., Thistlethwaite, J. E., et al. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1367375 · Cited by 64 · see citing works
Self-citationMultiple Mini Interview as an admission tool in higher education: Insights from a systematic review
Yusoff, M. S. B. (2019) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2019.03.006 · Cited by 57 · see citing works
“(40) 2013 Observational Study design* Cardiff University Dental Hospital, UK N 1⁄4 235 (BDS interviewees); N 1⁄4 62 (Therapy and hygiene interviewees) Identify any new themes for consideration during the MMI process highlighted by a postinterview evaluation questionnaire in a new cohort of undergraduate dental student…”
BackgroundFielding, S., Tiffin, P. A., Greatrix, R., Lee, A. J., Patterson, F., Nicholson, S., & Cleland, J. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-023274 · Cited by 52 · see citing works
<p>Multiple Mini-Interviews: Current Perspectives on Utility and Limitations</p>
Ali, S., Sadiq Hashmi, M. S., Umair, M., Beg, M. A., & Huda, N. (2019) · Advances in Medical Education and Practice · doi:10.2147/amep.s181332 · Cited by 32 · see citing works
Callwood, A., Jeevaratnam, K., Kotronoulas, G., Schneider, A., Lewis, L. S., & Nadarajah, V. D. (2018) · Nurse Education Today · doi:10.1016/j.nedt.2018.01.016 · Cited by 174 · see citing works
Twelve tips for constructing a multiple mini-interview
Eva, K. W., Macala, C., & Fleming, B. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1429586 · Cited by 25 · see citing works
Yoshimura, H., Kitazono, H., Fujitani, S., Machi, J., Saiki, T., Suzuki, Y., & Ponnamperuma, G. G. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0361-y · Cited by 24 · see citing works
Callwood, A. J., Cooke, D. D., Bolger, S., Lemańska, A., & Allan, H. T. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.10.003 · Cited by 23 · see citing works
Herde, C. N., & Lievens, F. (2018) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000512 · Cited by 23 · see citing works
Correlation between MMI performance and OSCE performance – a pilot study
Oluwasanjo, A., Wasser, T., & Alweis, R. L. (2015) · Journal of Community Hospital Internal Medicine Perspectives · doi:10.3402/jchimp.v5.27808 · Cited by 21 · see citing works
Graupe, T., Fischer, M. R., Strijbos, J.-W., & Kiessling, C. (2020) · Patient Education and Counseling · doi:10.1016/j.pec.2020.04.001 · Cited by 18 · see citing works
The social validity of a national assessment centre for selection into general practice training
Burgess, A. W., Roberts, C., Clark, T., & Mossman, K. (2014) · BMC Medical Education · doi:10.1186/s12909-014-0261-6 · Cited by 16 · see citing works
Self-citationCallwood, A. J., Groothuizen, J. E., Lemańska, A., & Allan, H. T. (2019) · Nurse Education Today · doi:10.1016/j.nedt.2019.104320 · Cited by 16 · see citing works
Heggarty, P., Teague, P.-A., Alele, F. O., Adu, M. D., & Malau‐Aduli, B. S. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-040290 · Cited by 16 · see citing works
Different approaches to selection of surgical trainees in the European Union
Hagelsteen, K., Pedersen, H., Bergenfelz, A. O. J., & Mathieu, C. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02779-5 · Cited by 15 · see citing works
Groothuizen, J. E., Callwood, A. J., & Allan, H. T. (2019) · Nursing Inquiry · doi:10.1111/nin.12307 · Cited by 13 · see citing works
The evolution of British neurosurgical selection and training over the past decade
Alamri, A., Chari, A., McKenna, G. S., Kamaly-Asl, I. D., & Whitfield, P. C. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1444744 · Cited by 12 · see citing works
AI for human assessment: What do professional assessors need?
Arakawa, R., & Yakura, H. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3573849 · Cited by 11 · see citing works
Factors related to doctors’ choice of rural pathway in general practice specialty training
Sureshkumar, P., Roberts, C., Clark, T., Jones, M., Hale, R., & GRANT, M. M. (2016) · Australian Journal of Rural Health · doi:10.1111/ajr.12311 · Cited by 11 · see citing works
Self-citationClark, J. R., Miller, C., & Garwood, E. L. (2019) · Psychological Reports · doi:10.1177/0033294119896062 · Cited by 8 · see citing works
Fung, B. S. C., Gawad, N., Rosenzveig, A., & Raîche, I. (2022) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2022.05.013 · Cited by 6 · see citing works
Oranye, N. O. (2016) · SAGE Open · doi:10.1177/2158244016659119 · Cited by 4 · see citing works
Interviews, Multiple Mini-Interviews, and Selection Centers
Knorr, M., Hissbach, J. C., & Hampe, W. (2018) · Springer eBooks · doi:10.1007/978-3-319-94971-0_5 · Cited by 4 · see citing works
Developing and evaluating the multiple mini interview in student midwife selection
Callwood, A. (2015) · Surrey Research Insight Open Access (The University of Surrey) · Cited by 4 · see citing works
Oxlad, M., Roberts, R., Chur‐Hansen, A., Proeve, M. J., Auton, J. C., Sarris, A., & Tabe, A. (2020) · MedEdPublish · doi:10.15694/mep.2020.000192.1 · Cited by 3 · see citing works
Roberts, C., Burgess, A. W., Mossman, K., & Kumar, K. (2025) · BMC Medical Education · doi:10.1186/s12909-024-06535-3 · Cited by 3 · see citing works
Self-citationGrosse, A., & Thomas, J. S. (2023) · Internal Medicine Journal · doi:10.1111/imj.16083 · Cited by 3 · see citing works
Anderson, C. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe81342 · Cited by 3 · see citing works
Yoshimura, H., Ganaha, H., Sakumoto, K., & Ponnamperuma, G. G. (2025) · Journal of St Marianna University · doi:10.17264/stmarieng.16.33 · Cited by 2 · see citing works
Using the Multiple Mini Interview for selection into vocational general practice training
Lillis, S., Lack, L., Mbita, A., & Ashford, M. (2019) · Journal of Primary Health Care · doi:10.1071/hc18085 · Cited by 2 · see citing works
Role Analysis: The Foundation for Selection Systems
Kerrin, M., Mossop, L. H., Morley, E., Fleming, G., & Flaxman, C. (2018) · Springer eBooks · doi:10.1007/978-3-319-94971-0_6 · Cited by 2 · see citing works
Sélection des futurs médecins : sur quelles bases empiriques ?
Detroz, P., & Loye, N. (2018) · Pédagogie médicale · doi:10.1051/pmed/2019001 · Cited by 2 · see citing works
Yoshimura, H., Ganaha, H., Sakumoto, K., & Ponnamperuma, G. G. (2025) · Journal of St Marianna University · doi:10.17264/stmarieng.16.53 · Cited by 1 · see citing works
Applicant Perceptions and Reactions to Selection
Zibarras, L. (2018) · Springer eBooks · doi:10.1007/978-3-319-94971-0_8 · Cited by 1 · see citing works
Utilizing Multiple Mini Interviews in Medical School Admissions
Apple, R. W. (2017) · Journal of Psychology & Clinical Psychiatry · doi:10.15406/jpcpy.2017.07.00462 · Cited by 1 · see citing works
Muktamiroh, H., Herqutanto, H., Soemantri, D., & Purwadianto, A. (2021) · Jurnal Pendidikan Kedokteran Indonesia The Indonesian Journal of Medical Education · doi:10.22146/jpki.53735 · Cited by 1 · see citing works
Comparison of current recruitment process for specialty or residency training in UK and USA
Sheikh, A. S. F., & Mohamed, M. A. (2018) · Hospital Practice · doi:10.1080/21548331.2018.1426338
Contribution of Cognitive and Non-Cognitive Admissions Measures to Pharm.D. Applicant Admission
Wilcox, R. E., Lawson, K. A., & Acosta, W. R. (2018)
Klemmt, C., & Koenig, S. (2020) · Wiener Medizinische Wochenschrift · doi:10.1007/s10354-020-00780-z
Different Approaches to Selection of Surgical Trainees in the European UnionPreprint
Hagelsteen, K., Pedersen, H., Bergenfelz, A. O. J., & Mathieu, C. (2021) · Research Square · doi:10.21203/rs.3.rs-156778/v1
Roberts, C., Annette, B., Mossman, K., & Kumar, K. (2023) · Research Square · doi:10.21203/rs.3.rs-3034900/v1
Self-citationGenerative artificial intelligence for innovation in pediatric dental residency interviews
Puranik, C. P., Pickett‐Nairne, K., de Peralta, T. L., & Chin, K. (2024) · Journal of Dental Education · doi:10.1002/jdd.13513
Additional file 1 of Different approaches to selection of surgical trainees in the European Union
Hagelsteen, K., Pedersen, H., Bergenfelz, A. O. J., & Mathieu, C. (2021) · Figshare · doi:10.6084/m9.figshare.14889306
Additional file 2 of Different approaches to selection of surgical trainees in the European Union
Hagelsteen, K., Pedersen, H., Bergenfelz, A. O. J., & Mathieu, C. (2021) · Figshare · doi:10.6084/m9.figshare.14889309
A Qualitative Study of a New Generation of Irish-Trained Doctors’ Views on Selection for Medicine
Barber, S. M., & Bennett, D. M. (2026) · MedEdPublish · doi:10.12688/mep.21457.1
Validation of a mini focus group interview for postgraduate year training program selection
Yen, J., Yang, C., Lin, Y., Tsai, M., Lu, P.-L., & Chen, C. (2026) · Tzu Chi Medical Journal · doi:10.4103/tcmj.tcmj-d-26-00061
- Authors
- Roberts, C., Clark, T., Burgess, A., Frommer, M., Grant, M., & Mossman, K.
- Affiliations
- The University of Sydney (AU)
- Corresponding author
- Roberts, Chris
- Venue
- BMC Medical Education
- Published
- 2014-08-13
- Volume
- 14
- Issue
- 1
- Pages
- 169-169
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC4136634
- OpenAlex
- W2121365658
- Cited by
- 49
- References
- 45
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 5 · 2020: 5 · 2019: 6 · 2018: 11 · 2017: 4 · 2016: 3 · 2015: 4 · 2014: 1
- FWCI
- 3.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Medical Education (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- The Sydney eScholarship Repository (The University of Sydney) (submittedVersion)
- Funders
- University of Sydney
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- multiple mini-interviews, situational judgment tests, assessment centers, measurement reliability, concurrent validity, construct validity, generalizability coefficient, non-cognitive skills, variance component analysis
- MeSH terms
- Adult, Aged, Australia, Clinical Competence, Education, Medical, Female, Humans, Interviews as Topic, Judgment, Male, Medicine, Middle Aged, School Admission Criteria, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
