The DOI matches its Crossref record; 162 of the 162 references it cites were found in a registry or an index.
How effective are selection methods in medical education? A systematic review
Open accessAbstract
Context: Selection methods used by medical schools should reliably identify whether candidates are likely to be successful in medical training and ultimately become competent clinicians. However, there is little consensus regarding methods that reliably evaluate non‐academic attributes, and longitudinal studies examining predictors of success after qualification are insufficient. This systematic review synthesises the extant research evidence on the relative strengths of various selection methods. We offer a research agenda and identify key considerations to inform policy and practice in the next 50 years. Methods: A formalised literature search was conducted for studies published between 1997 and 2015. A total of 194 articles met the inclusion criteria and were appraised in relation to: (i) selection method used; (ii) research question(s) addressed, and (iii) type of study design. Results: Eight selection methods were identified: (i) aptitude tests; (ii) academic records; (iii) personal statements; (iv) references; (v) situational judgement tests ( SJT s); (vi) personality and emotional intelligence assessments; (vii) interviews and multiple mini‐interviews ( MMI s), and (viii) selection centres ( SC s). The evidence relating to each method was reviewed against four evaluation criteria: effectiveness (reliability and validity); procedural issues; acceptability, and cost‐effectiveness. Conclusions: Evidence shows clearly that academic records, MMI s, aptitude tests, SJT s and SC s are more effective selection methods and are generally fairer than traditional interviews, references and personal statements. However, achievement in different selection methods may differentially predict performance at the various stages of medical education and clinical practice. Research into selection has been over‐reliant on cross‐sectional study designs and has tended to focus on reliability estimates rather than validity as an indicator of quality. A comprehensive framework of outcome criteria should be developed to allow researchers to interpret empirical evidence and compare selection methods fairly. This review highlights gaps in evidence for the combination of selection tools that is most effective and the weighting to be given to each tool.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Intelligence, personality, and interests: Evidence for overlapping traits
Ackerman, P. L., & Heggestad, E. D. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.2.219 · Cited by 1,829
A theory of adult intellectual development: Process, personality, interests, and knowledge
Ackerman, P. L. (1996) · Intelligence · doi:10.1016/s0160-2896(96)90016-1 · Cited by 846
Factors associated with success in medical school: systematic review of the literature
Ferguson, E., James, D., & Madeley, L. (2002) · BMJ · doi:10.1136/bmj.324.7343.952 · Cited by 811
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617
SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META‐ANALYSIS
McDANIEL, M. A., HARTMAN, N. S., WHETZEL, D. L., & GRUBB, W. L. (2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00065.x · Cited by 468
Lievens, F., Coetsier, P., De Fruyt, F., & De Maeseneer, J. (2002) · Medical Education · doi:10.1046/j.1365-2923.2002.01328.x · Cited by 401
CHRISTIAN, M. S., EDWARDS, B. D., & BRADLEY, J. C. (2010) · Personnel Psychology · doi:10.1111/j.1744-6570.2009.01163.x · Cited by 336
Situational judgment tests: a review of recent research
Lievens, F., Peeters, H., & Schollaert, E. (2008) · Personnel Review · doi:10.1108/00483480810877598 · Cited by 301
Donnon, T., Paolucci, E. O., & Violato, C. (2007) · Academic Medicine · doi:10.1097/01.acm.0000249878.25186.b7 · Cited by 297
Cited by
Using cognitive interviews and think-aloud protocols to understand thought processes
Wolcott, M. D., & Lobczowski, N. G. (2021) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2020.09.005 · Cited by 256
Kötter, T., Wagner, J., Brüheim, L., & Voltmer, E. (2017) · BMC Medical Education · doi:10.1186/s12909-017-1091-0 · Cited by 172
Multiple Mini-Interview Utilization in United States Physician Assistant Program Admission Processes
James, K., Mazur, Z., Statler, M., Hegmann, T., Landel, G., & Orcutt, V. L. (2021) · The Journal of Physician Assistant Education · doi:10.1097/jpa.0000000000000352 · Cited by 6
Metadata
- Authors
- Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2015-12-23
- Volume
- 50
- Issue
- 1
- Pages
- 36-60
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2202731635
- Cited by
- 481
- References
- 162
- FWCI
- 8.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How effective are selection methods in medical education? A systematic review. https://app.cochat.ai/papers/10.1111/medu.12817
- The paper
- Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016). How effective are selection methods in medical education? A systematic review. Medical Education. https://doi.org/10.1111/medu.12817
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.