Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To assess the practice effects from coaching on the Undergraduate Medicine and Health Sciences Admission Test (UMAT), and the effect of both coaching and repeat testing on the Multiple Mini Interview (MMI). DESIGN, SETTING AND PARTICIPANTS: Observational study based on a self-report survey of a cohort of 287 applicants for entry in 2008 to the new School of Medicine at the University of Western Sydney. Participants were asked about whether they had attended UMAT coaching or previous medical school interviews, and about their perceptions of the relative value of UMAT coaching, attending other interviews or having a "practice run" with an MMI question. UMAT and MMI results for participants were compared with respect to earlier attempts at the test, the degree of similarity between questions from one year to the next, and prior coaching. MAIN OUTCOME MEASURES: Effect of coaching on UMAT and MMI scores; effect of repeat testing on MMI scores; candidates' perceptions of the usefulness of coaching, previous interview experience and a practice run on the MMI. RESULTS: 51.4% of interviewees had attended coaching. Coached candidates had slightly higher UMAT scores on one of three sections of the test (non-verbal reasoning), but this difference was not significant after controlling for Universities Admission Index, sex and age. Coaching was ineffective in improving MMI scores, with coached candidates actually having a significantly lower score on one of the nine interview tasks ("stations"). Candidates who repeated the MMI in 2007 (having been unsuccessful at their 2006 entry attempt) did not improve their score on stations that had new content, but showed a small increase in scores on stations that were either the same as or similar to previous stations. CONCLUSION: A substantial number of Australian medical school applicants attend coaching before undertaking entry selection tests, but our study shows that coaching does not assist and may even hinder their performance on an MMI. Nevertheless, as practice on similar MMI tasks does improve scores, tasks should be rotated each year. Further research is required on the predictive validity of the UMAT, given that coaching appeared to have a small positive effect on the non-verbal reasoning component of the test.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Factors associated with success in medical school: systematic review of the literature
Ferguson, E., James, D., & Madeley, L. (2002) · BMJ · doi:10.1136/bmj.324.7343.952 · Cited by 811
An admissions OSCE: the multiple mini-interview
Eva, K. W., Rosenfeld, J., Reiter, H. I., & Norman, G. R. (2004) · Medical Education · doi:10.1046/j.1365-2923.2004.01776.x · Cited by 617
Reiter, H. I., Salvatori, P., Rosenfeld, J., Trinh, K., & Eva, K. W. (2006) · Medical Education · doi:10.1111/j.1365-2929.2005.02348.x · Cited by 47
Cited by
How effective are selection methods in medical education? A systematic review
Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016) · Medical Education · doi:10.1111/medu.12817 · Cited by 481
Pau, A., Jeevaratnam, K., Chen, Y. S., Fall, A. A., Khoo, C., & Nadarajah, V. D. (2013) · Medical Teacher · doi:10.3109/0142159x.2013.829912 · Cited by 195
Rees, E. L., Hawarden, A. W., Dent, G., Hays, R., Bates, J., & Hassell, A. B. (2016) · Medical Teacher · doi:10.3109/0142159x.2016.1158799 · Cited by 139
“Griffin et al. (2008) investigated the effect of previous interview experience and coaching on MMI performance in a sample of 287 applicants.”
BackgroundMultiple mini-interviews: same concept, different approaches
Knorr, M., & Hissbach, J. (2014) · Medical Education · doi:10.1111/medu.12535 · Cited by 110
The multiple mini-interview for emergency medicine resident selection
Hopson, L. R., Burkhardt, J. C., Stansfield, R. B., Vohra, T., Turner-Lawrence, D., & Losman, E. D. (2014) · The Journal of Emergency Medicine · doi:10.1016/j.jemermed.2013.08.119 · Cited by 43
Metadata
- Authors
- Griffin, B., Harding, D. W., Wilson, I. G., & Yeomans, N. D.
- Venue
- Medical Journal of Australia
- Publisher
- AMPCo
- Published
- 2008-09
- Volume
- 189
- Issue
- 5
- Pages
- 270-273
- ISSN
- 0025-729X (ISSN-L)
- 1326-5377
- OpenAlex
- W1518883900
- Cited by
- 74
- References
- 3
- FWCI
- 2.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school. https://app.cochat.ai/papers/10.5694/j.1326-5377.2008.tb02024.x
- The paper
- Griffin, B., Harding, D. W., Wilson, I. G., & Yeomans, N. D. (2008). Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school. Medical Journal of Australia. https://doi.org/10.5694/j.1326-5377.2008.tb02024.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.