CoChat
Sign Up
Cited by 7Diversity and Career in MedicineInnovations in Medical EducationMedical Education and Admissions

The DOI matches its Crossref record; the references it cites are not checked yet.

Big data analysis: examination of the relationship between candidates’ sociodemographic characteristics and performance in the UK’s Membership of the Royal College of Physicians Part 1 examination

Open access
Johnston, Peter W., Vieira, Rute, Cameron, Isobel M., Kumwenda, Ben, Walker, Kim A., Cleland, Jennifer A.·2025·Advances in Health Sciences Education
DOI 10.1007/s10459-024-10406-3PMC PMC11925973
Open this paper in CoChat — free accountOpen PDF

Abstract

Big datasets and data analytics enable granular analyses examining group differences in performance. Our focus is on differential attainment (DA) in postgraduate College (Board) examinations. We asked: Are candidates’ sociodemographic characteristics associated with performance on the UK’s Membership of the Royal College of Physicians (MRCP) Part 1 after adjusting for medical school performance (MSP) and type of medical programme? This was a retrospective longitudinal cohort study of 6040 medical graduates with linked sociodemographic data in the UK Medical Education Database qualifying from a UK medical school (2012–2014) and sitting MRCP Part 1 before October 2019. Chi-squared tests established univariable associations with MRCP performance (pass/fail first sitting MRCP Part 1). Multivariable mixed-effects logistic regression identified independent explanatory factors of success, adjusted for medical school. The odds (95% CI) of passing MRCP Part 1 exams on first sitting were greater for men (OR = 1.61, CI 1.42–1.81, p < 0.001) and those on a graduate entry programme (OR = 1.44, 1.05–1.99, p < 0.001). The odds of passing were lower as age increases (OR = 0.87, 0.85–0.90, p < 0.001), for minority ethnic (OR = 0.61, CI 0.53–0.7, p < 0.001), and gateway to medicine (OR = 0.49, CI 0.27–0.90, p = 0.02) candidates. After adjusting for MSP, odds were greater for passing in men (OR = 1.62, CI 1.24–2.11, p < 0.001) and candidates with higher MSP (OR = 4.12, CI 3.40–4.96, p < 0.001). Our findings illustrate how performance on MRCP part 1 is associated with group-level social and educational factors. This DA may be due to aspects of the assessment itself, and/or the persistent nature of social and educational disadvantage.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10459-024-10406-3

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists haven’t been fetched yet

References 56 · Cited by 7

Research works printed but not linked: 57

  1. Arday, J., & Mirza, H. S. (2018). Dismantling race in higher education: Racism, whiteness and decolonising the academy (1st ed.). Cham: Palgrave Macmillan. · DOI
  2. Asghar, Z., Williams, N., Denney, M., & Siriwardena, A. N. (2019). Performance in candidates declaring versus those not declaring dyslexia in a licensing clinical examination. Medical Education, 53(12), 1243–1252. · DOI
  3. Boatright, D., Ross, D., O’Connor, P., Moore, E., & Nunez-Smith, M. (2017). Racial disparities in medical student membership in the alpha omega alpha honor society. JAMA Internal Medicine, 177(5), 659–665. · DOI
  4. Cantor, J. C., Miles, E. L., Baker, L. C., & Barker, D. C. (1996). Physician service to the underserved: Implications for affirmative action in medical education. Inquiry, 33(2), 167–180.
  5. Cleland, J., Prescott, G., Walker, K., Johnston, P., & Kumwenda, B. (2019). Are there differences between those doctors who apply for a training post in foundation year 2 and those who take time out of the training pathway? A UK Multicohort Study. British Medical Journal Open, 9(11), e032021. https://doi.org/10.1136/bmjopen-2019-032021 · DOI
  6. Curtis, S., & Smith, D. (2020). A comparison of undergraduate outcomes for students from gateway courses and standard entry medicine courses. BMC Medical Education, 20(1), 4. https://doi.org/10.1186/s12909-019-1918-y · DOI
  7. Dewhurst, N. G., McManus, C., Mollon, J., Dacre, J. E., & Vale, A. J. (2007). Performance in the MRCP(UK) Examination 2003–4: Analysis of pass rates of UK graduates in relation to self-declared ethnicity and gender. BMC Medicine, 5, 8. · DOI
  8. Dowell, J., Cleland, J., Fitzpatrick, S., McManus, C., Nicholson, S., Oppe, T., Petty-Saphon, K., King, O. S., Smith, D., Thornton, S., & White, K. (2018). The UK medical education database (UKMED) what is it? Why and how might you use it? BMC Medical Education, 18(1), 6. https://doi.org/10.1186/s12909-017-1115-9 · DOI
  9. Ellis, R., Brennan, P. A., Lee, A. J., Scrimgeour, D. S., & Cleland, J. (2022a). Differential attainment at MRCS according to gender, ethnicity, age and socioeconomic factors: A retrospective cohort study. Journal of the Royal Society of Medicine, 115(7), 257–272. · DOI
  10. Ellis, R., Brennan, P., Scrimgeour, D. S., Lee, A. J., & Cleland, J. (2022b). Performance at medical school selection correlates with success in Part A of the intercollegiate Membership of the Royal College of Surgeons (MRCS) examination. Postgraduate Medical Journal, 98(1161), e19. · DOI
  11. Ellis, R., Cleland, J., Scrimgeour, D., Lee, A. J., & Brennan, P. A. (2021). Does the MRCS exam fulfil its function as a gatekeeper to the profession of surgery? Bulletin of the Royal College of Surgeons, 103, 344–350. · DOI
  12. Farquharson, C., McNally, S. & Tahir, I. (2022). Lack of progress on closing educational inequalities disadvantaging millions throughout life. https://ifs.org.uk/inequality/press-release/lack-of-progress-on-closing-educational-inequalities-disadvantaging-millions-throughout-life/. · DOI
  13. Fyfe, M., Horsburgh, J., Blitz, J., Chiavaroli, N., Kumar, S., & Cleland, J. (2022). The do’s, don’ts and don’t knows of redressing differential attainment related to race/ethnicity in medical schools. Perspectives on Medical Education, 11(1), 1–14. · DOI
  14. Galobardes, B., Shaw, M., Lawlor, D. A., Lynch, J. W., & Davey Smith, G. (2006). Indicators of socioeconomic position (part 2). Journal of Epidemiology & Community Health, 60(2), 95–101. · DOI
  15. Garrud, P., & McManus, I. C. (2018). Impact of accelerated, graduate-entry medicine courses: A comparison of profile, success, and specialty destination between graduate entrants to accelerated or standard medicine courses in UK. BMC Medical Education, 18(1), 250. https://doi.org/10.1186/s12909-018-1355-3 · DOI
  16. Gomez, L. E., & Bernet, P. (2019). Diversity improves performance and outcomes. Journal of the National Medical Association, 111(4), 383–392. · DOI
  17. Gonzaga, A. M. R., Appiah-Pippim, J., Onumah, C. M., & Yialamas, M. A. (2020). A framework for inclusive graduate medical education recruitment strategies: Meeting the ACGME standard for a diverse and inclusive workforce. Academic Medicine, 95(5), 710–716. · DOI
  18. Haq, I., Higham, J., Morris, R., & Dacre, J. (2005). Effect of ethnicity and gender on performance in undergraduate medical examinations. Medical Education, 39(11), 1126–1128. · DOI
  19. Hope, D., Adamson, K., McManus, I. C., Chis, L., & Elder, A. (2018). Using differential item functioning to evaluate potential bias in a high stakes postgraduate knowledge based assessment. BMC Medical Education, 18(1), 64. https://doi.org/10.1186/s12909-018-1143-0 · DOI
  20. Hope, D., Dewar, A., Hothersall, E. J., Leach, J. P., Cameron, I., & Jaap, A. (2021). Measuring differential attainment: A longitudinal analysis of assessment results for 1512 medical students at four Scottish medical schools. British Medical Journal Open, 11(9), e046056. https://doi.org/10.1136/bmjopen-2020-046056 · DOI
  21. Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression. John Wiley and Sons. · DOI · Paper page
  22. Hutchinson, K., Ricketts, W. M., Maxwell, S., & Ng, F. L. (2021). Candidates registered for reasonable adjustments underperform compared to other candidates in the national undergraduate prescribing safety assessment: Retrospective cohort analysis (2014–2018). British Journal of Clinical Pharmacology, 87(3), 946–954. · DOI
  23. Jefferson, L., Bloor, K., & Maynard, A. (2015). Women in medicine: Historical perspectives and recent trends. British Medical Bulletin, 114(1), 5–15. · DOI
  24. Jones, R. L., Prusmetikul, S., & Whitehorn, S. (2024). Differential attainment in assessment of postgraduate surgical trainees: A scoping review. BMC Medical Education, 24(1), 597. · DOI
  25. King, J. T. J., Angoff, N. R., Forrest, J. N. J., & Justice, A. C. (2018). Gender disparities in medical student research awards: A 13-year study from the Yale School of Medicine. Academic Medicine, 93(6), 911–919. · DOI
  26. Kumwenda, B., Cleland, J., Greatrix, R., MacKenzie, R. K., & Prescott, G. (2018b). Are efforts to attract graduate applicants to UK medical schools effective in increasing the participation of under-represented socioeconomic groups? A National Cohort Study. BMJ Open, 8(2), e018946. https://doi.org/10.1136/bmjopen-2017-018946 · DOI
  27. Kumwenda, B., Cleland, J. A., Prescott, G. J., Walker, K., & Johnston, P. W. (2018a). Relationship between sociodemographic factors and selection into UK postgraduate medical training programmes: A national cohort study. British Medical Journal Open, 8(6), e021329. https://doi.org/10.1136/bmjopen-2017-021329 · DOI
  28. Kumwenda, B., Cleland, J., Prescott, G., Walker, K., & Johnston, P. (2019). Relationship between sociodemographic factors and specialty destination of UK trainee doctors: A national cohort study. British Medical Journal Open, 9(3), e026961. https://doi.org/10.1136/bmjopen-2018-026961 · DOI
  29. Kumwenda, B., Cleland, J. A., Walker, K., Lee, A. J., & Greatrix, R. (2017). The relationship between school type and academic performance at medical school: A national, multi-cohort study. British Medical Journal Open, 7(8), e016291. https://doi.org/10.1136/bmjopen-2017-016291 · DOI
  30. LaVeist, T. A., & Pierre, G. (2014). Integrating the 3Ds–social determinants, health disparities, and health-care workforce diversity. Public Health Reports, 129(Suppl 2), 9–14. · DOI
  31. Lee, K. B., Vaishnavi, S. N., Lau, S. K. M., Andriole, D. A., & Jeffe, D. B. (2007). “Making the grade:” Noncognitive predictors of medical students’ clinical clerkship grades. Journal of the National Medical Association, 99(10), 1138–1150.
  32. Li, Y. (2018). Unequal returns: Higher education and access to the salariat by ethnic groups in the UK. In J. Arday & H. Mirza (Eds.), Dismantling race in higher education (pp. 103–124). Palgrave Macmillan. · DOI
  33. Marcoulides, K. M., & Raykov, T. (2019). Evaluation of variance inflation factors in regression models using latent variable modeling methods. Educational and Psychological Measurement, 79(5), 874–882. · DOI
  34. McManus, I. C., Elder, A. T., de Champlain, A., Dacre, J. E., Mollon, J., & Chis, L. (2008). Graduates of different UK medical schools show substantial differences in performance on MRCP(UK) Part 1, Part 2 and PACES examinations. BMC Medicine, 6, 5. https://doi.org/10.1186/1741-7015-6-5 · DOI
  35. McManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., et al. (2020). Exploring UK medical school differences: The MedDifs study of selection, teaching, student and F1 perceptions, postgraduate outcomes and fitness to practise. BMC Medicine, 18(1), 136. https://doi.org/10.1186/s12916-020-01572-3 · DOI
  36. McManus, I. C., & Ludka, K. (2012). Resitting a high-stakes postgraduate medical examination on multiple occasions: Nonlinear multilevel modelling of performance in the MRCP(UK) examinations. BMC Medicine, 10, 60. https://doi.org/10.1186/1741-7015-10-60 · DOI
  37. McManus, I. C., & Wakeford, R. (2014). PLAB and UK graduates’ performance on MRCP (UK) and MRCGP examinations: Data linkage study. BMJ: British Medical Journal, 348, g2621. · DOI
  38. McManus, I. C., Woolf, K., Dacre, J., Paice, E., & Dewberry, C. (2013). The academic backbone: Longitudinal continuities in educational achievement from secondary school and medical school to MRCP(UK) and the specialist register in UK medical students and doctors. BMC Medicine, 11, 242. https://doi.org/10.1186/1741-7015-11-242 · DOI
  39. Orom, H., Semalulu, T., & Underwood, W. (2013). The social and learning environments experienced by underrepresented minority medical students: A narrative review. Academic Medicine, 88, 1765–1777. · DOI
  40. Paton, L. W., McManus, I. C., Cheung, K. Y. F., Smith, D. T., & Tiffin, P. A. (2022). Can achievement at medical admission tests predict future performance in postgraduate clinical assessments? A UK-based national cohort study. British Medical Journal Open, 12(2), e056129. https://doi.org/10.1136/bmjopen-2021-056129 · DOI
  41. Patterson, R., & Price, J. (2017). Widening participation in medicine: What, why and how? MedEdPublish, 6, 184. https://doi.org/10.15694/mep.2017.000184 · DOI
  42. Pyne, Y., & Ben-Shlomo, Y. (2015). Older doctors and progression through specialty training in the UK: A cohort analysis of General Medical Council data. British Medical Journal Open, 5, e005658.
  43. Rabinowitz, H., Diamond, J., Veloski, J., & Gayle, J. (2000). The impact of multiple predictors on generalist physicians’ care of under-served populations. American Journal of Public Health, 90, 1225–1228. · DOI
  44. Scrimgeour, D., Brennan, P., Griffiths, G., Smith, F., Lee, A. J., & Cleland, J. (2018a). Does the intercollegiate membership of the Royal College of Surgeons (MRCS) examination predict performance during UK higher specialty surgical training? Annals of the Royal College Surgeons England, 100(6), 669–675. · DOI
  45. Scrimgeour, D., Cleland, J., Lee, A. J., & Brennan, P. A. (2018b). Predictors of success in the intercollegiate membership of the Royal College of Surgeons (MRCS) examination. Annals of the Royal College Surgeons England, 100(6), 424–427. · DOI
  46. Scrimgeour, D., Cleland, J., Lee, A. J., Griffiths, G., McKinley, A. J., Marx, C., & Brennan, P. A. (2017). Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training: Performance in a postgraduate surgical examination and selection into specialty training. British Journal of Surgery Open, 1, 67–74.
  47. Shen, M. J., Peterson, E. B., Costas-Muniz, R., Hernandez, M. H., Jewell, S. T., Matsoukas, K., & Bylund, C. L. (2018). The effects of race and racial concordance on patient-physician communication: A systematic review of the literature. Journal of Racial & Ethnic Health Disparities, 5(1), 117–140. · DOI
  48. Smith, D. G. (2020). Diversity's promise for higher education: Making it work (3rd ed.). Johns Hopkins University.
  49. Stegers-Jager, K. M., Steyerberg, E. W., Cohen-Schotanus, J., & Themmen, A. P. N. (2012). Ethnic disparities in undergraduate pre-clinical and clinical performance. Medical Education, 46(6), 575–585. · DOI
  50. Stegers-Jager, K. M., Themmen, A. P. N., Cohen-Schotanus, J., & Steyerberg, E. W. (2015). Predicting performance: Relative importance of students’ background and past performance. Medical Education, 49(9), 933–945. · DOI
  51. Teherani, A., Hauer, K. E., Fernandez, A., King, T. E. J., & Lucey, C. (2018). How small differences in assessed clinical performance amplify to large differences in grades and awards: A cascade with serious consequences for students underrepresented in medicine. Academic Medicine, 93(9), 1286–1292. · DOI · Paper page
  52. Unwin, E., Potts, H. W. W., Dacre, J., Elder, A., Woolf, K. (2018). Passing MRCP (UK) PACES: A cross-sectional study examining the performance of doctors by sex and country. BMC Medical Education, 18(1), 70. · DOI
  53. Wakeford, R., Denney, M., Ludka-Stempien, K., Dacre, J., & McManus, I. C. (2015). Cross-comparison of MRCGP & MRCP(UK) in a database linkage study of 2284 candidates taking both examinations: Assessment of validity and differential performance by ethnicity. BMC Medical Education, 15, 1. https://doi.org/10.1186/s12909-014-0281-2 · DOI
  54. Wijesekera, T. P., Kim, M., Moore, E. Z., Sorenson, O., & Ross, D. A. (2019). All other things being equal: Exploring racial and gender disparities in Medical School Honor Society Induction. Academic Medicine, 94(4), 562–569. · DOI
  55. Wikaire, E., Curtis, E., Cormack, D., Jiang, Y., McMillan, L., Loto, R., & Reid, P. (2017). Predictors of academic success for Maori, Pacific and non-Maori non-Pacific students in health professional education: A quantitative analysis. Advances in Health Sciences Education, 22(2), 299–326. · DOI
  56. Woolf, K., Potts, H. W. W., & McManus, I. C. (2011). Ethnicity and academic performance in UK trained doctors and medical students: Systematic review and meta-analysis. BMJ: British Medical Journal, 342, d901. · DOI
  57. Woolf, K., Rich, A., Viney, R., Needleman, S., & Griffin, A. (2016). Perceived causes of differential attainment in UK postgraduate medical training: A national qualitative study. British Medical Journal Open, 6, e013429.

Metadata

Authors
Johnston, P. W., Vieira, R., Cameron, I. M., Kumwenda, B., Walker, K. A., & Cleland, J. A.
Affiliations
  • University of Aberdeen (GB)
  • University of Dundee (GB)
  • Nanyang Technological University (SG)
Corresponding author
Walker, Kim A.
ORCID
Venue
Advances in Health Sciences Education
Publisher
Springer Science and Business Media LLC
Published
2024-12-20
Volume
30
Issue
1
Pages
53-68
ISSN
  • 1382-4996 (ISSN-L)
  • 1573-1677
DOI
10.1007/s10459-024-10406-3
PMC
PMC11925973
OpenAlex
W4405645675
Cited by
7
References
56
Citations by year
2026: 3 · 2025: 4
FWCI
5.15
Type
journal article
Language
en
Open access
Licence
Locations
  • Advances in Health Sciences Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Discovery Research Portal (University of Dundee) (publishedVersion, cc-by)
  • Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
  • DR-NTU (Nanyang Technological University) (submittedVersion)
Funders
University of Aberdeen
Topics
  • Social Sciences › Gender Studies › Diversity and Career in Medicine
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Education › Medical Education and Admissions
Keywords
differential attainment, sociodemographic factors, graduate medical education, medical school performance, gender differences, ethnic minority students, social deprivation, exam pass rates, Royal College of Physicians
MeSH terms
Big Data, Sociodemographic Factors, Adult, Age Factors, Educational Measurement, Female, United Kingdom, Humans, Longitudinal Studies, Male, Retrospective Studies, Schools, Medical, Sex Factors, Societies, Medical, Socioeconomic Factors

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review