The effect of a brief social intervention on the examination results of UK medical students: a cluster randomised controlled trial
Open accessAbstract
BACKGROUND: Ethnic minority (EM) medical students and doctors underperform academically, but little evidence exists on how to ameliorate the problem. Psychologists Cohen et al. recently demonstrated that a written self-affirmation intervention substantially improved EM adolescents' school grades several months later. Cohen et al.'s methods were replicated in the different setting of UK undergraduate medical education. METHODS: All 348 Year 3 white (W) and EM students at one UK medical school were randomly allocated to an intervention condition (writing about one's own values) or a control condition (writing about another's values), via their tutor group. Students and assessors were blind to the existence of the study. Group comparisons on post-intervention written and OSCE (clinical) assessment scores adjusted for baseline written assessment scores were made using two-way analysis of covariance. All assessment scores were transformed to z-scores (mean = 0 standard deviation = 1) for ease of comparison. Comparisons between types of words used in essays were calculated using t-tests. The study was covered by University Ethics Committee guidelines. RESULTS: Groups were statistically identical at baseline on demographic and psychological factors, and analysis was by intention to treat [intervention group EM n = 95, W n = 79; control group EM n = 77; W n = 84]. As predicted, there was a significant ethnicity by intervention interaction [F(4,334) = 5.74; p = 0.017] on the written assessment. Unexpectedly, this was due to decreased scores in the W intervention group [mean difference = 0.283; (95% CI = 0.093 to 0.474] not improved EM intervention group scores [mean difference = -0.060 (95% CI = -0.268 to 0.148)]. On the OSCE, both W and EM intervention groups outperformed controls [mean difference = 0.261; (95%CI = -0.047 to -0.476; p = 0.013)]. The intervention group used more optimistic words (p < 0.001) and more "I" and "self" pronouns in their essays (p < 0.001), whereas the control group used more "other" pronouns (p < 0.001) and more negations (p < 0.001). DISCUSSION: Cohen et al.'s finding that a brief self-affirmation task narrowed the ethnic academic achievement gap was replicated on the written assessment but against expectations, this was due to reduced performance in the W group. On the OSCE, the intervention improved performance in both W and EM groups. In the intervention condition, participants tended to write about themselves and used more optimistic words than in the control group, indicating the task was completed as requested. The study shows that minimal interventions can have substantial educational outcomes several months later, which has implications for the multitude of seemingly trivial changes in teaching that are made on an everyday basis, whose consequences are never formally assessed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The evaluative and public nature of the activity in the Woolf et al. (2009) study may have compromised its ability to be affirming.
“Beyond unblinding instructors to students' condition assignment, the evaluative and public nature of the activity may have compromised its ability to be affirming.”
From The Psychology of Change: Self-Affirmation and Social Psychological Intervention (2014) · cites this paper as Woolf et al. 2009
The Methods (Procedures and Interventions; page unavailable) say tutors marked the reflective exercises and selected a few submissions for discussion in tutorials, supporting the description of the activity as evaluative and potentially public. The paper does not say that these features may have compromised the activity’s ability to be affirming; that is the citing authors’ interpretation. (LLM, conf=0.83)
Experimental — accuracy not yet measuredIn the Woolf et al. (2009) study, it was unclear whether identity threat contributed to the performance of the ethnic minority sample.
“First, it was unclear whether identity threat contributed to the performance of the ethnic minority sample, a heterogeneous group consisting primarily of Asian Indian, Pakistani, and Bangladeshi participants.”
From The Psychology of Change: Self-Affirmation and Social Psychological Intervention (2014) · cites this paper as Woolf et al. 2009
In the Woolf et al. (2009) study, procedural changes made the affirmation evaluative in nature.
“Second, procedural changes made the affirmation evaluative in nature.”
From The Psychology of Change: Self-Affirmation and Social Psychological Intervention (2014) · cites this paper as Woolf et al. 2009
Another affirmation intervention with an ethnically heterogeneous sample of medical students in England found mixed effects, improving the performance of all students on their clinical evaluations and undermining the performance of white students on a written examination.
“Another affirmation intervention with an ethnically heterogeneous sample of medical students in England found mixed effects, improving the performance of all students on their clinical evaluations and undermining the performance of white students on a written examination(Woolf et al. 2009).”
From The Psychology of Change: Self-Affirmation and Social Psychological Intervention (2014) · cites this paper as Woolf et al. 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical Methods for Psychology.
Gudgeon, A. C., & Howell, D. C. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348956 · Cited by 8,277 · see citing works
Stereotype threat and the intellectual test performance of African Americans.
Steele, C. M., & Aronson, J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.797 · Cited by 8,181 · see citing works
A threat in the air: How stereotypes shape intellectual identity and performance
Steele, C. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.6.613 · Cited by 6,770 · see citing works
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041 · see citing works
Stereotype Threat and Women's Math Performance
Spencer, S. J., Steele, C. M., & Quinn, D. M. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1998.1373 · Cited by 3,435 · see citing works
A question of belonging: Race, social fit, and achievement.
Walton, G. M., & Cohen, G. L. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.1.82 · Cited by 2,163 · see citing works
Learning by doing : a guide to teaching and learning methods
Gibbs, G. (1998) · doi:10.24384/2ewd-qj09 · Cited by 2,148 · see citing works
Aronson, J., Fried, C. B., & Good, C. (2002) · Journal of Experimental Social Psychology · doi:10.1006/jesp.2001.1491 · Cited by 1,889 · see citing works
Pochet, P. (2006) · Griffith Research Online · Cited by 1,550 · see citing works
Reducing the racial achievement gap: A social-psychological intervention
Cohen, G. L., Garcia, J., Apfel, N., & Master, A. (2006) · Science · doi:10.1126/science.1128317 · Cited by 1,073 · see citing works
Stereotype threat effects on Black and White athletic performance
Stone, J., Lynch, C. I., Sjomeling, M., & Darley, J. M. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1213 · Cited by 712 · see citing works
Multicultural Politics: Racism, Ethnicity and Muslims in Britain
Modood, T. (2005) · Cited by 638 · see citing works
The Effects of Stereotype Threat and Double-Minority Status on the Test Performance of Latino Women
Gonzales, P. M., Blanton, H., & Williams, K. J. (2002) · Personality and Social Psychology Bulletin · doi:10.1177/0146167202288010 · Cited by 470 · see citing works
Crocker, J., Niiya, Y., & Mischkowski, D. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02150.x · Cited by 345 · see citing works
Do Asian students really want to listen and obey?
LITTLEWOOD, W. T. (2000) · ELT Journal · doi:10.1093/elt/54.1.31 · Cited by 297 · see citing works
A challenge to the anecdotal stereotype of the Asian student
Kember, D. R., & Gow, L. (1991) · Studies in Higher Education · doi:10.1080/03075079112331382934 · Cited by 253 · see citing works
Improving the performance of college freshmen with attributional techniques.
Wilson, T. D., & Linville, P. W. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.49.1.287 · Cited by 226 · see citing works
Statistics notes: Sample size in cluster randomisation
Kerry, S., & Bland, J. M. (1998) · BMJ · doi:10.1136/bmj.316.7130.549 · Cited by 162 · see citing works
Yates, J., & James, D. K. (2006) · BMJ · doi:10.1136/bmj.38730.678310.63 · Cited by 143 · see citing works
The attainment of ethnic minority students in UK higher education
Richardson, J. T. E. (2008) · Studies in Higher Education · doi:10.1080/03075070701794783 · Cited by 130 · see citing works
Woolf, K., Cave, J., Greenhalgh, T., & Dacre, J. E. (2008) · BMJ · doi:10.1136/bmj.a1220 · Cited by 116 · see citing works
Self-citationRoberts, C. (2000) · BMJ · doi:10.1136/bmj.320.7231.370 · Cited by 116 · see citing works
Medical education research remains the poor relation
Todres, M., Stephenson, A. E., & Jones, R. H. (2007) · BMJ · doi:10.1136/bmj.39253.544688.94 · Cited by 114 · see citing works
Effect of ethnicity and gender on performance in undergraduate medical examinations
Haq, I., HIGHAM, J. M., Morris, R. W., & Dacre, J. E. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02319.x · Cited by 110 · see citing works
Self-citationWass, V., Roberts, C., Hoogenboom, R. J. I., Jones, R., & van der Vleuten, C. P. M. (2003) · BMJ · doi:10.1136/bmj.326.7393.800 · Cited by 110 · see citing works
Evaluating the Predictive Validity of MCAT Scores across Diverse Applicant Groups
Koenig, J. A., Sireci, S. G., & Wiley, A. (1998) · Academic Medicine · doi:10.1097/00001888-199810000-00021 · Cited by 106 · see citing works
Lumb, A. B., & Vail, A. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01912.x · Cited by 93 · see citing works
Dewhurst, N. G., McManus, I. C., Mollon, J., Dacre, J. E., & Vale, A. J. (2007) · BMC Medicine · doi:10.1186/1741-7015-5-8 · Cited by 84 · see citing works
Self-citationKAY‐LAMBKIN, F. J., Pearson, S., & Rolfe, I. E. (2002) · Medical Education · doi:10.1046/j.1365-2923.2002.01071.x · Cited by 69 · see citing works
Woolf, K., Haq, I., McManus, I. C., HIGHAM, J. M., & Dacre, J. E. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-007-9067-1 · Cited by 65 · see citing works
Self-citationBoursicot, K. A. M., Roberts, T. E., & Pell, G. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02857.x · Cited by 65 · see citing works
Commentary: oral exams--get them right or don't bother.
Esmail, A., & May, C. R. (2000) · PubMed · Cited by 60 · see citing works
Final examination performance of medical students from ethnic minorities
McManus, I. C., Richards, P., Winder, B., & Sproston, K. A. (1996) · Medical Education · doi:10.1111/j.1365-2923.1996.tb00742.x · Cited by 60 · see citing works
Self-citationThe Power of Social Psychological Interventions
Wilson, T. D. (2006) · Science · doi:10.1126/science.1133017 · Cited by 46 · see citing works
Does the MRCGP examination discriminate against Asian doctors?
Wakeford, R. E., Farooqi, A. M., Rashid, A., & Southgate, L. J. (1992) · BMJ · doi:10.1136/bmj.305.6845.92 · Cited by 37 · see citing works
The educational background and qualifications of UK medical students from ethnic minorities
McManus, I. C., Woolf, K., & Dacre, J. (2008) · BMC Medical Education · doi:10.1186/1472-6920-8-21 · Cited by 33 · see citing works
Self-citationXu, G., Veloski, J. J., Hojat, M., Gonnella, J. S., & Bacharach, B. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00013 · Cited by 33 · see citing works
Bessant, R., Bessant, D. A. R., Chesser, A. M. S., & Coakley, G. (2006) · Postgraduate Medical Journal · doi:10.1136/pmj.2005.035998 · Cited by 29 · see citing works
Fielding, A., Charlton, C. M. J., Kounali, D., & Leckie, G. (2008) · Bristol Research (University of Bristol) · Cited by 22 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Xu G Veloski JJ Hojat M Gonnella JS Bacharach B Longitudinal comparison of the academic performances of Asian-American and white medical students Acad Med 1993 68 82 6 8447898
- Kerry SM Bland JM Sample size in cluster randomisation BMJ 1998 316 549 9501723 PMC2665662
Cited by
Sorted by citations
The Psychology of Change: Self-Affirmation and Social Psychological Intervention
Cohen, G. L., & Sherman, D. K. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115137 · Cited by 1,197 · see citing works
Woolf, K., POTTS, H. W. W., & McManus, I. C. (2011) · BMJ · doi:10.1136/bmj.d901 · Cited by 303 · see citing works
Self-citationStereotype Threat and Health Disparities: What Medical Educators and Future Physicians Need to Know
Burgess, D. J., Warren, J. R., Phelan, S. M., Dovidio, J. F., & van Ryn, M. (2010) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1221-4 · Cited by 239 · see citing works
Bridging the gap: the roles of social capital and ethnicity in medical student achievement
Vaughan, S., Sanders, T., Crossley, N., O'Neill, P. A., & Wass, V. (2014) · Medical Education · doi:10.1111/medu.12597 · Cited by 94 · see citing works
Ferrer, R. A., & Cohen, G. L. (2019) · Personality and Social Psychology Review · doi:10.1177/1088868318797036 · Cited by 87 · see citing works
McManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · BMC Medicine · doi:10.1186/s12916-020-01572-3 · Cited by 56 · see citing works
Self-citationUnconscious bias in the classroom : Evidence and opportunities
Dee, T. S., & Gershenson, S. (2023) · Figshare · doi:10.57912/23891580 · Cited by 51 · see citing works
A meta‐analysis of the effect of values affirmation on academic achievement
Wu, Z., Spreckelsen, T. F., & Cohen, G. L. (2021) · Journal of Social Issues · doi:10.1111/josi.12415 · Cited by 64 · see citing works
Fyfe, M., Horsburgh, J., Blitz, J., Chiavaroli, N. G., Kumar, S., & Cleland, J. (2021) · Perspectives on Medical Education · doi:10.1007/s40037-021-00696-3 · Cited by 38 · see citing works
Unleashing Latent Ability: Implications of Stereotype Threat for College Admissions
Logel, C. R., Walton, G. M., Spencer, S. J., Peach, J. M., & Zanna, M. P. (2012) · Educational Psychologist · doi:10.1080/00461520.2011.611368 · Cited by 33 · see citing works
Zhang, D., Su, T., Lyu, B., Yang, Y., & Zhuo, X. (2022) · Work · doi:10.3233/wor-210702 · Cited by 29 · see citing works
A Values Affirmation Intervention to Improve Female Residents' Surgical Performance
Salles, A., Mueller, C. M., & Cohen, G. L. (2016) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-15-00214.1 · Cited by 27 · see citing works
Effectiveness of Self-Affirmation Interventions in Educational Settings: A Meta-Analysis
Escobar-Soler, C., Berríos, R., Peñaloza-Díaz, G., Melis-Rivera, C., Caqueo-Urízar, A., Ponce-Correa, F., & Flores, J. (2023) · Healthcare · doi:10.3390/healthcare12010003 · Cited by 22 · see citing works
Lokhande, M., & Müller, T. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.07.006 · Cited by 19 · see citing works
Predicting who applies to study medicine: Implication for diversity in UK medical schools
Ferguson, E., James, D. K., Yates, J., & Lawrence, C. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652237 · Cited by 18 · see citing works
Playing with labels: Identity terms as tools for building agency
Camp, E., & Flores, C. (2024) · The Philosophical Quarterly · doi:10.1093/pq/pqae092 · Cited by 16 · see citing works
Solanki, S. M., Fitzpatrick, D., Jones, M. R., & Lee, H. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100359 · Cited by 12 · see citing works
Perry, S., Wages, J., Skinner, A. L., Burke, S. E., Hardeman, R. R., & Phelan, S. M. (2021) · Journal of Social Issues · doi:10.1111/josi.12448 · Cited by 14 · see citing works
Values affirmation replication at the University of Illinois
Gutmann, B., & Stelzer, T. J. (2021) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.17.020121 · Cited by 11 · see citing works
It's high time Canada started collecting race-based performance data on medical training and careers
Menezes, A., Henry, S., & Agarwal, G. (2022) · The Lancet Regional Health - Americas · doi:10.1016/j.lana.2022.100326 · Cited by 9 · see citing works
Reducing bias in decision making improves care and influences medical student education
Woolf, K., & Dacre, J. E. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04038.x · Cited by 7 · see citing works
Self-citationLudvik, M. B. (2020) · Advances in higher education and professional development book series · doi:10.4018/978-1-7998-2410-7.ch012 · Cited by 4 · see citing works
Affirmation and Majority Students: Does Affirmation Impair Academic Performance in White Males?
Jones, E. O., & Huey, S. J. (2020) · Basic and Applied Social Psychology · doi:10.1080/01973533.2020.1732389 · Cited by 2 · see citing works
GP National Selection Process: Equalities Impact
Patterson, F., La-Band, A., Koczwara, A., & Spicer, J. (2012) · Cited by 1 · see citing works
Burgess, D. J. (2016) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00215.1 · Cited by 1 · see citing works
Reconceptualizing self-affirmation with the Trigger and Channel FrameworkPreprint
Ferrer, R. A., & Cohen, G. L. (2018) · doi:10.31234/osf.io/y3j5a
Perry, S., Wages, J., Skinner, A. L., Burke, S. E., Hardeman, R. R., & Phelan, S. M. (2019) · doi:10.31234/osf.io/w9cbv
Navigating the Award Gap of Ethnic Minority Students
Calò, F., Kourti, I., Wahga, A. I., Scognamiglio, F., & Kutlu, G. (2025) · Springer eBooks · doi:10.1007/978-3-031-68086-1_10
Differential attainment within medical education: a systematic review
Cunningham, C., Thong, L., Mockler, D., Hayes, M., Cheallaigh, C. N., & Smith, S. M. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08197-1
McManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299783
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299774
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299780
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299789
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299708
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299732
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299747
Self-citationMcManus, I. C., Harborne, A. C., Horsfall, H. L., Joseph, T., Smith, D. T., Marshall-Andon, T., Samuels, R., Kearsley, J. W., Abbas, N., Baig, H., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12299765
Self-citation
- Authors
- Woolf, K., McManus, I. C., Gill, D., & Dacre, J.
- Affiliations
- University College London (GB)
- Corresponding author
- Woolf, Katherine
- Venue
- BMC Medical Education
- Published
- 2009-06-24
- Volume
- 9
- Issue
- 1
- Pages
- 35-35
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC2717066
- OpenAlex
- W2027182423
- Cited by
- 37
- References
- 39
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 2 · 2022: 2 · 2021: 4 · 2020: 12 · 2019: 2 · 2018: 2 · 2016: 2 · 2014: 2 · 2012: 3
- FWCI
- 2.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Keywords
- self-affirmation intervention, academic performance, medical education, written assessment, OSCE assessment, optimism, values affirmation, self-concept, self-efficacy
- MeSH terms
- Analysis of Variance, Curriculum, Educational Measurement, Educational Status, Ethnicity, United Kingdom, Humans, Psychology, Self Concept, Social Perception, Students, Medical, Cluster Analysis, Models, Educational
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review