Realist methods in medical education research: what are they and what can they contribute?
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Medical Education 2012: 46: 89–96 Context Education is a complex intervention which produces different outcomes in different circumstances. Education researchers have long recognised the need to supplement experimental studies of efficacy with a broader range of study designs that will help to unpack the ‘how’ and ‘why’ questions and illuminate the many, varied and interdependent mechanisms by which interventions may work (or fail to work) in different contexts. Methods One promising approach is realist evaluation, which seeks to establish what works, for whom, in what circumstances, in what respects, to what extent, and why. This paper introduces the realist approach and explains why it is particularly suited to education research. It gives a brief introduction to the philosophical assumptions underlying realist methods and outlines key principles of realist evaluation (designed for empirical studies) and realist review (the application of realist methods to secondary research). Discussion The paper warns that realist approaches are not a panacea and lists the circumstances in which they are likely to be particularly useful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Art of Case Study Research
Johnson, K. E., & Stake, R. E. (1996) · The Modern Language Journal · doi:10.2307/329758 · Cited by 15,826
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Self-citationPawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Self-citationInternet-Based Learning in the Health Professions: A Meta-analysis
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.10.1181 · Cited by 1,498
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729
Self-citationLockyer, J. (1997) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.4750170109 · Cited by 619
On Theoretical Sociology: Five Essays, Old and New
Merton, R. Κ. (1967) · Cited by 514
Internet-based medical education: a realist review of what works, for whom and in what circumstances
Wong, G., Greenhalgh, T., & Pawson, R. (2010) · BMC Medical Education · doi:10.1186/1472-6920-10-12 · Cited by 441
Self-citation
Cited by
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-21 · Cited by 1,374
“They are not intended to provide detailed guidance on how to conduct such a synthesis; for this, we direct interested readers to summary articles [15,22] or various publications on methods [1,11,14,23].”
Self-citationRAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12095 · Cited by 385
Self-citationLacouture, A., Breton, E., Guichard, A., & Ridde, V. (2015) · Implementation Science · doi:10.1186/s13012-015-0345-7 · Cited by 289
Mapping the dark matter of context: A conceptual scoping review.
Bates, J., & Ellaway, R. H. (2016) · Medical Education · doi:10.1111/medu.13034 · Cited by 144
Dornan, T. (2012) · Perspectives on Medical Education · doi:10.1007/s40037-012-0005-4 · Cited by 116
“I use a piece of my own research, a realist synthesis [12] of how medical students learn in workplaces [13], to show how Dutch publications have contributed to the scholarship of workplace learning.”
MethodRivas, C., Vigurs, C., Cameron, J., & Yeo, L. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013135.pub2 · Cited by 65
Realist review of interprofessional education for health care students: What works for whom and why
Maddock, B., Dārziņš, P., & Kent, F. (2023) · Journal of Interprofessional Care · doi:10.1080/13561820.2022.2039105 · Cited by 32
Grades in formative workplace‐based assessment: a study of what works for whom and why
Lefroy, J., Hawarden, A., Gay, S. P., McKinley, R. K., & Cleland, J. (2015) · Medical Education · doi:10.1111/medu.12659 · Cited by 31
Interprofessional education in a student-led emergency department: A realist evaluation
Ericson, A., Löfgren, S., Bolinder, G., Reeves, S., Kitto, S., & Masiello, I. (2017) · Journal of Interprofessional Care · doi:10.1080/13561820.2016.1250726 · Cited by 24
Abrams, R., Spiers, J., Maben, J., Grosvenor, W., Touray, M., & Gage, H. (2024) · BMC Medicine · doi:10.1186/s12916-024-03806-0 · Cited by 8
Simulated patient judgements of medical student performance in OSCEs: A realist evaluation
El-Sherif, A., Lim, J. J., & Roberts, C. (2026) · Medical Teacher · doi:10.1080/0142159x.2026.2641759 · Cited by 1
“Encouraging SPs to reflect on how personal and professional experiences shape their judgments can support more conscious and consistent scoring. tested, and refined through interview data gathered sequentially during the realist evaluation phase [17,18].”
Metadata
- Authors
- Wong, G., Greenhalgh, T., Westhorp, G., & Pawson, R.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2011-12-13
- Volume
- 46
- Issue
- 1
- Pages
- 89-96
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W1568031113
- Cited by
- 404
- References
- 23
- FWCI
- 19.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.