The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Realist review - a new method of systematic review designed for complex policy interventions
Abstract
Evidence-based policy is a dominant theme in contemporary public services but the practical realities and challenges involved in using evidence in policy-making are formidable. Part of the problem is one of complexity. In health services and other public services, we are dealing with complex social interventions which act on complex social systems-things like league tables, performance measures, regulation and inspection, or funding reforms. These are not ‘magic bullets‘ which will always hit their target, but programmes whose effects are crucially dependent on context and implementation. Traditional methods of review focus on measuring and reporting on programme effectiveness, often find that the evidence is mixed or conflicting, and provide little or no clue as to why the intervention worked or did not work when applied in different contexts or circumstances, deployed by different stakeholders, or used for different purposes. This paper offers a model of research synthesis which is designed to work with complex social interventions or programmes, and which is based on the emerging ‘realist’ approach to evaluation. It provides an explanatory analysis aimed at discerning what works for whom, in what circumstances, in what respects and how. The first step is to make explicit the programme theory (or theories) - the underlying assumptions about how an intervention is meant to work and what impacts it is expected to have. We then look for empirical evidence to populate this theoretical framework, supporting, contradicting or modifying the programme theories as it goes. The results of the review combine theoretical understanding and empirical evidence, and focus on explaining the relationship between the context in which the intervention is applied, the mechanisms by which it works and the outcomes which are produced. The aim is to enable decision-makers to reach a deeper understanding of the intervention and how it can be made to work most effectively. Realist review does not provide simple answers to complex questions. It will not tell policy-makers or managers whether something works or not, but will provide the policy and practice community with the kind of rich, detailed and highly practical understanding of complex social interventions which is likely to be of much more use to them when planning and implementing programmes at a national, regional or local level.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Realist synthesis [68], which does include diverse forms of evidence, is oriented towards theory evaluation, in particular by focusing on theories of change.”
From Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups (2006) · cites this paper as [68]
In the citing paper
“The realist approach followed processes set out by Pawson et al. and the Realist and Meta-narrative Evidence Synthesis: Evolving Standards (RAMESES) [29, 32].”
From Do hospital-to-home transitions work for older adults with multiple long-term conditions including dementia? A realist review (2025) · cites this paper as [29]
In the citing paper
“Following guidelines for realist reviews [11, 12, 26, 27], it was necessary to make decisions about whether a study’s findings were relevant for the development of the framework and whether inferences drawn by an original study were sufficiently supported by evidence.”
From A realist review of mobile phone-based health interventions for non-communicable disease management in sub-Saharan Africa (2017) · cites this paper as [26]
In the citing paper
“Context is often used synonymously with setting and environment [13, 28], embracing static (e.g., physical environment) and dynamic aspects (e.g., relationships, networks) as well as the theory underpinning the intervention and its implementation [29].”
From Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework (2017) · cites this paper as [29]
Citations
Cites
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789
The Discovery of Grounded Theory
Glaser, B. G., & Strauss, A. L. (2017) · The Discovery of Grounded Theory · doi:10.4324/9780203793206-1 · Cited by 8,344
Crime, Shame and Reintegration
Braithwaite, J. (1989) · doi:10.1017/cbo9780511804618 · Cited by 4,153
Lawson, T. (1997) · Routledge eBooks · doi:10.4324/9780203195390 · Cited by 1,863
Whitbeck, C., & Bhaskar, R. (1977) · The Philosophical Review · doi:10.2307/2184170 · Cited by 1,617
Mays, N., Pope, C., & Popay, J. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308576 · Cited by 1,375
Complex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244
(2003) · Digital Education Resource Archive (University College London) · Cited by 902
Family intervention for schizophrenia
Pharoah, F., Mari, J., Rathbone, J., & Wong, W. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000088.pub2 · Cited by 737
Putnam, H. (2011) · The Pragmatism Reader · doi:10.1515/9781400838684-022 · Cited by 594
Research works printed but not linked: 11
- Harré R., 1978, Social Being.
- Collier A., 1994, Critical Realism.
- Pawson R, 1997, Realistic Evaluation.
- Connell J, 1995, New Approaches to Evaluating Community Initiatives.
- Pawson R., 2002, Does Megan's Law Work.
- 2004, NHS Modernisation Agency Clinical Governance Support Team. Learning Through Supporting Improvements: Change from Challenge?
- Pawson R., 2003, Assessing the Quality of Evidence in Evidence-Based Policy: Why, How and When Working Paper No. 1. ESRC Research Methods Programme.
- Pawson R., 2004, ESRC Centre for Evidence-Based Policy and Practice.
- Weiss CH., 1987, Knowl Creation Diffus Util, 8, 274
- Deshpande R., 1981, Knowl Creation Diffus Util, 2, 134
- Bate SP, 2002, Report on the ‘Breakthrough’ Collaborative Approach to Quality and Service Improvement in Four Regions of the NHS. A Research Based Evaluation of the Orthopaedic Services Collaborative Within the Eastern, South and West, South East and Trent Regions.
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
“The theories underpinning the intervention and implementation [17] also contribute to context.”
BackgroundShea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Metadata
- Authors
- Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K.
- Affiliations
- University of Leeds (GB)
- University College London (GB)
- University of Manchester (GB)
- Venue
- Journal of Health Services Research & Policy
- Publisher
- SAGE Publications
- Published
- 2005-07
- Volume
- 10
- Issue
- 1_suppl
- Pages
- 21-34
- ISSN
- 1355-8196 (ISSN-L)
- 1758-1060
- OpenAlex
- W2145452196
- Cited by
- 3,190
- References
- 35
- Citations by year
- 2026: 185 · 2025: 266 · 2024: 263 · 2023: 240 · 2022: 241 · 2021: 292 · 2020: 193 · 2019: 165 · 2018: 154 · 2017: 153 · 2016: 138 · 2015: 163 · 2014: 143 · 2013: 178 · 2012: 107
- FWCI
- 8.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Health Services Research & Policy (publishedVersion)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Economic and Social Research Council (RES-333-34-3002)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- realist review, evidence-based policy, program theory, context-mechanism-outcome, implementation context, health services policy, public service reform, program effectiveness
- MeSH terms
- Evaluation Studies as Topic, United Kingdom, Models, Theoretical, Practice Patterns, Physicians', Policy Making, State Medicine, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Realist review - a new method of systematic review designed for complex policy interventions. https://app.cochat.ai/papers/10.1258/1355819054308530
- The paper
- Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review - a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy. https://doi.org/10.1258/1355819054308530
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.