Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.

Realist review - a new method of systematic review designed for complex policy interventions

Pawson, Ray, Greenhalgh, Trisha, Harvey, Gill, Walshe, Kieran · 2005 · Journal of Health Services Research & Policy

Abstract

Evidence-based policy is a dominant theme in contemporary public services but the practical realities and challenges involved in using evidence in policy-making are formidable. Part of the problem is one of complexity. In health services and other public services, we are dealing with complex social interventions which act on complex social systems-things like league tables, performance measures, regulation and inspection, or funding reforms. These are not ‘magic bullets‘ which will always hit their target, but programmes whose effects are crucially dependent on context and implementation. Traditional methods of review focus on measuring and reporting on programme effectiveness, often find that the evidence is mixed or conflicting, and provide little or no clue as to why the intervention worked or did not work when applied in different contexts or circumstances, deployed by different stakeholders, or used for different purposes. This paper offers a model of research synthesis which is designed to work with complex social interventions or programmes, and which is based on the emerging ‘realist’ approach to evaluation. It provides an explanatory analysis aimed at discerning what works for whom, in what circumstances, in what respects and how. The first step is to make explicit the programme theory (or theories) - the underlying assumptions about how an intervention is meant to work and what impacts it is expected to have. We then look for empirical evidence to populate this theoretical framework, supporting, contradicting or modifying the programme theories as it goes. The results of the review combine theoretical understanding and empirical evidence, and focus on explaining the relationship between the context in which the intervention is applied, the mechanisms by which it works and the outcomes which are produced. The aim is to enable decision-makers to reach a deeper understanding of the intervention and how it can be made to work most effectively. Realist review does not provide simple answers to complex questions. It will not tell policy-makers or managers whether something works or not, but will provide the policy and practice community with the kind of rich, detailed and highly practical understanding of complex social interventions which is likely to be of much more use to them when planning and implementing programmes at a national, regional or local level.

Overview

Integrity signals

Registry

Crossref · 10.1258/1355819054308530

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 35 references

Research works printed but not linked: 11

  1. Harré R., 1978, Social Being.
  2. Collier A., 1994, Critical Realism.
  3. Pawson R, 1997, Realistic Evaluation.
  4. Connell J, 1995, New Approaches to Evaluating Community Initiatives.
  5. Pawson R., 2002, Does Megan's Law Work.
  6. 2004, NHS Modernisation Agency Clinical Governance Support Team. Learning Through Supporting Improvements: Change from Challenge?
  7. Pawson R., 2003, Assessing the Quality of Evidence in Evidence-Based Policy: Why, How and When Working Paper No. 1. ESRC Research Methods Programme.
  8. Pawson R., 2004, ESRC Centre for Evidence-Based Policy and Practice.
  9. Weiss CH., 1987, Knowl Creation Diffus Util, 8, 274
  10. Deshpande R., 1981, Knowl Creation Diffus Util, 2, 134
  11. Bate SP, 2002, Report on the ‘Breakthrough’ Collaborative Approach to Quality and Service Improvement in Four Regions of the NHS. A Research Based Evaluation of the Orthopaedic Services Collaborative Within the Eastern, South and West, South East and Trent Regions.

Cited by

See all 3,190

Metadata

Authors
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K.
Affiliations
  • University of Leeds (GB)
  • University College London (GB)
  • University of Manchester (GB)
Venue
Journal of Health Services Research & Policy
Published
2005-07
Volume
10
Issue
1_suppl
Pages
21-34
ISSN
  • 1355-8196 (ISSN-L)
  • 1758-1060
OpenAlex
W2145452196
Cited by
3,190
References
35
Citations by year
2026: 185 · 2025: 266 · 2024: 263 · 2023: 240 · 2022: 241 · 2021: 292 · 2020: 193 · 2019: 165 · 2018: 154 · 2017: 153 · 2016: 138 · 2015: 163 · 2014: 143 · 2013: 178 · 2012: 107
FWCI
8.45
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Journal of Health Services Research & Policy (publishedVersion)
  • PubMed (publishedVersion)
  • Research Explorer (The University of Manchester) (publishedVersion)
  • Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
Funders
Economic and Social Research Council (RES-333-34-3002)
Topics
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
realist review, evidence-based policy, program theory, context-mechanism-outcome, implementation context, health services policy, public service reform, program effectiveness
MeSH terms
Evaluation Studies as Topic, United Kingdom, Models, Theoretical, Practice Patterns, Physicians', Policy Making, State Medicine, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Realist review - a new method of systematic review designed for complex policy interventions. https://app.cochat.ai/papers/10.1258/1355819054308530
The paper
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review - a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy. https://doi.org/10.1258/1355819054308530

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.