Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 296Evaluation and Performance AssessmentHealth Policy Implementation ScienceAdvanced Causal Inference Techniques

The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index; none of the 79 sources its claims cite is checked for support yet.

Realist complex intervention science: Applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions

Open access

Abstract

The integration of realist evaluation principles within randomised controlled trials (‘realist RCTs’) enables evaluations of complex interventions to answer questions about what works, for whom and under what circumstances. This allows evaluators to better develop and refine mid-level programme theories. However, this is only one phase in the process of developing and evaluating complex interventions. We describe and exemplify how social scientists can integrate realist principles across all phases of the Medical Research Council framework. Intervention development, modelling, and feasibility and pilot studies need to theorise the contextual conditions necessary for intervention mechanisms to be activated. Where interventions are scaled up and translated into routine practice, realist principles also have much to offer in facilitating knowledge about longer-term sustainability, benefits and harms. Integrating a realist approach across all phases of complex intervention science is vital for considering the feasibility and likely effects of interventions for different localities and population subgroups.

Overview

CoChat Summary

TL;DR

This conceptual article argues that realist evaluation principles should be integrated across all phases of the MRC framework for complex interventions, not only in effectiveness trials. It proposes methods for theorising context–mechanism–outcome configurations during development, feasibility/piloting, realist RCTs, and scale-up evaluations.

Key findings

  • Realist principles can be applied across intervention development, feasibility and pilot studies, realist RCTs, and scale-up evaluations to ask what works, for whom, and under what circumstances.
  • The authors recommend mixed-method evidence synthesis, formative mixed-method multi-case-study research, and pragmatic formative process evaluation to build “3-D” logic models that include contextual dimensions alongside inputs and outcomes.
  • Realist RCTs combine randomisation with theory testing, mediation and moderation analyses, and qualitative process data; examples include the Welsh National Exercise Referral Scheme, where effects varied by referral subgroup, and a whole-school restorative approach trial.
  • Scale-up evaluation of IMAGE suggested community mobilisation components were often not sustainable in some contexts, refining theory about why effects may have been limited to women themselves. The Public Health Improvement Research Network in Wales supported 122 multidisciplinary research development groups and secured 72 externally funded projects between 2006 and 2014.

Methods

  • Design: conceptual and methodological article, not an empirical study; it draws on case examples of realist studies across phases of the MRC framework.
  • Data/sample: illustrative examples include a formative study in six further education colleges, a four-arm cluster randomised pilot trial in 12 secondary schools in south Wales, the Welsh NERS trial, a whole-school restorative approach pilot and RCT, and the IMAGE scale-up evaluation.
  • Analysis: narrative argument and synthesis of prior literature and case examples to propose how realist principles can be integrated into intervention development, feasibility/piloting, effectiveness trials, and implementation/scale-up studies.

Limitations

  • Stated: the major barrier to formally testing CMO configurations within individual studies is that trials often have small sample sizes, powered for primary outcomes but not necessarily for secondary or intermediate process outcomes; trials are rarely designed for mediator or subgroup analyses, and clinical trials units often reject such secondary analyses for fear of false positives and “data dredging.”
  • Stated: there is concern that new UK anti-lobbying regulations may limit knowledge exchange between policymakers and researchers.
  • Evident from the text: this is a conceptual proposal illustrated by selected examples rather than a systematic review or empirical test, so the recommended approach is not itself evaluated here.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1177/1356389016652743

Cites

81 of 81 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 1 Not valid · 68 Not checked · 28 Own results and interpretations

44 more claims

Create a free account to see all 97 claims and to verify the 79 references still open.

See all claims — free account
  • Probably not a substantial claim. 27
  • It may state two separate claims as one. 23

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

13 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 81 references

Research works printed but not linked: 5

  1. Anderson R, 2008, BMJ, 337, 944
  2. Griffiths F, 2000, British Journal of General Practice, 50, 913
  3. Moore G, 2014, Process Evaluation of Complex Interventions: Medical Research Council guidance
  4. Pawson R, 1997, Realistic Evaluation
  5. Weiss CH, 1995, New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts, 65

Cited by

See all 296

Metadata

Authors
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C.
Affiliations
  • Cardiff University (GB)
  • University College London (GB)
  • London School of Hygiene & Tropical Medicine (GB)
Corresponding author
Fletcher, Adam
Venue
Evaluation
Published
2016-06-02
Volume
22
Issue
3
Pages
286-303
ISSN
  • 1356-3890 (ISSN-L)
  • 1461-7153
OpenAlex
W2413220774
Cited by
294
References
81
Citations by year
2026: 24 · 2025: 26 · 2024: 24 · 2023: 23 · 2022: 26 · 2021: 64 · 2020: 40 · 2019: 29 · 2018: 24 · 2017: 14
FWCI
24.48
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Evaluation (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
  • LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
Funders
  • Wellcome Trust
  • Health and Care Research Wales (SCF-14-09)
  • Medical Research Council (MR/K023233/1)
Topics
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords
realist evaluation, complex interventions, MRC framework, intervention development, intervention mechanisms, contextual factors, program theory, feasibility study, pilot study, scale-up, sustainability, benefits and harms, routine practice, randomized controlled trials

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Realist complex intervention science: Applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions. https://app.cochat.ai/papers/10.1177/1356389016652743
The paper
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016). Realist complex intervention science: Applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions. Evaluation. https://doi.org/10.1177/1356389016652743

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.