Building programme theory to develop more adaptable and scalable complex interventions: Realist formative process evaluation prior to full trial
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Medical Research Council guidelines recognise the need to optimise complex interventions prior to full trial through greater understanding of underlying theory and formative process evaluation, yet there are few examples. A realist approach to formative process evaluation makes a unique contribution through a focus on theory formalisation and abstraction. The success of an intervention is dependent on the extent to which it gels or jars with existing provision and can be successfully transferred to new contexts. Interventions with underlying programme theory about how they work, for whom, and under which circumstances will be better able to adapt to work with (rather than against) different services, individuals, and settings. In this methodological article, we describe and illustrate how a realist approach to formative process evaluation develops contextualised intervention theory that can underpin more adaptable and scalable interventions. We discuss challenges and benefits of this approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Qualitative data analysis for applied policy research
Ritchie, J., & Spencer, L. (2010) · Analyzing qualitative data · doi:10.4324/9780203413081_chapter_9 · Cited by 4,800
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 1×
“…of as the way in which a programme’s resources or opportunities interact with the reasoning of individuals and produce behaviour change (Pawson et al., 1997), and these are held to be enabled or constrained by a wider configuration of factors (‘contexts’ (Pawson, 2006; Pawson et al., 2005).”
Sayer, A. (2000) · doi:10.4135/9781446218730 · Cited by 2,259 · cited 1×
“Generative mechanisms are seen to be discernible within the social systems in which they operate (Bhaskar, 2013; Sayer, 2000).”
Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001862 · Cited by 1,871 · cited 1×
“These changes share similarities with other quality improvement approaches such as the use of Plan-Do-Study-Act cycles in Quality Improvement (see Taylor et al., 2013) and action research (e.g. Waterman et al., 2001).”
MethodPawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658 · cited 3×
“Medical Research Council (MRC) guidance emphasises the use of evaluation to build theory, understand causal mechanisms and optimise delivery during feasibility and piloting, but does not include illustrative case studies of formative process evaluations (Craig et al., 2013; Moore et al., 2015).”
Self-citationThe Science of Evaluation: A Realist Manifesto
Pawson, R. (2013) · doi:10.4135/9781473913820 · Cited by 1,271
Complex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244
What’s in a mechanism? Development of a key concept in realist evaluation
Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015) · Implementation Science · doi:10.1186/s13012-015-0237-x · Cited by 896
RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880 · cited 2×
“Coming up with solutions to complex problems in complex systems is challenging and requires in-depth understanding of the nature of interventions and their implementation contexts (Wong et al., 2016).”
The craft of interviewing in realist evaluation
Manzano, A. (2016) · Evaluation · doi:10.1177/1356389016638615 · Cited by 691
Lessons from Complex Interventions to Improve Health
Hawe, P. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031912-114421 · Cited by 607
Bonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582 · cited 1×
“(Dalkin et al., 2015; Williams, 2018); paradigmatic, such as debates about the (in)commensurability of experimental and realist approaches (Bonell et al., 2012, 2016, 2018; Marchal et al., 2013; Van Belle et al., 2016); and practical, such as how a realist approach can be applied in low-resource…”
How Do You Modernize a Health Service? A Realist Evaluation of Whole‐Scale Transformation in London
GREENHALGH, T., HUMPHREY, C., HUGHES, J., MACFARLANE, F., BUTLER, C., & PAWSON, R. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00562.x · Cited by 380
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016) · Evaluation · doi:10.1177/1356389016652743 · Cited by 294 · cited 5×
“, 2015) and only limited mention of the role of context in shaping implementation and causal processes is made in the MRC complex intervention guidance (Fletcher et al., 2016).”
Influential
Cited by
Adapting interventions to new contexts—The ADAPT guidance
Moore, G., Campbell, M., Copeland, L., Craig, P., Movsisyan, A., Hoddinott, P., Littlecott, H., O’Cathain, A., Pfadenhauer, L., Rehfuess, E., et al. (2021) · BMJ · doi:10.1136/bmj.n1679 · Cited by 511
Movsisyan, A., Arnold, L., Evans, R., Hallingberg, B., Moore, G., O’Cathain, A., Pfadenhauer, L. M., Segrott, J., & Rehfuess, E. (2019) · Implementation Science · doi:10.1186/s13012-019-0956-5 · Cited by 331
“No paper directly guides the user to critically examine the underlying mechanisms and the possible contextual interactions that could matter in the replicability of the effects [78, 79].”
BackgroundContext matters—the phased development of an adaptable food literacy intervention: Up for Cooking
Harms, L. S. E., van Assema, P., Gubbels, J. S., Gerards, S. M. P. L., Linssen, E., Vonken, L., & Bessems, K. M. H. H. (2023) · Health Promotion International · doi:10.1093/heapro/daad071 · Cited by 9
Green, F., Preece, C., Allen, K., Manzi, S., Mannes, J., Callaghan, L., Berry, V., de Lima, E. S., Woodburn, A., Hobbs, T., et al. (2026) · Journal of Prevention · doi:10.1007/s10935-025-00888-1 · Cited by 2
“Qualitative data were analysed using framework analysis (Ritchie & Spen - cer, 1994 ; Brand et al., 2019 ; Gale et al., 2013), a deductive method suitable for researchers with predefined ideas of how to interpret the data (guided here by the ToC).”
Self-citation
Metadata
- Authors
- Brand, S. L., Quinn, C., Pearson, M., Lennox, C., Owens, C., Kirkpatrick, T., Callaghan, L., Stirzaker, A., Michie, S., Maguire, M., Shaw, J., & Byng, R.
- Venue
- Evaluation
- Publisher
- SAGE Publications
- Published
- 2018-10-08
- Volume
- 25
- Issue
- 2
- Pages
- 149-170
- ISSN
- 1356-3890 (ISSN-L)
- 1461-7153
- OpenAlex
- W2897480550
- Cited by
- 56
- References
- 16
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.