Process evaluation: the new miracle ingredient in public health research?
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Good evaluation practice in public health research has become equated with the inclusion of a mixed-methods ‘process evaluation’ alongside an ‘outcome evaluation’ to gather data on how and why interventions are effective or ineffective. While the incorporation of process evaluations in randomized controlled trials is to be welcomed, there is a danger that they are being oversold. The problematic position of process evaluations is illustrated by data from an evaluation of an unsuccessful schools health promotion intervention. The process evaluation data (designed to ‘explain’ the outcome evaluation results) must be collected before the outcome evaluation results are typically available: unanticipated outcomes cannot always be addressed satisfactorily from prior process data. Further, qualitative process data draw inductively general inferences from particular circumstances and the generalizability of those inferences is therefore uncertain: qualitative data can deepen our understanding of quantitative data, but the commensurability of the two classes of data remains problematic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247 · cited 3×
“It has therefore become commonplace, and considered as part of good research practice, for a ‘process evaluation’ to be paired with an ‘outcome evaluation’ in the design of studies of complex interventions (Oakley et al., 2006; O’Cathain, 2009).”
BackgroundEvidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · cited 1×
“…of educational interventions and public health initiatives, involves the assessment of ‘complex interventions’ (Giannakaki, 2005; Oakley et al., 2006; Victora et al., 2004; Young et al., 2008), that is to say that the interventions are multifaceted, organizationally elaborate, and socially…”
BackgroundCampbell, R., Starkey, F., Holliday, J., Audrey, S., Bloor, M., Parry-Langdon, N., Hughes, R., & Moore, L. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60692-3 · Cited by 583 · cited 1×
“Based on the successful ASSIST (A Stop Smoking In Schools Trial) programme for reducing the uptake of cigarette smoking amongst adolescents (Campbell et al., 2008), the intervention aimed to train a proportion of ‘influential’ S2 school pupils (second year of Scottish secondary school) to intervene…”
MethodSelf-citationThe Case for Combining Qualitative and Quantitative Approaches in Health Services Research
Barbour, R. S. (1999) · Journal of Health Services Research & Policy · doi:10.1177/135581969900400110 · Cited by 280 · cited 1×
“The use of multiple methods has long been the hallmark of good research design (see, for example, Barbour, 1999).”
MethodYoung, D. R., Steckler, A., Cohen, S., Pratt, C., Felton, G., Moe, S. G., Pickrel, J., Johnson, C. C., Grieser, M., Lytle, L. A., et al. (2007) · Health Education Research · doi:10.1093/her/cyn029 · Cited by 78 · cited 2×
“…educational interventions and public health initiatives, involves the assessment of ‘complex interventions’ (Giannakaki, 2005; Oakley et al., 2006; Victora et al., 2004; Young et al., 2008), that is to say that the interventions are multifaceted, organizationally elaborate, and socially mediated.”
Background
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
“28 Hence, when feasible, it is often useful to combine quantitative data on key process variables from all sites or participants with in-depth qualitative data from samples purposively selected along dimensions expected to influence the functioning of the intervention.”
O’Cathain, A., Thomas, K. J., Drabble, S. J., Rudolph, A., Goode, J., & Hewison, J. (2014) · Health Technology Assessment · doi:10.3310/hta18380 · Cited by 159
Clarke, D. J., Godfrey, M., Hawkins, R., Sadler, E., Harding, G., Forster, A., McKevitt, C., Dickerson, J., & Farrin, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-96 · Cited by 88
Chittleborough, C. R., Nicholson, A. L., Basker, E., Bell, S., & Campbell, R. (2012) · Health Education Research · doi:10.1093/her/cys061 · Cited by 87
“were not influenced by prior knowledge of trial results [30].”
BackgroundQualitative Methods and Process Evaluation in Clinical Trials Context: Where to Head to?
Cheng, K. K. F., & Metcalfe, A. (2018) · International Journal of Qualitative Methods · doi:10.1177/1609406918774212 · Cited by 57
“Instead, it relates to how and why the intervention works or does not work in the context of the trial (Lewin et al., 2009; Munro & Bloor, 2010).”
Background
Metadata
- Authors
- Munro, A., & Bloor, M.
- Venue
- Qualitative Research
- Publisher
- SAGE Publications
- Published
- 2010-12
- Volume
- 10
- Issue
- 6
- Pages
- 699-713
- ISSN
- 1468-7941 (ISSN-L)
- 1741-3109
- OpenAlex
- W1964040638
- Cited by
- 59
- References
- 5
- FWCI
- 4.36
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Process evaluation: the new miracle ingredient in public health research? https://app.cochat.ai/papers/10.1177/1468794110380522
- The paper
- Munro, A., & Bloor, M. (2010). Process evaluation: the new miracle ingredient in public health research? Qualitative Research. https://doi.org/10.1177/1468794110380522
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.