Using theory of change to design and evaluate public health interventions: a systematic review
Open accessThe DOI matches its Crossref record; 71 of the 73 references it cites were found in a registry or an index; 5 of the 72 sources its claims cite were checked for support.
Abstract
BACKGROUND: Despite the increasing popularity of the theory of change (ToC) approach, little is known about the extent to which ToC has been used in the design and evaluation of public health interventions. This review aims to determine how ToCs have been developed and used in the development and evaluation of public health interventions globally. METHODS: We searched for papers reporting the use of "theory of change" in the development or evaluation of public health interventions in databases of peer-reviewed journal articles such as Scopus, Pubmed, PsychInfo, grey literature databases, Google and websites of development funders. We included papers of any date, language or study design. Both abstracts and full text papers were double screened. Data were extracted and narratively and quantitatively summarised. RESULTS: A total of 62 papers were included in the review. Forty-nine (79 %) described the development of ToC, 18 (29 %) described the use of ToC in the development of the intervention and 49 (79 %) described the use of ToC in the evaluation of the intervention. Although a large number of papers were included in the review, their descriptions of the ToC development and use in intervention design and evaluation lacked detail. CONCLUSIONS: The use of the ToC approach is widespread in the public health literature. Clear reporting of the ToC process and outputs is important to strengthen the body of literature on practical application of ToC in order to develop our understanding of the benefits and advantages of using ToC. We also propose a checklist for reporting on the use of ToC to ensure transparent reporting and recommend that our checklist is used and refined by authors reporting the ToC approach.
Overview
CoChat Summary
TL;DR
This systematic review found that the theory of change (ToC) approach is widespread in public health literature, with 62 included papers, but descriptions of how ToCs were developed and used in intervention design and evaluation often lacked detail. The authors propose a checklist to improve transparent reporting of ToC processes and outputs.
Key findings
- Of 62 included papers, 49 (79%) described developing a ToC, 18 (29%) described using ToC in intervention development, and 49 (79%) described using ToC in evaluation.
- Among 44 papers where a ToC was displayed or described, long-term change was reported in 40 (90.9%), process/sequence of change in 33 (75%), context in 24 (54.5%), assumptions in 7 (15.9%), and indicators in 4 (9.1%).
- Few papers reported causal explanation elements: 4 (6.5%) identified breakdowns of programme theory, 3 (4.8%) identified unexpected consequences, 10 (16.1%) made cause-and-effect associations explicit, 2 (3.2%) described direction/strength of relationships, and 2 (3.2%) described mediation.
- Only 2 papers explicitly described using ToC to identify indicators for ongoing monitoring of implementation, and no studies used ToC alongside RCTs to unpack programme theory.
Methods
- Systematic review with a pre-agreed protocol; searched peer-reviewed databases (e.g., Scopus, PubMed, PsychInfo), grey literature databases, Google, funder websites, and evaluator mailing lists, with no limits by date, language, or study design.
- Included papers had to self-identify as using a ToC approach, specifically mention “theory of change,” and describe a public health intervention or ToC development; abstracts and full texts were double screened.
- Data were extracted by the first author onto a form covering ToC development, use in design/implementation/evaluation, context, and theory-driven evaluation principles; findings were summarised narratively and quantitatively using STATA 13, with no meta-analysis due to heterogeneity.
Limitations
- The paper states limitations including lack of double data extraction, inability to effectively measure the quality of included papers, and no agreed-upon quality criteria for ToC, compounded by the flexibility of the ToC approach.
- The paper also states it did not contact authors for additional information and did not assess quality of included papers.
- Evident from the text: most included papers provided little detail on ToC development and use, making it difficult to assess thoroughness; the review also notes that many papers did not define ToC and often overlapped with other approaches such as realist evaluation and logic models.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
5 Valid · 1 Not valid · 36 Not checked · 65 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Two papers reported that their evaluation was guided by testing the assumptions in the ToC [29, 34].”
§ Using theory of change to design and evaluate public health interventions: a systematic review > Results > Using ToCs to evaluate public health interventions
What the sources say
- Supportedcites [29] Bacchus LJ, Bewley S, Vitolas CT, Aston G, Jordan P, Murray SF. Evaluation of a domestic violence intervention in the maternity and sexual health services of a UK hospital. Reprod Health Matters. 2010;18(36):147–57. doi: 10.1016/s0968-8080(10)36526-810.1136/ . source
The Methods section states the authors "chose a 'theory of change' approach" whose first stage is "articulating with stakeholders the assumptions made within the programme as to how they expect the intervention to change behaviour and outcomes", and lists the key programme assumptions whose findings are described. The Abstract reinforces this: an "assumption querying" approach was applied and "Programmatic assumptions were identified and tested" using interviews, record review and questionnaires; the Analysis subsection confirms themes "were examined in relation to the assumptions underpinning the intervention". So this paper is one of the evaluations guided by testing ToC assumptions. (LLM, conf=0.92)
- Not checked yetcites [34] Bhattacharjee P. Use of theory of change to guide the design and monitoring of an intervention intended to reduce partner violence and increase protected sex among sex workers. STRIVE Ann Meet. 2013.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“There were some exceptions [40, 56, 64, 72].”
§ Using theory of change to design and evaluate public health interventions: a systematic review > Results > Using ToCs to evaluate public health interventions
What the sources say
- Supportedcites [40] Chandani Y, Noel M, Pomeroy A, Andersson S, Pahl MK, Williams T. Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle. Am J Trop Med Hyg. 2012;87(5):120–6. doi: 10.4269/ajtmh.2012.11-0781 . source
The Methods section says the researchers developed country-specific theories of change to account for varying supply-chain contexts. The Discussion also says their framework accommodated country contexts and that the surveys were tailored to each country. This paper therefore supports its use as an example of research that explored context. Page numbers were not available in our copy. (LLM, conf=0.90)
- Not checked yetcites [56] Macfarlane F, Greenhalgh T, Humphrey C, Hughes J, Butler C, Pawson R. A new workforce in the making?: a case study of strategic human resource management in a whole-system change effort in healthcare. J Health, Organ Manag. 2011;25(1):55–72. doi: 10.1108/14777261111116824 . source
- Not checked yetcites [64] Mookherji S, LaFond A. Strategies to maximize generalization from multiple case studies: lessons from the Africa Routine Immunization System Essentials (ARISE) project. Evaluation. 2013;19(3):284–303. doi: 10.1177/1356389013495212 . source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The quantitative data analysis methods were strongly linked to the types of data collected and included descriptive statistics [33], inferential statistics [27, 40, 42, 43, 74, 78], multilevel modelling [16] and path analysis [41].”
§ Using theory of change to design and evaluate public health interventions: a systematic review > Results > Using ToCs to evaluate public health interventions
What the sources say
- Not checked yetcites [33] Beeston C, Robinson M, Craig N. Monitoring and evaluating Scotland’s alcohol strategy. Setting the scene: theory of change and baseline picture. Edinburgh: NHS Health Scotland; 2011.
- Not checked yetcites [27] Andreas D, Ja DY, Wilson S. Peers reach out supporting peers to embrace recovery (PROSPER): a center for substance abuse treatment recovery community services program. Alcohol Treat Q. 2010;28(3):326–38. doi: 10.1080/07347324.2010.488538 . source
- Supportedcites [40] Chandani Y, Noel M, Pomeroy A, Andersson S, Pahl MK, Williams T. Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle. Am J Trop Med Hyg. 2012;87(5):120–6. doi: 10.4269/ajtmh.2012.11-0781 . source
The citation is attached to “descriptive statistics,” rather than to the citing authors’ broader characterization of how methods related to data types. In Materials and Methods, under “Analysis of survey results,” the source reports using frequencies and cross-tabulations to analyze its survey data. (LLM, conf=0.92)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Secondly, piloting the initial broad search strategy (including all synonyms for ToC and programme logic) returned more than 20,000 hits in only three databases.”
§ Using theory of change to design and evaluate public health interventions: a systematic review > Methods > Inclusion and exclusion criteria
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“49 (79 %) described the use of ToC in the evaluation of the intervention.”
- Also stated in: § Included studies · plain
“Describes the use of ToC in the evaluation of the intervention | 49 (79.0 %)”
§ Using theory of change to design and evaluate public health interventions: a systematic review > Abstract > Results
plainn = 62- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Included studies · plain
53 more claims
Create a free account to see all 107 claims and to verify the 67 references still open.
- It may state two separate claims as one. 27
- Probably not a substantial claim. 29
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“ToC frameworks offer distinct advantages for mental health integration by conceptualizing the interplay between clinical and community-level changes, fostering stakeholder ownership to enhance local relevance, and serving as implementation roadmaps that provide clarity on priorities, sequencing, and evaluation metrics [18, 19].”
From Co-creating systems change for mental health: a theory of change approach from the MeHPriC initiative in Lagos, Nigeria (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Evaluations using ToCs are often criticised for not testing the causal logic of interventions fully (Breuer et al., 2016).”
From Promoting positive youth development with adolescent boys in UK schools: A theory-driven evaluation of the "Becoming a Man" programme (2026) · cites this paper as Breuer et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Using theory of change to design and evaluate public health interventions: a systematic review > Discussion
“Most authors present the long-term outcomes, sequence of change, beneficiaries and context.”
§ Using theory of change to design and evaluate public health interventions: a systematic review > Results > Development of ToCs
“| Beneficiaries | 20 (45.5 %) |”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
(1984) · Cited by 81,983
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · cited 1×
“As ToC is method neutral, this checklist could also be used together with other existing checklists such as the CONSORT statement for RCTs [85], the STROBE guidelines for observational research [86] or CReDECI2 for complex intervention development and evaluation [87].”
MethodVandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
Purposeful Program Theory: Effective Use of Theories of Change and Logic Models
Funnell, S., & Rogers, P. (2011) · RMIT Research Repository (RMIT University Library) · Cited by 897
Research works printed but not linked: 11
- US Department of Health and Human Services, Centres for Disease Conrol and Prevention, Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: a self study guide. Atlanta, GA: Centres for Disease Control and Prevention; 2011.
- Weiss C. Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. In: Connell JP, editor. New approaches to evaluating community initiatives: concepts, methods, and contexts. Washington, DC: Aspen Institute; 1995. p. 65–92.
- Andersen A. A community builder’s approach to theory of change: a practical guide to theory development. New York: The Aspen Insitute; 2004.
- James C. Theory of change review: a report comissioned by Comic Relief; 2011. http://mande.co.uk/2012/uncategorized/comic-relief-theory-of-change-review/ .
- Statcorp. STATA. 13th ed. College Station: Statcorp; 2013.
- Andersen R, Nesman T, Hodges S. Expressing your ideas: using a logic model to create system change USF logic model team, Tampa, Florida. University of South Florida: Tools for Creating and Sustaining Human Services: Theory of Change Logic Models; 2012.
- Beeston C, Robinson M, Craig N. Monitoring and evaluating Scotland’s alcohol strategy. Setting the scene: theory of change and baseline picture. Edinburgh: NHS Health Scotland; 2011.
- Birkby BW. The design and implementation of an evaluation for a comprehensive community-wide initiative on child maltreatment (Kentucky). Kentucky University, US: ProQuest Information & Learning; 2001.
- Goss-Power PJ. Evaluation of a school-based program for youth with emotional and behavioral disabilities. New England Graduate School, US: ProQuest Information & Learning; 2005.
- Henderson PM. Program evaluation of a long-term substance abuse treatment program for homeless men. US: ProQuest Information & Learning; 2004.
- Rodriguez MH, Betanzos-Reyes AF. Grupo de Trabajo de Malaria del Sistema Mesoamericano de Salud P. Plan de mejoramiento del control de la malaria hacia su eliminación en Mesoamérica. Salud Publica Mex. 2011;53 Suppl 3:S333–48.
Cited by
Craig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370
O. B. O. T. C.-S. G., Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018) · Trials · doi:10.1186/s13063-018-2735-z · Cited by 348
“For each intervention evaluated, authors should describe the 'mechanism of action' [51], also known as the 'theory of change' [52], 'programme theory' [53], or 'causal pathway' [54].”
MethodA small wins framework to overcome the evaluation paradox of governing wicked problems
Termeer, C. J. A. M., & Dewulf, A. (2019) · Policy and Society · doi:10.1080/14494035.2018.1497933 · Cited by 251
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z., & Hanson, C. (2020) · Implementation Science · doi:10.1186/s13012-020-0978-z · Cited by 231
Face-to-face interventions for informing or educating parents about early childhood vaccination
Kaufman, J., Ryan, R., Walsh, L., Horey, D., Leask, J., Robinson, P., & Hill, S. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010038.pub3 · Cited by 206
Metadata
- Authors
- Breuer, E., Lee, L., De Silva, M., & Lund, C.
- Affiliations
- University of Cape Town (ZA)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Breuer, Erica
- Venue
- Implementation Science
- Published
- 2015-12
- Volume
- 11
- Issue
- 1
- Pages
- 63-63
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4859947
- OpenAlex
- W2345472301
- Cited by
- 425
- References
- 73
- Citations by year
- 2026: 36 · 2025: 64 · 2024: 71 · 2023: 60 · 2022: 60 · 2021: 36 · 2020: 24 · 2019: 26 · 2018: 38 · 2017: 8 · 2016: 2
- FWCI
- 5.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Open University of Cape Town (University of Cape Town) (submittedVersion, cc-by)
- Open University of Cape Town (University of Cape Town) (submittedVersion)
- Funders
- Department for International Development (GB)
- London School of Hygiene and Tropical Medicine
- Grand Challenges Canada
- Department for International Development
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Keywords
- theory of change, public health interventions, intervention design, intervention evaluation, reporting checklist, reporting transparency, program theory
- MeSH terms
- Health Plan Implementation, Humans, Public Health, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using theory of change to design and evaluate public health interventions: a systematic review. https://app.cochat.ai/papers/10.1186/s13012-016-0422-6
- The paper
- Breuer, E., Lee, L., De Silva, M., & Lund, C. (2015). Using theory of change to design and evaluate public health interventions: a systematic review. Implementation Science. https://doi.org/10.1186/s13012-016-0422-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

