CoChat

Using theory of change to design and evaluate public health interventions: a systematic review

Open access
Breuer, Erica, Lee, Lucy, De Silva, Mary, Lund, Crick · 2015 · Implementation Science

The DOI matches its Crossref record; 71 of the 73 references it cites were found in a registry or an index; 5 of the 72 sources its claims cite were checked for support.

Abstract

BACKGROUND: Despite the increasing popularity of the theory of change (ToC) approach, little is known about the extent to which ToC has been used in the design and evaluation of public health interventions. This review aims to determine how ToCs have been developed and used in the development and evaluation of public health interventions globally. METHODS: We searched for papers reporting the use of "theory of change" in the development or evaluation of public health interventions in databases of peer-reviewed journal articles such as Scopus, Pubmed, PsychInfo, grey literature databases, Google and websites of development funders. We included papers of any date, language or study design. Both abstracts and full text papers were double screened. Data were extracted and narratively and quantitatively summarised. RESULTS: A total of 62 papers were included in the review. Forty-nine (79 %) described the development of ToC, 18 (29 %) described the use of ToC in the development of the intervention and 49 (79 %) described the use of ToC in the evaluation of the intervention. Although a large number of papers were included in the review, their descriptions of the ToC development and use in intervention design and evaluation lacked detail. CONCLUSIONS: The use of the ToC approach is widespread in the public health literature. Clear reporting of the ToC process and outputs is important to strengthen the body of literature on practical application of ToC in order to develop our understanding of the benefits and advantages of using ToC. We also propose a checklist for reporting on the use of ToC to ensure transparent reporting and recommend that our checklist is used and refined by authors reporting the ToC approach.

Overview

CoChat Summary

TL;DR

This systematic review found that the theory of change (ToC) approach is widespread in public health literature, with 62 included papers, but descriptions of how ToCs were developed and used in intervention design and evaluation often lacked detail. The authors propose a checklist to improve transparent reporting of ToC processes and outputs.

Key findings

  • Of 62 included papers, 49 (79%) described developing a ToC, 18 (29%) described using ToC in intervention development, and 49 (79%) described using ToC in evaluation.
  • Among 44 papers where a ToC was displayed or described, long-term change was reported in 40 (90.9%), process/sequence of change in 33 (75%), context in 24 (54.5%), assumptions in 7 (15.9%), and indicators in 4 (9.1%).
  • Few papers reported causal explanation elements: 4 (6.5%) identified breakdowns of programme theory, 3 (4.8%) identified unexpected consequences, 10 (16.1%) made cause-and-effect associations explicit, 2 (3.2%) described direction/strength of relationships, and 2 (3.2%) described mediation.
  • Only 2 papers explicitly described using ToC to identify indicators for ongoing monitoring of implementation, and no studies used ToC alongside RCTs to unpack programme theory.

Methods

  • Systematic review with a pre-agreed protocol; searched peer-reviewed databases (e.g., Scopus, PubMed, PsychInfo), grey literature databases, Google, funder websites, and evaluator mailing lists, with no limits by date, language, or study design.
  • Included papers had to self-identify as using a ToC approach, specifically mention “theory of change,” and describe a public health intervention or ToC development; abstracts and full texts were double screened.
  • Data were extracted by the first author onto a form covering ToC development, use in design/implementation/evaluation, context, and theory-driven evaluation principles; findings were summarised narratively and quantitatively using STATA 13, with no meta-analysis due to heterogeneity.

Limitations

  • The paper states limitations including lack of double data extraction, inability to effectively measure the quality of included papers, and no agreed-upon quality criteria for ToC, compounded by the flexibility of the ToC approach.
  • The paper also states it did not contact authors for additional information and did not assess quality of included papers.
  • Evident from the text: most included papers provided little detail on ToC development and use, making it difficult to assess thoroughness; the review also notes that many papers did not define ToC and often overlapped with other approaches such as realist evaluation and logic models.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s13012-016-0422-6

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Results of database, abstract and full text screening
Fig. 1 Results of database, abstract and full text screeningCC BY · PubMed Central
Fig. 2 Histogram of number of publications per year
Fig. 2 Histogram of number of publications per yearCC BY · PubMed Central

Verification

Claims the paper makes

5 Valid · 1 Not valid · 36 Not checked · 65 Own results and interpretations

53 more claims

Create a free account to see all 107 claims and to verify the 67 references still open.

See all claims — free account
  • It may state two separate claims as one. 27
  • Probably not a substantial claim. 29
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 71 references

Research works printed but not linked: 11

  1. US Department of Health and Human Services, Centres for Disease Conrol and Prevention, Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: a self study guide. Atlanta, GA: Centres for Disease Control and Prevention; 2011.
  2. Weiss C. Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. In: Connell JP, editor. New approaches to evaluating community initiatives: concepts, methods, and contexts. Washington, DC: Aspen Institute; 1995. p. 65–92.
  3. Andersen A. A community builder’s approach to theory of change: a practical guide to theory development. New York: The Aspen Insitute; 2004.
  4. James C. Theory of change review: a report comissioned by Comic Relief; 2011. http://mande.co.uk/2012/uncategorized/comic-relief-theory-of-change-review/ .
  5. Statcorp. STATA. 13th ed. College Station: Statcorp; 2013.
  6. Andersen R, Nesman T, Hodges S. Expressing your ideas: using a logic model to create system change USF logic model team, Tampa, Florida. University of South Florida: Tools for Creating and Sustaining Human Services: Theory of Change Logic Models; 2012.
  7. Beeston C, Robinson M, Craig N. Monitoring and evaluating Scotland’s alcohol strategy. Setting the scene: theory of change and baseline picture. Edinburgh: NHS Health Scotland; 2011.
  8. Birkby BW. The design and implementation of an evaluation for a comprehensive community-wide initiative on child maltreatment (Kentucky). Kentucky University, US: ProQuest Information & Learning; 2001.
  9. Goss-Power PJ. Evaluation of a school-based program for youth with emotional and behavioral disabilities. New England Graduate School, US: ProQuest Information & Learning; 2005.
  10. Henderson PM. Program evaluation of a long-term substance abuse treatment program for homeless men. US: ProQuest Information & Learning; 2004.
  11. Rodriguez MH, Betanzos-Reyes AF. Grupo de Trabajo de Malaria del Sistema Mesoamericano de Salud P. Plan de mejoramiento del control de la malaria hacia su eliminación en Mesoamérica. Salud Publica Mex. 2011;53 Suppl 3:S333–48.

Cited by

See all 425

Metadata

Authors
Breuer, E., Lee, L., De Silva, M., & Lund, C.
Affiliations
  • University of Cape Town (ZA)
  • London School of Hygiene & Tropical Medicine (GB)
Corresponding author
Breuer, Erica
Venue
Implementation Science
Published
2015-12
Volume
11
Issue
1
Pages
63-63
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2345472301
Cited by
425
References
73
Citations by year
2026: 36 · 2025: 64 · 2024: 71 · 2023: 60 · 2022: 60 · 2021: 36 · 2020: 24 · 2019: 26 · 2018: 38 · 2017: 8 · 2016: 2
FWCI
5.28
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Implementation Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
  • Open University of Cape Town (University of Cape Town) (submittedVersion, cc-by)
  • Open University of Cape Town (University of Cape Town) (submittedVersion)
Funders
  • Department for International Development (GB)
  • London School of Hygiene and Tropical Medicine
  • Grand Challenges Canada
  • Department for International Development
Topics
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
Keywords
theory of change, public health interventions, intervention design, intervention evaluation, reporting checklist, reporting transparency, program theory
MeSH terms
Health Plan Implementation, Humans, Public Health, Research Design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using theory of change to design and evaluate public health interventions: a systematic review. https://app.cochat.ai/papers/10.1186/s13012-016-0422-6
The paper
Breuer, E., Lee, L., De Silva, M., & Lund, C. (2015). Using theory of change to design and evaluate public health interventions: a systematic review. Implementation Science. https://doi.org/10.1186/s13012-016-0422-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.