Do complexity-informed health interventions work? A scoping review
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The lens of complexity theory is widely advocated to improve health care delivery. However, empirical evidence that this lens has been useful in designing health care remains elusive. This review assesses whether it is possible to reliably capture evidence for efficacy in results or process within interventions that were informed by complexity science and closely related conceptual frameworks. METHODS: Systematic searches of scientific and grey literature were undertaken in late 2015/early 2016. Titles and abstracts were screened for interventions (A) delivered by the health services, (B) that explicitly stated that complexity science provided theoretical underpinning, and (C) also reported specific outcomes. Outcomes had to relate to changes in actual practice, service delivery or patient clinical indicators. Data extraction and detailed analysis was undertaken for studies in three developed countries: Canada, UK and USA. Data were extracted for intervention format, barriers encountered and quality aspects (thoroughness or possible biases) of evaluation and reporting. RESULTS: From 5067 initial finds in scientific literature and 171 items in grey literature, 22 interventions described in 29 articles were selected. Most interventions relied on facilitating collaboration to find solutions to specific or general problems. Many outcomes were very positive. However, some outcomes were measured only subjectively, one intervention was designed with complexity theory in mind but did not reiterate this in subsequent evaluation and other interventions were credited as compatible with complexity science but reported no relevant theoretical underpinning. Articles often omitted discussion on implementation barriers or unintended consequences, which suggests that complexity theory was not widely used in evaluation. CONCLUSIONS: It is hard to establish cause and effect when attempting to leverage complex adaptive systems and perhaps even harder to reliably find evidence that confirms whether complexity-informed interventions are usually effective. While it is possible to show that interventions that are compatible with complexity science seem efficacious, it remains difficult to show that explicit planning with complexity in mind was particularly valuable. Recommendations are made to improve future evaluation reports, to establish a better evidence base about whether this conceptual framework is useful in intervention design and implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
The challenge of complexity in health care
Plsek, P. E., & Greenhalgh, T. (2001) · BMJ · doi:10.1136/bmj.323.7313.625 · Cited by 2,578 · cited 3×
“Nonetheless, recognizing the inherent properties of complex systems may suggest opportunities to design more effective health care delivery [1, 4, 7].”
BackgroundEvidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · cited 2×
“As a result, possible solutions to some public health issues are not well-suited to the otherwise gold standard test method for intervention research (randomized controlled trials) [2, 3, 8], due to the sheer complexity of inputs as well as diverse interpretations or relative importance of many inputs and outputs.”
BackgroundOrganizations as complex adaptive systems: Implications of Complexity Theory for leadership research
Schneider, M., & Somers, M. (2006) · The Leadership Quarterly · doi:10.1016/j.leaqua.2006.04.006 · Cited by 599 · cited 1×
“These include the phrases (each citation indicates distinctions from applications using complexity science) “systems change” [20], “complex interventions” [6], “systems science” [21] and “quality improvement” [22].”
BackgroundImplementing innovative models of dementia care: the healthy aging brain center
Boustani, M. A., Sachs, G. A., Alder, C. A., Munger, S., Schubert, C. C., Guerriero Austrom, M., Hake, A. M., Unverzagt, F. W., Farlow, M., Matthews, B. R., et al. (2011) · Aging & Mental Health · doi:10.1080/13607863.2010.496445 · Cited by 142 · cited 2×
“efficiency in filling out paperwork [43] or fewer patient hospitalisations [46]), but were somewhat less likely than UK/ Canadian applications to look for (in evaluation methods) unintended consequences, and tended towards shorter evaluation periods.”
Background
Cited by
Braithwaite, J., Churruca, K., Long, J. C., Ellis, L. A., & Herkes, J. (2018) · BMC Medicine · doi:10.1186/s12916-018-1057-z · Cited by 845
Moore, G. F., Evans, R. E., Hawkins, J., Littlecott, H., Melendez-Torres, G. J., Bonell, C., & Murphy, S. (2019) · Evaluation · doi:10.1177/1356389018803219 · Cited by 471
“In particular, a growing literature has advocated movement toward complex systems approaches to social intervention research (Brainard and Hunter, 2016; Hawe et al., 2009; Howarth et al., 2016; Moore and Evans, 2017; Rutter et al., 2017; Shiell et al., 2008).”
BackgroundCraig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370
Designing and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J. M., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 270
Patient-centred care and patient autonomy: doctors’ views in Chinese hospitals
Liang, Z., Xu, M., Liu, G., Zhou, Y., & Howard, P. (2022) · BMC Medical Ethics · doi:10.1186/s12910-022-00777-w · Cited by 47
Metadata
- Authors
- Brainard, J., & Hunter, P. R.
- Venue
- Implementation Science
- Published
- 2015-12
- Volume
- 11
- Issue
- 1
- Pages
- 127-127
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2522454764
- Cited by
- 93
- References
- 5
- FWCI
- 8.18
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do complexity-informed health interventions work? A scoping review. https://app.cochat.ai/papers/10.1186/s13012-016-0492-5
- The paper
- Brainard, J., & Hunter, P. R. (2015). Do complexity-informed health interventions work? A scoping review. Implementation Science. https://doi.org/10.1186/s13012-016-0492-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.