Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute
The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Self-citationMethods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Qualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964
Gibbs, G. (2007) · doi:10.4135/9781849208574 · Cited by 4,299
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Cited by
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260
Self-citationTime to challenge the spurious hierarchy of systematic over narrative reviews?
Greenhalgh, T., Thorne, S., & Malterud, K. (2018) · European Journal of Clinical Investigation · doi:10.1111/eci.12931 · Cited by 1,267
Lewin, S., Glenton, C., Munthe-Kaas, H., Carlsen, B., Colvin, C. J., Gülmezoglu, M., Noyes, J., Booth, A., Garside, R., & Rashidian, A. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001895 · Cited by 866
Self-citationThe effects of integrated care: a systematic review of UK and international evidence
Baxter, S., Johnson, M., Chambers, D., Sutton, A., Goyder, E., & Booth, A. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3161-3 · Cited by 678
Noyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Self-citationFlemming, K., Booth, A., Garside, R., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000882 · Cited by 389
Self-citationBenoot, C., Hannes, K., & Bilsen, J. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0114-6 · Cited by 370
Synthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322
“2 A 3–6 This paper is part of a series to explore the implications of complexity for systematic reviews and guideline development, commissioned by WHO.”
Self-citationBleijenberg, N., de Man-van Ginkel, J. M., Trappenburg, J. C. A., Ettema, R. G. A., Sino, C. G., Heim, N., Hafsteindóttir, T. B., Richards, D. A., & Schuurmans, M. J. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.12.001 · Cited by 334
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016) · Evaluation · doi:10.1177/1356389016652743 · Cited by 294
Formulating questions to explore complex interventions within qualitative evidence synthesis
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001107 · Cited by 258
Self-citationCharacteristics of mental health recovery narratives: Systematic review and narrative synthesis
Llewellyn-Beardsley, J., Rennick-Egglestone, S., Callard, F., Crawford, P., Farkas, M., Hui, A., Manley, D., McGranahan, R., Pollock, K., Ramsay, A., et al. (2019) · PLOS ONE · doi:10.1371/journal.pone.0214678 · Cited by 254
“However, in accordance with best-practice recommendations [60] the current study included a structured critical appraisal stage.”
Zhang, M., Ding, H., & Zhang, Y. (2022) · doi:10.20944/preprints202202.0056.v1 · Cited by 211
(2022) · doi:10.3390/bs12050138 · Cited by 211
Booth, A., Noyes, J., Flemming, K., Gerhardus, A., Wahlster, P., van der Wilt, G. J., Mozygemba, K., Refolo, P., Sacchini, D., Tummers, M., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.03.003 · Cited by 198
Self-citationCampbell, M., Katikireddi, S. V., Sowden, A., & Thomson, H. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.08.019 · Cited by 169
Self-citationSingh, N. S., Aryasinghe, S., Smith, J., Khosla, R., Say, L., & Blanchet, K. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000682 · Cited by 144
Self-management interventions: Proposal and validation of a new operational definition
Jonkman, N. H., Schuurmans, M. J., Jaarsma, T., Shortridge-Baggett, L. M., Hoes, A. W., & Trappenburg, J. C. A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.08.001 · Cited by 143
“There has been increasing attention for the challenges of synthesizing and comparing the evidence on complex interventions [1,2].”
BackgroundCampbell, M., Katikireddi, S. V., Sowden, A., McKenzie, J. E., & Thomson, H. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020064 · Cited by 142
Self-citationRohwer, A., Pfadenhauer, L., Burns, J., Brereton, L., Gerhardus, A., Booth, A., Oortwijn, W., & Rehfuess, E. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.06.012 · Cited by 121
Self-citationFletcher, B. R., Hinton, L., Hartmann-Boyce, J., Roberts, N. W., Bobrovitz, N., & McManus, R. J. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2015.08.026 · Cited by 121
“Methods for synthesising qualitative evidence and incorporating qualitative evidence in broader reviews have been developed, and are becoming more commonplace [7, 8].”
MethodInvestigating complexity in systematic reviews of interventions by using a spectrum of methods
Anderson, L. M., Oliver, S. R., Michie, S., Rehfuess, E., Noyes, J., & Shemilt, I. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.014 · Cited by 101
Self-citationCzosnek, L., Lederman, O., Cormie, P., Zopf, E., Stubbs, B., & Rosenbaum, S. (2019) · Mental Health and Physical Activity · doi:10.1016/j.mhpa.2018.11.001 · Cited by 94
Wilson, C., Bungay, H., Munn-Giddings, C., & Boyce, M. (2016) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2015.11.003 · Cited by 76
Wu, Y., Kemps, E., & Prichard, I. (2024) · Body Image · doi:10.1016/j.bodyim.2023.101650 · Cited by 60
Movsisyan, A., Melendez-Torres, G. J., & Montgomery, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.014 · Cited by 50
“Recent academic discussions suggest the integration of a spectrum of methods and types of evidence, including quantitative, qualitative, and mixed-method approaches, when reviewing the evidence on the effectiveness of complex interventions [11,12].”
BackgroundKelly, M. P., Noyes, J., Kane, R. L., Chang, C., Uhl, S., Robinson, K. A., Springs, S., Butler, M. E., & Guise, J.-M. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.012 · Cited by 49
Self-citationMaynard, C., Tariq, S., Sotgiu, G., Migliori, G. B., van den Boom, M., & Field, N. (2023) · eClinicalMedicine · doi:10.1016/j.eclinm.2023.102057 · Cited by 44
The future of Cochrane Neonatal
Soll, R. F., Ovelman, C., & McGuire, W. (2020) · Early Human Development · doi:10.1016/j.earlhumdev.2020.105191 · Cited by 23
When is audit and feedback effective in dementia care? A systematic review
Sykes, M. J., McAnuff, J., & Kolehmainen, N. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.10.013 · Cited by 19
“The one study that could not be included in the graph was an uncontrolled interrupted time series without a comparison group (Petticrew et al., 2013); this study described increases in the hourly number of activity prompts (3.7 to 26.8) and praise (1.3 to 3.2) as a result of audit and feedback by…”
BackgroundInfluentialMoyes, E., Nutman, G., & Mirman, J. H. (2022) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-022-00454-5 · Cited by 19
Mooney, R., Newbigging, K., McCabe, R., McCrone, P., Halvorsrud, K., Raghavan, R., Joseph, D., & Bhui, K. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060086 · Cited by 11
A systematic review of newborn health interventions in humanitarian settings
Rodo, M., Duclos, D., DeJong, J., Akik, C., & Singh, N. S. (2022) · BMJ Global Health · doi:10.1136/bmjgh-2022-009082 · Cited by 11
“17 20 21 The synthesis of results was done by categorising the type of intervention reported, identifying any strategies used to increase utilisation and effectiveness and the implementers of these interventions.”
MethodSystematic reviews and meta-analysis in rheumatology: a gentle introduction for clinicians
Kelley, G. A., & Kelley, K. S. (2019) · Clinical Rheumatology · doi:10.1007/s10067-019-04590-6 · Cited by 8
Alizadeh, N., Packer, T., Chen, Y.-T., & Alnasery, Y. (2023) · Patient Education and Counseling · doi:10.1016/j.pec.2023.107866 · Cited by 8
Metadata
- Authors
- Petticrew, M., Rehfuess, E., Noyes, J., Higgins, J. P. T., Mayhew, A., Pantoja, T., Shemilt, I., & Sowden, A.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2013-11
- Volume
- 66
- Issue
- 11
- Pages
- 1230-1243
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2061912725
- Cited by
- 292
- References
- 66
- FWCI
- 24.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.