Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
BACKGROUND: To improve quality of care and patient outcomes, health system decision-makers need to identify and implement effective interventions. An increasing number of systematic reviews document the effects of quality improvement programs to assist decision-makers in developing new initiatives. However, limitations in the reporting of primary studies and current meta-analysis methods (including approaches for exploring heterogeneity) reduce the utility of existing syntheses for health system decision-makers. This study will explore the role of innovative meta-analysis approaches and the added value of enriched and updated data for increasing the utility of systematic reviews of complex interventions. METHODS/DESIGN: We will use the dataset from our recent systematic review of 142 randomized trials of diabetes quality improvement programs to evaluate novel approaches for exploring heterogeneity. These will include exploratory methods, such as multivariate meta-regression analyses and all-subsets combinatorial meta-analysis. We will then update our systematic review to include new trials and enrich the dataset by surveying authors of all included trials. In doing so, we will explore the impact of variables not, reported in previous publications, such as details of study context, on the effectiveness of the intervention. We will use innovative analytical methods on the enriched and updated dataset to identify key success factors in the implementation of quality improvement interventions for diabetes. Decision-makers will be involved throughout to help identify and prioritize variables to be explored and to aid in the interpretation and dissemination of results. DISCUSSION: This study will inform future systematic reviews of complex interventions and describe the value of enriching and updating data for exploring heterogeneity in meta-analysis. It will also result in an updated comprehensive systematic review of diabetes quality improvement interventions that will be useful to health system decision-makers in developing interventions to improve outcomes for people with diabetes. SYSTEMATIC REVIEW REGISTRATION: PROSPERO registration no. CRD42013005165.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Self-citationAnalysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
The Design and Administration of Mail Surveys
Dillman, D. A. (1991) · Annual Review of Sociology · doi:10.1146/annurev.so.17.080191.001301 · Cited by 1,311
Successes and Failures in the Implementation of Evidence-Based Guidelines for Clinical Practice
Grol, R. (2001) · Medical Care · doi:10.1097/00005650-200108002-00003 · Cited by 1,233 · cited 1×
“care provided by health care professionals and health systems [1-3].”
BackgroundClosing the Gap between Methodologists and End-Users: R as a Computational Back-End
Wallace, B. C., Dahabreh, I. J., Trikalinos, T. A., Lau, J., Trow, P., & Schmid, C. H. (2012) · Journal of Statistical Software · doi:10.18637/jss.v049.i05 · Cited by 1,125 · cited 2×
“Meta-analyses will be conducted in Comprehensive Meta-analysis (version 2.2.050) and meta-regression analyses with SAS (version 9.2; SAS Institute, Cary, NC, USA) and OpenMetaanalyst (version 3, Center for Evidence-based Medicine, Brown University, Providence, RI, USA) [35,36].”
InfluentialSelf-citationSpecifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Self-citationTricco, A. C., Ivers, N. M., Grimshaw, J. M., Moher, D., Turner, L., Galipeau, J., Halperin, I., Vachon, B., Ramsay, T., Manns, B., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60480-2 · Cited by 652 · cited 4×
“systematic review of 12 QI interventions for diabetes [19].”
BackgroundMethodInfluentialSelf-citationWhat is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Explaining Michigan: Developing an Ex Post Theory of a Quality Improvement Program
DIXON-WOODS, M., BOSK, C. L., AVELING, E. L., GOESCHEL, C. A., & PRONOVOST, P. J. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00625.x · Cited by 603 · cited 1×
“Understanding the effectiveness of each component of a QI program is a prerequisite for informing program development [6].”
Background
Cited by
Synthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322
“More sophisticated models for examining components have been described by Welton et al , 55 Ivers et al 56 and Madan et al .”
MethodSelf-citationThe impact of hospital accreditation on the quality of healthcare: a systematic literature review
Hussein, M., Pavlova, M., Ghalwash, M., & Groot, W. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07097-6 · Cited by 239
Lu, J. B., Danko, K. J., Elfassy, M. D., Welch, V., Grimshaw, J. M., & Ivers, N. M. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018826 · Cited by 34
Self-citationInterventions to increase attendance for diabetic retinopathy screening
Lawrenson, J. G., Graham-Rowe, E., Lorencatto, F., Presseau, J., Burr, J., Ivers, N., Quartilho, A., Bunce, C., Francis, J. J., Grimshaw, J. M., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012054 · Cited by 10
Self-citation
Metadata
- Authors
- Ivers, N., Tricco, A. C., Trikalinos, T. A., Dahabreh, I. J., Danko, K. J., Moher, D., Straus, S. E., Lavis, J. N., Yu, C. H., Shojania, K., Manns, B., Tonelli, M., Ramsay, T., Edwards, A., Sargious, P., Paprica, A., Hillmer, M., & Grimshaw, J. M.
- Venue
- Systematic Reviews
- Published
- 2014-08-12
- Volume
- 3
- Issue
- 1
- Pages
- 88-88
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2120631909
- Cited by
- 31
- References
- 9
- FWCI
- 0.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol. https://app.cochat.ai/papers/10.1186/2046-4053-3-88
- The paper
- Ivers, N., Tricco, A. C., Trikalinos, T. A., Dahabreh, I. J., Danko, K. J., Moher, D., Straus, S. E., Lavis, J. N., Yu, C. H., Shojania, K., Manns, B., Tonelli, M., Ramsay, T., Edwards, A., Sargious, P., Paprica, A., Hillmer, M., & Grimshaw, J. M. (2014). Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol. Systematic Reviews. https://doi.org/10.1186/2046-4053-3-88
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.