Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Systematic reviews can include cluster-randomised controlled trials (C-RCTs), which require different analysis compared with standard individual-randomised controlled trials. However, it is not known whether review authors follow the methodological and reporting guidance when including these trials. The aim of this study was to assess the methodological and reporting practice of Cochrane reviews that included C-RCTs against criteria developed from existing guidance. METHODS: Criteria were developed, based on methodological literature and personal experience supervising review production and quality. Criteria were grouped into four themes: identifying, reporting, assessing risk of bias, and analysing C-RCTs. The Cochrane Database of Systematic Reviews was searched (2nd December 2013), and the 50 most recent reviews that included C-RCTs were retrieved. Each review was then assessed using the criteria. RESULTS: The 50 reviews we identified were published by 26 Cochrane Review Groups between June 2013 and November 2013. For identifying C-RCTs, only 56% identified that C-RCTs were eligible for inclusion in the review in the eligibility criteria. For reporting C-RCTs, only eight (24%) of the 33 reviews reported the method of cluster adjustment for their included C-RCTs. For assessing risk of bias, only one review assessed all five C-RCT-specific risk-of-bias criteria. For analysing C-RCTs, of the 27 reviews that presented unadjusted data, only nine (33%) provided a warning that confidence intervals may be artificially narrow. Of the 34 reviews that reported data from unadjusted C-RCTs, only 13 (38%) excluded the unadjusted results from the meta-analyses. CONCLUSIONS: The methodological and reporting practices in Cochrane reviews incorporating C-RCTs could be greatly improved, particularly with regard to analyses. Criteria developed as part of the current study could be used by review authors or editors to identify errors and improve the quality of published systematic reviews incorporating C-RCTs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Fluoride varnishes for preventing dental caries in children and adolescents
Marinho, V. C., Worthington, H. V., Walsh, T., & Clarkson, J. E. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002279.pub2 · Cited by 1,022
Midwife-led continuity models versus other models of care for childbearing women
Sandall, J., Soltani, H., Gates, S., Shennan, A., & Devane, D. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004667.pub5 · Cited by 906
Issues in the meta-analysis of cluster randomized trials
Donner, A., & Klar, N. (2002) · Statistics in Medicine · doi:10.1002/sim.1301 · Cited by 734 · cited 1×
“Report absences of key information in the original trial reports, and if necessary, comment on the possible implications of this information being missing Subgroup analyses can be performed to explore heterogeneity between results from C-RCTs and I-RCTs or between results from C-RCTs with different units of randomisat…”
ResultPsychosocial interventions for supporting women to stop smoking in pregnancy
Chamberlain, C., O'Mara-Eves, A., Porter, J., Coleman, T., Perlen, S. M., Thomas, J., & McKenzie, J. E. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub5 · Cited by 650
van Ginneken, N., Tharyan, P., Lewin, S., Rao, G. N., Meera, S., Pian, J., Chandrashekar, S., & Patel, V. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009149.pub2 · Cited by 575
Dangour, A. D., Watson, L., Cumming, O., Boisson, S., Che, Y., Velleman, Y., Cavill, S., Allen, E., & Uauy, R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009382.pub2 · Cited by 374
Fetal and umbilical Doppler ultrasound in high-risk pregnancies
Alfirevic, Z., Stampalija, T., & Dowswell, T. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007529.pub4 · Cited by 304
Psychosocial interventions for supporting women to stop smoking in pregnancy
Chamberlain, C., O'Mara-Eves, A., Oliver, S., Caird, J. R., Perlen, S. M., Eades, S. J., & Thomas, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub4 · Cited by 251
Internet-based interventions for smoking cessation
Civljak, M., Stead, L. F., Hartmann-Boyce, J., Sheikh, A., & Car, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007078.pub4 · Cited by 249
Cited by
When and how to update systematic reviews: consensus and checklist
Garner, P., Hopewell, S., Chandler, J., MacLehose, H., Schünemann, H. J., Akl, E. A., Beyene, J., Chang, S., Churchill, R., Dearness, K., et al. (2016) · BMJ · doi:10.1136/bmj.i3507 · Cited by 426
“29 AMSTAR can assess the overall quality of a systematic review, 30 and the ROBIS tool can provide a more detailed assessment of the potential for bias.”
Self-citationPage, M. J., Altman, D. G., McKenzie, J. E., Shamseer, L., Ahmadzai, N., Wolfe, D., Yazdi, F., Catalá-López, F., Tricco, A. C., & Moher, D. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.022 · Cited by 82
Godard-Sebillotte, C., Le Berre, M., Schuster, T., Trottier, M., & Vedel, I. (2019) · PLOS ONE · doi:10.1371/journal.pone.0218426 · Cited by 50
Metadata
- Authors
- Richardson, M., Garner, P., & Donegan, S.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-03-16
- Volume
- 11
- Issue
- 3
- Pages
- e0151818
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2299770932
- Cited by
- 36
- References
- 16
- FWCI
- 3.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice. https://app.cochat.ai/papers/10.1371/journal.pone.0151818
- The paper
- Richardson, M., Garner, P., & Donegan, S. (2016). Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice. PLOS ONE. https://doi.org/10.1371/journal.pone.0151818
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.