Reporting and methodological quality of sample size calculations in cluster randomized trials could be improved: a review
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To assess the quality of reporting and accuracy of a priori estimates used in sample size calculations for cluster randomized trials (CRTs). STUDY DESIGN AND SETTING: We reviewed 300 CRTs published between 2000 and 2008. The prevalence of reporting sample size elements from the 2004 CONSORT recommendations was evaluated and a priori estimates compared with those observed in the trial. RESULTS: Of the 300 trials, 166 (55%) reported a sample size calculation. Only 36 of 166 (22%) reported all recommended descriptive elements. Elements specific to CRTs were the worst reported: a measure of within-cluster correlation was specified in only 58 of 166 (35%). Only 18 of 166 articles (11%) reported both a priori and observed within-cluster correlation values. Except in two cases, observed within-cluster correlation values were either close to or less than a priori values. CONCLUSION: Even with the CONSORT extension for cluster randomization, the reporting of sample size elements specific to these trials remains below that necessary for transparent reporting. Journal editors and peer reviewers should implement stricter requirements for authors to follow CONSORT recommendations. Authors should report observed and a priori within-cluster correlation values to enable comparisons between these over a wider range of trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510 · cited 2×
“The CONSORT statement was extended in 2004 [14] for the reporting of CRTs, and this was revised in 2012 [15] to be in line with CONSORT 2010.”
MethodCONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557 · cited 1×
“The CONSORT statement was extended in 2004 [14] for the reporting of CRTs, and this was revised in 2012 [15] to be in line with CONSORT 2010.”
MethodEldridge, S. M., Ashby, D., & Kerry, S. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl129 · Cited by 529 · cited 1×
“When cluster sizes are unequal, n is usually replaced by the average cluster size, although this risks potentially underestimating the required sample size [5].”
BackgroundSelf-citationMdege, N. D., Man, M.-S., Taylor (nee Brown), C. A., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.003 · Cited by 425
Puffer, S., Torgerson, D., & Watson, J. (2003) · BMJ · doi:10.1136/bmj.327.7418.785 · Cited by 351
Eldridge, S. M., Ashby, D., Feder, G. S., Rudnicka, A. R., & Ukoumunne, O. C. (2004) · Clinical Trials · doi:10.1191/1740774504cn006rr · Cited by 288
Self-citationReporting of sample size calculation in randomised controlled trials: review
Charles, P., Giraudeau, B., Dechartres, A., Baron, G., & Ravaud, P. (2009) · BMJ · doi:10.1136/bmj.b1732 · Cited by 274
Schulz, K. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100702 · Cited by 248
Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2008) · Trials · doi:10.1186/1745-6215-9-20 · Cited by 241
Internal and external validity of cluster randomised trials: systematic review of recent trials
Eldridge, S., Ashby, D., Bennett, C., Wakelin, M., & Feder, G. (2008) · BMJ · doi:10.1136/bmj.39517.495764.25 · Cited by 224
Self-citation
Cited by
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Self-citationSample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230
Self-citationReview of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Analysis of cluster randomised stepped wedge trials with repeated cross-sectional samples
Hemming, K., Taljaard, M., & Forbes, A. (2017) · Trials · doi:10.1186/s13063-017-1833-7 · Cited by 166
Parker, K., Nunns, M., Xiao, Z., Ford, T., & Ukoumunne, O. C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01348-0 · Cited by 41
“Interpretation Seventy two percent of the studies reported the level of clustering assumed in their sample size calculation, a little more than the 62% observed in a 2015 review of the reporting of sample size calculations in CRTs [96].”
Result
Metadata
- Authors
- Rutterford, C., Taljaard, M., Dixon, S., Copas, A., & Eldridge, S.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2015-06
- Volume
- 68
- Issue
- 6
- Pages
- 716-723
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W1989344401
- Cited by
- 66
- References
- 15
- FWCI
- 5.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reporting and methodological quality of sample size calculations in cluster randomized trials could be improved: a review. https://app.cochat.ai/papers/10.1016/j.jclinepi.2014.10.006
- The paper
- Rutterford, C., Taljaard, M., Dixon, S., Copas, A., & Eldridge, S. (2015). Reporting and methodological quality of sample size calculations in cluster randomized trials could be improved: a review. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2014.10.006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.