CoChat

Reporting of Factorial Randomized Trials: Extension of the CONSORT 2010 Statement

Open access
Kahan, Brennan C., Hall, Sophie S., Beller, Elaine M., Birchenall, Megan, Chan, An-Wen, Elbourne, Diana, Little, Paul, Fletcher, John, Golub, Robert M., Goulao, Beatriz, Hopewell, Sally, Islam, Nazrul, Zwarenstein, Merrick, Juszczak, Edmund, Montgomery, Alan A. · 2023 · JAMA
Cited by 81

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

Importance: Transparent reporting of randomized trials is essential to facilitate critical appraisal and interpretation of results. Factorial trials, in which 2 or more interventions are assessed in the same set of participants, have unique methodological considerations. However, reporting of factorial trials is suboptimal. Objective: To develop a consensus-based extension to the Consolidated Standards of Reporting Trials (CONSORT) 2010 Statement for factorial trials. Design: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT extension for factorial trials was developed by (1) generating a list of reporting recommendations for factorial trials using a scoping review of methodological articles identified using a MEDLINE search (from inception to May 2019) and supplemented with relevant articles from the personal collections of the authors; (2) a 3-round Delphi survey between January and June 2022 to identify additional items and assess the importance of each item, completed by 104 panelists from 14 countries; and (3) a hybrid consensus meeting attended by 15 panelists to finalize the selection and wording of items for the checklist. Findings: This CONSORT extension for factorial trials modifies 16 of the 37 items in the CONSORT 2010 checklist and adds 1 new item. The rationale for the importance of each item is provided. Key recommendations are (1) the reason for using a factorial design should be reported, including whether an interaction is hypothesized, (2) the treatment groups that form the main comparisons should be clearly identified, and (3) for each main comparison, the estimated interaction effect and its precision should be reported. Conclusions and Relevance: This extension of the CONSORT 2010 Statement provides guidance on the reporting of factorial randomized trials and should facilitate greater understanding of and transparency in their reporting.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jama.2023.19793

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 30

  1. Green, 2002, Factorial design considerations., J Clin Oncol, 20, 3424, 10.1200/JCO.2002.03.003 · DOI · Paper page
  2. Kahan, 2020, Reporting of randomized factorial trials was frequently inadequate., J Clin Epidemiol, 117, 52, 10.1016/j.jclinepi.2019.09.018 · DOI
  3. Lubsen, 1994, Factorial trials in cardiology: pros and cons., Eur Heart J, 15, 585, 10.1093/oxfordjournals.eurheartj.a060552 · DOI
  4. McAlister, 2003, Analysis and reporting of factorial trials: a systematic review., JAMA, 289, 2545, 10.1001/jama.289.19.2545 · DOI · Paper page
  5. Montgomery, 2011, Reporting of factorial trials of complex interventions in community settings: a systematic review., Trials, 12, 179, 10.1186/1745-6215-12-179 · DOI
  6. Montgomery, 2003, Design, analysis and presentation of factorial randomised controlled trials., BMC Med Res Methodol, 3, 26, 10.1186/1471-2288-3-26 · DOI · Paper page
  7. Byth, 2004, Factorial designs: a graphical aid for choosing study designs accounting for interaction., Clin Trials, 1, 315, 10.1191/1740774504cn026oa · DOI
  8. Dakin, 2017, Economic evaluation of factorial randomised controlled trials: challenges, methods and recommendations., Stat Med, 36, 2814, 10.1002/sim.v36.18 · doi:10.1002/sim.v36.18
  9. Dakin, 2018, Partial factorial trials: comparing methods for statistical analysis and economic evaluation., Trials, 1, 442, 10.1186/s13063-018-2818-x · DOI
  10. Freidlin, 2017, Two-by-two factorial cancer treatment trials: is sufficient attention being paid to possible interactions?, J Natl Cancer Inst, 9, 10.1093/jnci/djx146 · DOI
  11. Kahan, 2022, Estimands for factorial trials., Stat Med, 4299, 10.1002/sim.v41.22 · doi:10.1002/sim.v41.22
  12. Korn, 2016, Non-factorial analyses of two-by-two factorial trial designs., Clin Trials, 6, 651, 10.1177/1740774516659472 · doi:10.1177/1740774516659472
  13. McClure, 2013, Monitoring futility in a two-by-two factorial design: the SPS3 experience., Clin Trials, 2, 250, 10.1177/1740774512474374 · doi:10.1177/1740774512474374
  14. Lin, 2016, Simultaneous inference on treatment effects in survival studies with factorial designs., Biometrics, 4, 1078, 10.1111/biom.v72.4 · doi:10.1111/biom.v72.4
  15. Bria, 2006, Factorial design for randomized clinical trials., Ann Oncol, 10, 1607, 10.1093/annonc/mdl106 · doi:10.1093/annonc/mdl106
  16. Byar, 1989, Some statistical considerations for design of cancer prevention trials., Prev Med, 18, 688, 10.1016/0091-7435(89)90040-6 · doi:10.1016/0091-7435(89)90040-6
  17. Kahan, 2013, Bias in randomised factorial trials., Stat Med, 32, 4540, 10.1002/sim.v32.26 · doi:10.1002/sim.v32.26
  18. Schulz, 2010, CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials., BMJ, 340, c332, 10.1136/bmj.c332 · DOI · Paper page
  19. Mdege, 2014, The 2 × 2 cluster randomized controlled factorial trial design is mainly used for efficiency and to explore intervention interactions: a systematic review., J Clin Epidemiol, 67, 1083, 10.1016/j.jclinepi.2014.06.004 · DOI
  20. Allore, 2008, An examination of effect estimation in factorial and standardly-tailored designs., Clin Trials, 5, 121, 10.1177/1740774508089278 · DOI
  21. Baker, 2017, Implementing clinical research using factorial designs: a primer., Behav Ther, 48, 567, 10.1016/j.beth.2016.12.005 · DOI · Paper page
  22. White, 2022, Combining factorial and multi-arm multi-stage platform designs to evaluate multiple interventions efficiently., Clin Trials, 19, 432, 10.1177/17407745221093577 · doi:10.1177/17407745221093577
  23. Curran, 1999, Sample size estimation in phase III cancer clinical trials., European J Surg Oncol, 25, 244, 10.1053/ejso.1998.0635 · doi:10.1053/ejso.1998.0635
  24. Slud, 1994, Analysis of factorial survival experiments., Biometrics, 50, 25, 10.2307/2533194 · doi:10.2307/2533194
  25. Kahan, 2021, Estimands in published protocols of randomised trials: urgent improvement needed., Trials, 22, 686, 10.1186/s13063-021-05644-4 · DOI
  26. Mitroiu, 2022, Estimation of treatment effects in short-term depression studies: an evaluation based on the ICH E9(R1) estimands framework., Pharm Stat, 21, 1037, 10.1002/pst.v21.5 · doi:10.1002/pst.v21.5
  27. Tian, 2022, Sample size calculation in hierarchical 2×2 factorial trials with unequal cluster sizes., Stat Med, 41, 645, 10.1002/sim.v41.4 · doi:10.1002/sim.v41.4
  28. Pocock, 2015, Challenging issues in clinical trial design: part 4 of a 4-part series on statistics for clinical trials., J Am Coll Cardiol, 66, 2886, 10.1016/j.jacc.2015.10.051 · DOI
  29. Leifer, 2021, Joint testing of overall and simple effects for the two-by-two factorial trial design., Clin Trials, 18, 521, 10.1177/17407745211014493 · DOI
  30. Hall? SS, Juszczak? E, Birchenall? M, . Development of extensions to SPIRIT and CONSORT guidelines: the Reporting Factorial Trials (RAFT) study. OSF. Preprint posted online April 18, 2023. https://osf.io/undpm

Cited by

See all 81

Metadata

Authors
Kahan, B. C., Hall, S. S., Beller, E. M., Birchenall, M., Chan, A.-W., Elbourne, D., Little, P., Fletcher, J., Golub, R. M., Goulao, B., Hopewell, S., Islam, N., Zwarenstein, M., Juszczak, E., & Montgomery, A. A.
Venue
JAMA
Published
2023-12-05
Volume
330
Issue
21
Pages
2106
ISSN
  • 0002-9955 (ISSN-L)
  • 0098-7484
OpenAlex
W4389334827
Cited by
81
References
5
FWCI
14.87
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reporting of Factorial Randomized Trials: Extension of the CONSORT 2010 Statement. https://app.cochat.ai/papers/10.1001/jama.2023.19793
The paper
Kahan, B. C., Hall, S. S., Beller, E. M., Birchenall, M., Chan, A.-W., Elbourne, D., Little, P., Fletcher, J., Golub, R. M., Goulao, B., Hopewell, S., Islam, N., Zwarenstein, M., Juszczak, E., & Montgomery, A. A. (2023). Reporting of Factorial Randomized Trials: Extension of the CONSORT 2010 Statement. JAMA. https://doi.org/10.1001/jama.2023.19793

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.