The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Reporting and analysis of trials using stratified randomisation in leading medical journals: review and reanalysis
Open accessAbstract
OBJECTIVES: To assess how often stratified randomisation is used, whether analysis adjusted for all balancing variables, and whether the method of randomisation was adequately reported, and to reanalyse a previously reported trial to assess the impact of ignoring balancing factors in the analysis. DESIGN: Review of published trials and reanalysis of a previously reported trial. SETTING: Four leading general medical journals (BMJ, Journal of the American Medical Association, Lancet, and New England Journal of Medicine) and the second Multicenter Intrapleural Sepsis Trial (MIST2). PARTICIPANTS: 258 trials published in 2010 in the four journals. Cluster randomised, crossover, non-randomised, single arm, and phase I or II trials were excluded, as were trials reporting secondary analyses, interim analyses, or results that had been previously published in 2010. MAIN OUTCOME MEASURES: Whether the method of randomisation was adequately reported, how often balanced randomisation was used, and whether balancing factors were adjusted for in the analysis. RESULTS: Reanalysis of MIST2 showed that an unadjusted analysis led to larger P values and a loss of power. The review of published trials showed that balanced randomisation was common, with 163 trials (63%) using at least one balancing variable. The most common methods of balancing were stratified permuted blocks (n=85) and minimisation (n=27). The method of randomisation was unclear in 37% of trials. Most trials that balanced on centre or prognostic factors were not adequately analysed; only 26% of trials adjusted for all balancing factors in their primary analysis. Trials that did not adjust for balancing factors in their analysis were less likely to show a statistically significant result (unadjusted 57% v adjusted 78%, P=0.02). CONCLUSION: Balancing on centre or prognostic factors is common in trials but often poorly described, and the implications of balancing are poorly understood. Trialists should adjust their primary analysis for balancing factors to obtain correct P values and confidence intervals and to avoid an unnecessary loss in power.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Subgroup analysis and other (mis)uses of baseline data in clinical trials
Assmann, S. F., Pocock, S. J., Enos, L. E., & Kasten, L. E. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02039-0 · Cited by 1,167
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Intrapleural Use of Tissue Plasminogen Activator and DNase in Pleural Infection
Rahman, N. M., Maskell, N. A., West, A., Teoh, R., Arnold, A., Mackinlay, C., Peckham, D., Davies, C. W. H., Ali, N., Kinnear, W., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1012740 · Cited by 855
Self-citationThe method of minimization for allocation to clinical trials
Scott, N. W., McPherson, G. C., Ramsay, C. R., & Campbell, M. K. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00242-8 · Cited by 651
Stratified Randomization for Clinical Trials
Kernan, W. N., Viscoli, C. M., Makuch, R. W., Brass, L. M., & Horwitz, R. I. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00138-3 · Cited by 627
Statistical Principles for Clinical Trials
Kay, R. (1998) · Journal of International Medical Research · doi:10.1177/030006059802600201 · Cited by 573
Treatment allocation by minimisation
Altman, D. G., & Bland, J. M. (2005) · BMJ · doi:10.1136/bmj.330.7495.843 · Cited by 550
Cited by
Jakobsen, J. C., Gluud, C., Wetterslev, J., & Winkel, P. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0442-1 · Cited by 2,747
de Boer, S. M., Powell, M. E., Mileshkin, L., Katsaros, D., Bessette, P., Haie-Meder, C., Ottevanger, P. B., Ledermann, J. A., Khaw, P., Colombo, A., et al. (2018) · The Lancet Oncology · doi:10.1016/s1470-2045(18)30079-2 · Cited by 641
Kahan, B. C., Jairath, V., Doré, C. J., & Morris, T. P. (2014) · Trials · doi:10.1186/1745-6215-15-139 · Cited by 497
Self-citationA No-Prophylaxis Platelet-Transfusion Strategy for Hematologic Cancers
Stanworth, S. J., Estcourt, L. J., Powter, G., Kahan, B. C., Dyer, C., Choo, L., Bakrania, L., Llewelyn, C., Littlewood, T., Soutar, R., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1212772 · Cited by 472
Self-citationde Boer, S. M., Powell, M. E., Mileshkin, L., Katsaros, D., Bessette, P., Haie-Meder, C., Ottevanger, P. B., Ledermann, J. A., Khaw, P., D'Amico, R., et al. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30395-x · Cited by 457
Clive, A. O., Kahan, B. C., Hooper, C. E., Bhatnagar, R., Morley, A. J., Zahan-Evans, N., Bintcliffe, O. J., Boshuizen, R. C., Fysh, E. T. H., Tobin, C. L., et al. (2014) · Thorax · doi:10.1136/thoraxjnl-2014-205285 · Cited by 446
Self-citationLower or Higher Oxygenation Targets for Acute Hypoxemic Respiratory Failure
Schjørring, O. L., Klitgaard, T. L., Perner, A., Wetterslev, J., Lange, T., Siegemund, M., Bäcklund, M., Keus, F., Laake, J. H., Morgan, M., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2032510 · Cited by 370
de Groot, S., Lugtenberg, R. T., Cohen, D., Welters, M. J. P., Ehsan, I., Vreeswijk, M. P. G., Smit, V. T. H. B. M., de Graaf, H., Heijns, J. B., Portielje, J. E. A., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-16138-3 · Cited by 335
Chappell, L. C., Bell, J. L., Smith, A., Linsell, L., Juszczak, E., Dixon, P. H., Chambers, J., Hunter, R., Dorling, J., Williamson, C., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31270-x · Cited by 295
Outpatient Talc Administration by Indwelling Pleural Catheter for Malignant Effusion
Bhatnagar, R., Keenan, E. K., Morley, A. J., Kahan, B. C., Stanton, A. E., Haris, M., Harrison, R. N., Mustafa, R. A., Bishop, L. J., Ahmed, L., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1716883 · Cited by 279
Self-citationRisk of selection bias in randomised trials
Kahan, B. C., Rehal, S., & Cro, S. (2015) · Trials · doi:10.1186/s13063-015-0920-x · Cited by 180
Self-citationSchisterman, E. F., Sjaarda, L. A., Clemons, T., Carrell, D. T., Perkins, N. J., Johnstone, E., Lamb, D., Chaney, K., Van Voorhis, B. J., Ryan, G., et al. (2020) · JAMA · doi:10.1001/jama.2019.18714 · Cited by 179
Planning a method for covariate adjustment in individually randomised trials: a practical guide
Morris, T. P., Walker, A. S., Williamson, E. J., & White, I. R. (2022) · Trials · doi:10.1186/s13063-022-06097-z · Cited by 97
Self-citationBricker, J. B., Mull, K. E., McClure, J. B., Watson, N. L., & Heffner, J. L. (2018) · Addiction · doi:10.1111/add.14127 · Cited by 91
Nørskov, A. K., Wetterslev, J., Rosenstock, C. V., Afshari, A., Astrup, G., Jakobsen, J. C., Thomsen, J. L., Bøttger, M., Ellekvist, M., Schousboe, B. M. B., et al. (2016) · British Journal of Anaesthesia · doi:10.1093/bja/aew057 · Cited by 78
A comparison of methods to adjust for continuous covariates in the analysis of randomised trials
Kahan, B. C., Rushton, H., Morris, T. P., & Daniel, R. M. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0141-3 · Cited by 74
Self-citationTaylor, S. J. C., Carnes, D., Homer, K., Kahan, B. C., Hounsome, N., Eldridge, S., Spencer, A., Pincus, T., Rahman, A., & Underwood, M. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002040 · Cited by 63
Sandal, L. F., Stochkendahl, M. J., Svendsen, M. J., Wood, K., Øverås, C. K., Nordstoga, A. L., Villumsen, M., Rasmussen, C. D. N., Nicholl, B., Cooper, K., et al. (2019) · JMIR Research Protocols · doi:10.2196/14720 · Cited by 59
Kuppermann, M., Kaimal, A. J., Blat, C., Gonzalez, J., Thiet, M.-P., Bermingham, Y., Altshuler, A. L., Bryant, A. S., Bacchetti, P., & Grobman, W. A. (2020) · JAMA · doi:10.1001/jama.2020.5952 · Cited by 50
Taylor, S. J., Carnes, D., Homer, K., Pincus, T., Kahan, B. C., Hounsome, N., Eldridge, S., Spencer, A., Diaz-Ordaz, K., Rahman, A., et al. (2016) · Programme Grants for Applied Research · doi:10.3310/pgfar04140 · Cited by 44
Self-citationOsilla, K. C., Becker, K., Ecola, L., Hurley, B., Manuel, J. K., Ober, A., Paddock, S. M., & Watkins, K. E. (2020) · Addiction Science & Clinical Practice · doi:10.1186/s13722-020-00199-2 · Cited by 20
Zhu, R., Fogelholm, M., Larsen, T. M., Poppitt, S. D., Silvestre, M. P., Vestentoft, P. S., Jalo, E., Navas-Carretero, S., Huttunen-Lenz, M., Taylor, M. A., et al. (2021) · Frontiers in Nutrition · doi:10.3389/fnut.2021.685648 · Cited by 16
Mapesi, H., Gupta, R., Wilson, H. I., Lukau, B., Amstutz, A., Lyimo, A., Muhairwe, J., Senkoro, E., Byakuzana, T., Mphunyane, M., et al. (2021) · Trials · doi:10.1186/s13063-021-05023-z · Cited by 8
Metadata
- Authors
- Kahan, B. C., & Morris, T. P.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2012-09-14
- Volume
- 345
- Issue
- sep14 1
- Pages
- e5840-e5840
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W2061393918
- Cited by
- 295
- References
- 19
- FWCI
- 13.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.