Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 234

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study

Open access
Egbewale, Bolaji E, Lewis, Martyn, Sim, Julius · 2014 · BMC Medical Research Methodology

Abstract

BACKGROUND: Analysis of variance (ANOVA), change-score analysis (CSA) and analysis of covariance (ANCOVA) respond differently to baseline imbalance in randomized controlled trials. However, no empirical studies appear to have quantified the differential bias and precision of estimates derived from these methods of analysis, and their relative statistical power, in relation to combinations of levels of key trial characteristics. This simulation study therefore examined the relative bias, precision and statistical power of these three analyses using simulated trial data. METHODS: 126 hypothetical trial scenarios were evaluated (126,000 datasets), each with continuous data simulated by using a combination of levels of: treatment effect; pretest-posttest correlation; direction and magnitude of baseline imbalance. The bias, precision and power of each method of analysis were calculated for each scenario. RESULTS: Compared to the unbiased estimates produced by ANCOVA, both ANOVA and CSA are subject to bias, in relation to pretest-posttest correlation and the direction of baseline imbalance. Additionally, ANOVA and CSA are less precise than ANCOVA, especially when pretest-posttest correlation ≥ 0.3. When groups are balanced at baseline, ANCOVA is at least as powerful as the other analyses. Apparently greater power of ANOVA and CSA at certain imbalances is achieved in respect of a biased treatment effect. CONCLUSIONS: Across a range of correlations between pre- and post-treatment scores and at varying levels and direction of baseline imbalance, ANCOVA remains the optimum statistical method for the analysis of continuous outcomes in RCTs, in terms of bias, precision and statistical power.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1471-2288-14-49

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 36

  1. Rosenberger WF, Lachin JM: Randomization in Clinical Trials: Theory and Practice. 2002, New York, NY: Wiley-Interscience · DOI · Paper page
  2. Roberts C, Torgerson DJ: Baseline imbalance in randomised controlled trials. BMJ. 1999, 319: 185- · DOI · Paper page
  3. Altman DG, Doré CJ: Baseline comparisons in randomized clinical trials. Stat Med. 1991, 10: 797-799. · DOI
  4. Tu D, Shalay K, Pater J: Adjustment of treatment effect for covariates in clinical trials: statistical and regulatory issues. Drug Inf J. 2000, 34: 511-523. · DOI
  5. Ciolino JD, Martin RH, Zhao W, Jauch EC, Hill MD, Palesch YY: Covariate imbalance and adjustment for logistic regression analysis of clinical trial data. J Biopharm Stat. 2013, 23: 1383-1402. 10.1080/10543406.2013.834912. · DOI
  6. Piantadosi S: Clinical Trials: a Methodologic Perspective. 2005, New York: Wiley, 2 · DOI · Paper page
  7. Kernan WN, Makuch RM: Response. J Clin Epidemiol. 2001, 54: 105-10.1016/S0895-4356(00)00285-7. · DOI
  8. Hagino A, Hamada C, Yoshimura I, Ohashi Y, Sakamoto J, Nakazato H: Statistical comparison of random allocation methods in cancer clinical trials. Control Clin Trials. 2004, 25: 572-584. 10.1016/j.cct.2004.08.004. · DOI
  9. Taves DR: Faulty assumptions in Atkinson’s criteria for clinical trial design. J R Stat Soc. 2004, 167: 179-181. 10.1046/j.0964--1998.2003.00741.x. · doi:10.1046/j.0964--1998.2003.00741.x
  10. Rosenberger WF, Sverdlov O: Handling covariates in the design of clinical trials. Stat Sci. 2008, 23: 404-419. 10.1214/08-STS269. · DOI · Paper page
  11. Kent DM, Trikalinos TA, Hill MD: Are unadjusted analyses of clinical trials inappropriately biased toward the null?. Stroke. 2009, 40: 672-673. 10.1161/STROKEAHA.108.532051. · DOI
  12. Ciolino JD, Martin RH, Zhao W, Hill MD, Jauch EC, Palesch YY: Measuring continuous baseline covariate imbalances in clinical trial data. Stat Methods Med Res. 2011, doi:10.1177/0962280211416038 · DOI
  13. Austin PC, Manca A, Zwarenstein M, Juurlink DN, Stanbrook MB: A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals. J Clin Epidemiol. 2010, 63: 142-153. 10.1016/j.jclinepi.2009.06.002. · DOI · Paper page
  14. Vickers AJ: The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study. BMC Med Res Methodol. 2001, 1: 6-10.1186/1471-2288-1-6. · DOI · Paper page
  15. Matthews JNS: Introduction to Randomized Controlled Clinical Trials. 2006, Boca Raton, FL: Chapman & Hall/CRC, 2 · DOI · Paper page
  16. Christensen E, Neuberger J, Crowe J, Altman DG, Popper H, Portmann B, Doniach D, Ranek L, Tygstrup N, Williams R: Beneficial effect of azathioprine and prediction of prognosis in primary biliary cirrhosis. Final results of an international trial. Gastroenterology. 1985, 89: 1084-1091. · DOI · Paper page
  17. Beach ML, Meier P: Choosing covariates in the analysis of clinical trials. Control Clin Trials. 1989, 10 (4 Suppl): 161S-175S. · DOI
  18. Steyerberg EW, Bossuyt PMM, Lee KL: Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics?. Am Heart J. 2000, 139: 745-751. · DOI
  19. Senn SJ: Baseline comparisons in randomised clinical trials. Stat Med. 1991, 10: 1157-1160. · DOI
  20. Overall JE, Magee KN: Directional baseline differences and Type I error probabilities in randomized clinical trials. J Biopharm Stat. 1992, 2: 189-203. 10.1080/10543409208835039. · DOI
  21. Overall JE, Doyle SR: Implications of chance baseline differences in repeated measurement designs. J Biopharm Stat. 1994, 4: 199-216. 10.1080/10543409408835083. · DOI
  22. Chu R, Walter SD, Guyatt G, Devereaux PJ, Walsh M, Thorlund K, Thabane L: Assessment and implication of prognostic imbalance in randomized controlled trials with a binary outcome – a simulation study. PLoS One. 2012, 7: e36677-10.1371/journal.pone.0036677. · DOI
  23. Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale NJ: Lawrence Erlbaum, 2
  24. Tu YK, Blance A, Clerehugh V, Gilthorpe MS: Statistical power for analyses of changes in randomized controlled trials. J Dent Res. 2005, 84: 283-287. 10.1177/154405910508400315. · DOI
  25. Wei L, Zhang J: Analysis of data with imbalance in the baseline outcome variable for randomized clinical trials. Drug Inf J. 2001, 35: 1201-1214. 10.1177/009286150103500417. · DOI
  26. Egger MJ, Coleman ML, Ward JR, Reading JC, Williams HJ: Uses and abuses of analysis of covariance in clinical trials. Control Clin Trials. 1985, 6: 12-24. 10.1016/0197-2456(85)90093-5. · DOI
  27. Twisk J, Proper K: Evaluation of the result of a randomized controlled trial: how to define changes between baseline and follow up. J Clin Epidemiol. 2004, 57: 223-228. 10.1016/j.jclinepi.2003.07.009. · DOI · Paper page
  28. Assmann SF, Pocock SJ, Enos LE, Kasten LE: Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet. 2000, 355: 1064-1069. 10.1016/S0140-6736(00)02039-0. · DOI · Paper page
  29. Armitage P, Gehan EA: Statistical methods for the identification and use of prognostic factors. Int J Cancer. 1974, 13: 16-36. 10.1002/ijc.2910130104. · DOI
  30. Senn SJ: Covariate imbalance and random allocation in clinical trials. Stat Med. 1989, 8: 467-475. 10.1002/sim.4780080410. · DOI · Paper page
  31. Raab GM, Day S, Sales J: How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000, 21: 330-342. 10.1016/S0197-2456(00)00061-1. · DOI · Paper page
  32. DHHS: Guidance for Industry E9: Statistical Principles for Clinical Trials. 1998, Rockville MD: Department of Health and Human Services
  33. Ciolino J, Zhao W, Martin R, Palesch Y: Quantifying the cost in power of ignoring continuous covariates imbalances in clinical trial randomization. Contemp Clin Trials. 2011, 32: 250-259. 10.1016/j.cct.2010.11.005. · DOI
  34. Kahan BC, Morris TP: Reporting and analysis of trials using stratified randomisation in leading medical journals: review and reanalysis. BMJ. 2012, 345: e5840-10.1136/bmj.e5840. · DOI · Paper page
  35. Overall JE, Ashby B: Baseline corrections in experimental and quasi-experimental clinical trials. Neuropsychopharmacology. 1991, 4: 273-281.
  36. Hernández AV, Steyerberg EW, Habbema JD: Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements. J Clin Epidemiol. 2004, 57: 454-460. 10.1016/j.jclinepi.2003.09.014. · DOI · Paper page

Cited by

See all 234

Metadata

Authors
Egbewale, B. E., Lewis, M., & Sim, J.
Venue
BMC Medical Research Methodology
Published
2014-04-09
Volume
14
Issue
1
Pages
49-49
ISSN
1471-2288 (ISSN-L)
OpenAlex
W2020480331
Cited by
234
References
10
FWCI
20.97
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study. https://app.cochat.ai/papers/10.1186/1471-2288-14-49
The paper
Egbewale, B. E., Lewis, M., & Sim, J. (2014). Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-14-49

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.