The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study
Open accessAbstract
BACKGROUND: Analysis of variance (ANOVA), change-score analysis (CSA) and analysis of covariance (ANCOVA) respond differently to baseline imbalance in randomized controlled trials. However, no empirical studies appear to have quantified the differential bias and precision of estimates derived from these methods of analysis, and their relative statistical power, in relation to combinations of levels of key trial characteristics. This simulation study therefore examined the relative bias, precision and statistical power of these three analyses using simulated trial data. METHODS: 126 hypothetical trial scenarios were evaluated (126,000 datasets), each with continuous data simulated by using a combination of levels of: treatment effect; pretest-posttest correlation; direction and magnitude of baseline imbalance. The bias, precision and power of each method of analysis were calculated for each scenario. RESULTS: Compared to the unbiased estimates produced by ANCOVA, both ANOVA and CSA are subject to bias, in relation to pretest-posttest correlation and the direction of baseline imbalance. Additionally, ANOVA and CSA are less precise than ANCOVA, especially when pretest-posttest correlation ≥ 0.3. When groups are balanced at baseline, ANCOVA is at least as powerful as the other analyses. Apparently greater power of ANOVA and CSA at certain imbalances is achieved in respect of a biased treatment effect. CONCLUSIONS: Across a range of correlations between pre- and post-treatment scores and at varying levels and direction of baseline imbalance, ANCOVA remains the optimum statistical method for the analysis of continuous outcomes in RCTs, in terms of bias, precision and statistical power.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251 · cited 1×
“Moreover, the primary analysis in an RCT should be prespecified [40,41].”
BackgroundAnalysing controlled trials with baseline and follow up measurements
Vickers, A. J., & Altman, D. G. (2001) · BMJ · doi:10.1136/bmj.323.7321.1123 · Cited by 2,116
Pocock, S. J., Assmann, S. E., Enos, L. E., & Kasten, L. E. (2002) · Statistics in Medicine · doi:10.1002/sim.1296 · Cited by 1,077
Van Breukelen, G. J. P. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.02.007 · Cited by 765
The method of minimization for allocation to clinical trials
Scott, N. W., McPherson, G. C., Ramsay, C. R., & Campbell, M. K. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00242-8 · Cited by 651 · cited 7×
“Many randomized controlled trials (RCTs) involve a single post-treatment measurement of a continuous outcome variable previously measured at baseline.”
MethodResultInfluentialStratified Randomization for Clinical Trials
Kernan, W. N., Viscoli, C. M., Makuch, R. W., Brass, L. M., & Horwitz, R. I. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00138-3 · Cited by 627 · cited 1×
“through stratified randomization or covariate-adaptive methods of allocation [11,43,44].”
MethodFrison, L., & Pocock, S. J. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111304 · Cited by 593
Testing for baseline balance in clinical trials
Senn, S. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131703 · Cited by 503 · cited 1×
“Several authors [2,34,36-39] argue that covariates should be selected a priori in terms of their prognostic importance, rather than on the basis of examining baseline imbalance in the trial data – even large imbalance is of little consequence in terms of bias if the covariate is not related to outcome.”
BackgroundHuitema, B. E. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781118067475 · Cited by 464 · cited 2×
“ANCOVA is known to produce unbiased estimates of treatment effect in the presence of baseline imbalance when groups are randomized [19,20].”
MethodHernández, A. V., Eijkemans, M. J. C., & Steyerberg, E. W. (2006) · Annals of Epidemiology · doi:10.1016/j.annepidem.2005.09.007 · Cited by 65 · cited 2×
“Our results concur with previous literature that emphasizes the advantages of covariate adjustment [3,8,9,12-16,24,35].”
MethodResult
Research works printed but not linked: 36
- Rosenberger WF, Lachin JM: Randomization in Clinical Trials: Theory and Practice. 2002, New York, NY: Wiley-Interscience · DOI · Paper page
- Roberts C, Torgerson DJ: Baseline imbalance in randomised controlled trials. BMJ. 1999, 319: 185- · DOI · Paper page
- Altman DG, Doré CJ: Baseline comparisons in randomized clinical trials. Stat Med. 1991, 10: 797-799. · DOI
- Tu D, Shalay K, Pater J: Adjustment of treatment effect for covariates in clinical trials: statistical and regulatory issues. Drug Inf J. 2000, 34: 511-523. · DOI
- Ciolino JD, Martin RH, Zhao W, Jauch EC, Hill MD, Palesch YY: Covariate imbalance and adjustment for logistic regression analysis of clinical trial data. J Biopharm Stat. 2013, 23: 1383-1402. 10.1080/10543406.2013.834912. · DOI
- Piantadosi S: Clinical Trials: a Methodologic Perspective. 2005, New York: Wiley, 2 · DOI · Paper page
- Kernan WN, Makuch RM: Response. J Clin Epidemiol. 2001, 54: 105-10.1016/S0895-4356(00)00285-7. · DOI
- Hagino A, Hamada C, Yoshimura I, Ohashi Y, Sakamoto J, Nakazato H: Statistical comparison of random allocation methods in cancer clinical trials. Control Clin Trials. 2004, 25: 572-584. 10.1016/j.cct.2004.08.004. · DOI
- Taves DR: Faulty assumptions in Atkinson’s criteria for clinical trial design. J R Stat Soc. 2004, 167: 179-181. 10.1046/j.0964--1998.2003.00741.x. · doi:10.1046/j.0964--1998.2003.00741.x
- Rosenberger WF, Sverdlov O: Handling covariates in the design of clinical trials. Stat Sci. 2008, 23: 404-419. 10.1214/08-STS269. · DOI · Paper page
- Kent DM, Trikalinos TA, Hill MD: Are unadjusted analyses of clinical trials inappropriately biased toward the null?. Stroke. 2009, 40: 672-673. 10.1161/STROKEAHA.108.532051. · DOI
- Ciolino JD, Martin RH, Zhao W, Hill MD, Jauch EC, Palesch YY: Measuring continuous baseline covariate imbalances in clinical trial data. Stat Methods Med Res. 2011, doi:10.1177/0962280211416038 · DOI
- Austin PC, Manca A, Zwarenstein M, Juurlink DN, Stanbrook MB: A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals. J Clin Epidemiol. 2010, 63: 142-153. 10.1016/j.jclinepi.2009.06.002. · DOI · Paper page
- Vickers AJ: The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study. BMC Med Res Methodol. 2001, 1: 6-10.1186/1471-2288-1-6. · DOI · Paper page
- Matthews JNS: Introduction to Randomized Controlled Clinical Trials. 2006, Boca Raton, FL: Chapman & Hall/CRC, 2 · DOI · Paper page
- Christensen E, Neuberger J, Crowe J, Altman DG, Popper H, Portmann B, Doniach D, Ranek L, Tygstrup N, Williams R: Beneficial effect of azathioprine and prediction of prognosis in primary biliary cirrhosis. Final results of an international trial. Gastroenterology. 1985, 89: 1084-1091. · DOI · Paper page
- Beach ML, Meier P: Choosing covariates in the analysis of clinical trials. Control Clin Trials. 1989, 10 (4 Suppl): 161S-175S. · DOI
- Steyerberg EW, Bossuyt PMM, Lee KL: Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics?. Am Heart J. 2000, 139: 745-751. · DOI
- Senn SJ: Baseline comparisons in randomised clinical trials. Stat Med. 1991, 10: 1157-1160. · DOI
- Overall JE, Magee KN: Directional baseline differences and Type I error probabilities in randomized clinical trials. J Biopharm Stat. 1992, 2: 189-203. 10.1080/10543409208835039. · DOI
- Overall JE, Doyle SR: Implications of chance baseline differences in repeated measurement designs. J Biopharm Stat. 1994, 4: 199-216. 10.1080/10543409408835083. · DOI
- Chu R, Walter SD, Guyatt G, Devereaux PJ, Walsh M, Thorlund K, Thabane L: Assessment and implication of prognostic imbalance in randomized controlled trials with a binary outcome – a simulation study. PLoS One. 2012, 7: e36677-10.1371/journal.pone.0036677. · DOI
- Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale NJ: Lawrence Erlbaum, 2
- Tu YK, Blance A, Clerehugh V, Gilthorpe MS: Statistical power for analyses of changes in randomized controlled trials. J Dent Res. 2005, 84: 283-287. 10.1177/154405910508400315. · DOI
- Wei L, Zhang J: Analysis of data with imbalance in the baseline outcome variable for randomized clinical trials. Drug Inf J. 2001, 35: 1201-1214. 10.1177/009286150103500417. · DOI
- Egger MJ, Coleman ML, Ward JR, Reading JC, Williams HJ: Uses and abuses of analysis of covariance in clinical trials. Control Clin Trials. 1985, 6: 12-24. 10.1016/0197-2456(85)90093-5. · DOI
- Twisk J, Proper K: Evaluation of the result of a randomized controlled trial: how to define changes between baseline and follow up. J Clin Epidemiol. 2004, 57: 223-228. 10.1016/j.jclinepi.2003.07.009. · DOI · Paper page
- Assmann SF, Pocock SJ, Enos LE, Kasten LE: Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet. 2000, 355: 1064-1069. 10.1016/S0140-6736(00)02039-0. · DOI · Paper page
- Armitage P, Gehan EA: Statistical methods for the identification and use of prognostic factors. Int J Cancer. 1974, 13: 16-36. 10.1002/ijc.2910130104. · DOI
- Senn SJ: Covariate imbalance and random allocation in clinical trials. Stat Med. 1989, 8: 467-475. 10.1002/sim.4780080410. · DOI · Paper page
- Raab GM, Day S, Sales J: How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000, 21: 330-342. 10.1016/S0197-2456(00)00061-1. · DOI · Paper page
- DHHS: Guidance for Industry E9: Statistical Principles for Clinical Trials. 1998, Rockville MD: Department of Health and Human Services
- Ciolino J, Zhao W, Martin R, Palesch Y: Quantifying the cost in power of ignoring continuous covariates imbalances in clinical trial randomization. Contemp Clin Trials. 2011, 32: 250-259. 10.1016/j.cct.2010.11.005. · DOI
- Kahan BC, Morris TP: Reporting and analysis of trials using stratified randomisation in leading medical journals: review and reanalysis. BMJ. 2012, 345: e5840-10.1136/bmj.e5840. · DOI · Paper page
- Overall JE, Ashby B: Baseline corrections in experimental and quasi-experimental clinical trials. Neuropsychopharmacology. 1991, 4: 273-281.
- Hernández AV, Steyerberg EW, Habbema JD: Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements. J Clin Epidemiol. 2004, 57: 454-460. 10.1016/j.jclinepi.2003.09.014. · DOI · Paper page
Cited by
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
Kahan, B. C., Jairath, V., Doré, C. J., & Morris, T. P. (2014) · Trials · doi:10.1186/1745-6215-15-139 · Cited by 497
Al-Khudairy, L., Loveman, E., Colquitt, J. L., Mead, E., Johnson, R. E., Fraser, H., Olajide, J., Murphy, M., Velho, R. M., O'Malley, C., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012691 · Cited by 455
Navarro-Haro, M. V., Modrego-Alarcón, M., Hoffman, H. G., López-Montoyo, A., Navarro-Gil, M., Montero-Marin, J., García-Palacios, A., Borao, L., & García-Campayo, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00055 · Cited by 189
“REML is less biased for the estimation of variance parameters when using small sample sizes or unbalanced data (Egbewale et al., 2014).”
BackgroundThiart, H., Lehr, D., Ebert, D. D., Berking, M., & Riper, H. (2015) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3478 · Cited by 168
Metadata
- Authors
- Egbewale, B. E., Lewis, M., & Sim, J.
- Venue
- BMC Medical Research Methodology
- Published
- 2014-04-09
- Volume
- 14
- Issue
- 1
- Pages
- 49-49
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2020480331
- Cited by
- 234
- References
- 10
- FWCI
- 20.97
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study. https://app.cochat.ai/papers/10.1186/1471-2288-14-49
- The paper
- Egbewale, B. E., Lewis, M., & Sim, J. (2014). Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-14-49
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.