Testing for baseline balance in clinical trials
The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
Once the data from a clinical trial are available for analysis it is common practice to carry out ‘tests of baseline homogeneity’ on prognostic covariates before proceeding to analyse the effects of treatment on outcome variables. It is argued that this practice is philosophically unsound, of no practical value and potentially misleading. Instead it is recommended that prognostic variables be identified in the trial‐plan and fitted in an analysis of covariance regardless of their baseline distribution (statistical significance).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Between-group differences on change scores of the outcomes were tested using a General Linear Model (GLM) while adjusting for theoretically-important covariates (i.e., age, stage of cancer, education)39 and cancer treatments received, which differed significantly between arms at baseline.”
From Acceptance and commitment therapy for breast cancer survivors with fear of cancer recurrence: A 3-arm pilot randomized controlled trial. (2020) · cites this paper as [39]
Citations
Cites
Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,155
Cross-Over Trials in Clinical Research
(1994) · Technometrics · doi:10.1080/00401706.1994.10485798 · Cited by 763
Self-citationClinical Trials: Design, Conduct and Analysis
Meinert, C. L. (1986) · DigitalGeorgetown (Georgetown University Library) · doi:10.1093/acprof:oso/9780195035681.001.0001 · Cited by 756
GAIL, M. H., WIEAND, S., & PIANTADOSI, S. (1984) · Biometrika · doi:10.1093/biomet/71.3.431 · Cited by 698
Senn, S., Frison, L., & Pocock, S. (1994) · Statistics in Medicine · doi:10.1002/sim.4780130210 · Cited by 529
Self-citationRandomisation and baseline comparisons in clinical trials
Altman, D. G., & Doré, C. J. (1990) · The Lancet · doi:10.1016/0140-6736(90)90014-v · Cited by 508
On the Principle of Total Evidence
GOOD, I. J. (1967) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/17.4.319 · Cited by 329
Comparability of Randomised Groups
Altman, D. G. (1985) · The Statistician · doi:10.2307/2987510 · Cited by 328
Research works printed but not linked: 3
- Maxwell C., 1973, Clinical Research For All
- Lindley D. V., 1985, Making Decisions
- Miller D., 1991, On the Maximization of Expected Futility
Cited by
Items 101–200 of 503
Common Methodological Problems in Randomized Controlled Trials of Preventive Interventions
Steeger, C. M., Buckley, P. R., Pampel, F. C., Gust, C. J., & Hill, K. G. (2021) · Prevention Science · doi:10.1007/s11121-021-01263-2 · Cited by 61
“However, researchers and other guidelines (e.g., CONSORT-SPI, see below; European Medicines Agency, 2015; Raab et al., 2000; Senn, 1994) argue that it is most important to identify potential confounding variables a priori and adjust for these covariates regardless of whether they are significantly…”
BackgroundWright, N., Ivers, N. M., Eldridge, S. M., Taljaard, M., & Bremner, S. A. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.006 · Cited by 59
“There are clear recommendations against significance testing of balance of covariates between treatment arms [1,11].”
BackgroundMethodSathyapalan, T., Rigby, A. S., Bhasin, S., Thatcher, N. J., Kilpatrick, E. S., & Atkin, S. L. (2016) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2016-2875 · Cited by 57
Mauck, C. K., Callahan, M. M., Weiner, D. H., & Dominik, R. (1999) · Contraception · doi:10.1016/s0010-7824(99)00068-2 · Cited by 56
Ideal vs. real: a systematic review on handling covariates in randomized controlled trials
Ciolino, J. D., Palac, H., Yang, A., Vaca, M., & Belli, H. M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0787-8 · Cited by 67
Alberts, D. S., Einspahr, J. G., Ritenbaugh, C., Aickin, M. G., Rees-McGee, S., Atwood, J. R., Emerson, S. S., Mason-Liddil, N., Bettinger, L., Patel, J., et al. (1997) · PubMed · Cited by 54
The z-difference can be used to measure covariate balance in matched propensity score analyses
Kuß, O. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.001 · Cited by 54
Johnson, T. R. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p253 · Cited by 66
“…it is important to understand the strengths, limitations, and requirements of each method; generally speaking, however, ANCOVA is usually the preferred approach (Bonate, 2000; Dimitrov & Rumrill, 2003; Dugard & Todman, 1995; Huck & McLean, 1975; Knapp & Schafer, 2009; Overall, 1993; Senn, 1994).”
MethodGeneral guidance on exploratory and confirmatory subgroup analysis in late-stage clinical trials
Dmitrienko, A., Muysers, C., Fritsch, A., & Lipkovich, I. (2016) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2015.1092033 · Cited by 51
“Furthermore, the validity of inferences from such analysis is questionable as discussed in Grouin et al. (2005) and Senn (1994).”
BackgroundValeriani, D., & Simonyan, K. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2009165117 · Cited by 59
“As a result of this randomization, testing for the balance of age and sex in the first and second independent test sets was not performed (54).”
Impact of a Supervised Worksite Exercise Program on Back and Core Muscular Endurance in Firefighters
Mayer, J. M., Quillen, W. S., Verna, J. L., Chen, R., Lunseth, P. A., & Dagenais, S. (2014) · American Journal of Health Promotion · doi:10.4278/ajhp.130228-quan-89 · Cited by 51
Nonparametric Analysis of Covariance and Its Role in Noninferiority Clinical Trials
Koch, G. G., & Tangen, C. M. (1999) · Drug Information Journal · doi:10.1177/009286159903300419 · Cited by 51
METHODS FOR COVARIATE ADJUSTMENT IN COST‐EFFECTIVENESS ANALYSIS THAT USE CLUSTER RANDOMISED TRIALS
Gomes, M., Grieve, R., Nixon, R. M., Ng, E. S. W., Carpenter, J. R., & Thompson, S. G. (2012) · Health Economics · doi:10.1002/hec.2812 · Cited by 57
Detecting and differentiating the direction of change and intervention effects in randomized trials.
Bodner, T., & Bliese, P. D. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000251 · Cited by 55
Hayes, R., Wawer, M. J., Gray, R. H., Whitworth, J. A. G., Grosskurth, H., & Mabey, D. C. W. (1997) · Sexually Transmitted Infections · doi:10.1136/sti.73.6.432 · Cited by 50
Meyer, K. N., Santillana, R. M., Miller, B., Clapp, W. C., Way, M., Bridgman-Goines, K., & Sheridan, M. A. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241352 · Cited by 54
“It has been argued that covariates should be selected a priori and also be strong predictors of the treatment outcome [73, 74].”
BackgroundRobles, P., Brooks, D., Goldstein, R. S., Salbach, N. M., & Mathur, S. (2013) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000018 · Cited by 53
Sellier, P., & Broustet, J.-P. (2003) · American Journal of Cardiovascular Drugs · doi:10.2165/00129784-200303050-00007 · Cited by 49
A graphical sensitivity analysis for clinical trials with non‐ignorable missing binary outcome
Hollis, S. (2002) · Statistics in Medicine · doi:10.1002/sim.1276 · Cited by 50
“However, for a randomized controlled trial, adjustment for covariates is often neither necessary nor advisable [11].”
Farm Decision Making and Gender: Results from a Randomized Experiment in Ecuador
Alwang, J., Larochelle, C., & Barrera, V. H. (2017) · World Development · doi:10.1016/j.worlddev.2016.11.015 · Cited by 48
“As Senn (1994) shows, this conditional analysis of an unbalanced experiment produces a valid inference.”
BackgroundDo baseline p-values follow a uniform distribution in randomised trials?
Bland, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076010 · Cited by 47
“There is a large literature criticising the use of significance tests of differences in baseline variables in randomised clinical trials [1,2,3,4,5,6].”
BackgroundMoncion, K., Rodrigues, L., Heras, B. D. L., Noguchi, K. S., Wiley, E., Eng, J. J., MacKay-Lyons, M. J., Sweet, S. N., Thiel, A., Fung, J., et al. (2024) · Stroke · doi:10.1161/strokeaha.124.046564 · Cited by 47
“33 Estimated marginal means, within-group differences, and between-group differences from baseline and their respective 95% CI are reported where appropriate.”
Mountain, G. A., Hind, D., Gossage-Worrall, R., Walters, S. J., Duncan, R., Newbould, L., Rex, S., Jones, C., Bowling, A., Cattan, M., et al. (2014) · Trials · doi:10.1186/1745-6215-15-141 · Cited by 46
“Baseline and socio-demographic characteristics were summarised and assessed for comparability between trial arms without formal testing of statistical significance [38,39].”
Covariate adjustment had similar benefits in small and large randomized controlled trials
Thompson, D. D., Lingsma, H. F., Whiteley, W. N., Murray, G. D., & Steyerberg, E. W. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.001 · Cited by 44
The Bologna criteria for poor ovarian response: the good, the bad and the way forward
Venetis, C. A. (2014) · Human Reproduction · doi:10.1093/humrep/deu138 · Cited by 45
“…in important covariates that might result from simple (non-stratified) randomization does not violate the fundamental statistical assumptions and thus statistical tests remain valid and inferences can still be made (Senn, 1989, 1991, 1994; Altman and Dore, 1991; Roberts and Torgerson, 1999).”
BackgroundScantlebury, A., Fairhurst, C. M., Booth, A., McDaid, C., Moran, N. E., Parker, A., Payne, R. L., Scott, W. J., Torgerson, D. J., Webber, M., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184377 · Cited by 49
“No formal statistical comparisons were undertaken[16, 17].”
Statistical testing for baseline differences between randomised groups is not meaningful
Harvey, L. A. (2018) · Spinal Cord · doi:10.1038/s41393-018-0203-y · Cited by 43
Rezansoff, S. N., Moniruzzaman, A., Fazel, S., McCandless, L., Procyshyn, R., & Somers, J. M. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw136 · Cited by 42
A note on non‐parametric ANCOVA for covariate adjustment in randomized clinical trials
Lesaffre, E. M. E. H., & Senn, S. J. (2003) · Statistics in Medicine · doi:10.1002/sim.1583 · Cited by 50
“correct for these imbalances and thereby estimate and test the treatment e ect as if the two groups had been perfectly balanced [3].”
BackgroundSelf-citationBaseline testing in cluster randomised controlled trials: should this be done?
Bolzern, J. E., Mitchell, A. S., & Torgerson, D. J. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0750-8 · Cited by 44
Analysis of Data with Imbalance in the Baseline Outcome Variable for Randomized Clinical Trials
Wei, L., & Zhang, J. (2001) · Drug Information Journal · doi:10.1177/009286150103500417 · Cited by 41
“Senn (16) indicated that as an approximation to the truth an analysis of covariance that assumed parallelism would always be better than an analysis of variance that ignored the covari-”
BackgroundKnol, M., Groenwold, R., & Grobbee, D. (2012) · European Journal of Preventive Cardiology · doi:10.1177/1741826711421688 · Cited by 41
“In addition, whether baseline differences are significant does not have any implications for the validity of the results of the study.(2,3) For example, even a covariate that is balanced between treatment groups (according to a p-value) can affect the association between treatment and outcome.”
ResultBarton, R., English, A., Nabb, S., Rigby, A. S., & Johnson, M. J. (2010) · Lung Cancer · doi:10.1016/j.lungcan.2010.03.007 · Cited by 40
Riley, R. D., Elia, E. G., Malin, G. L., Hemming, K., & Price, M. P. (2015) · Statistics in Medicine · doi:10.1002/sim.6493 · Cited by 42
“The actual analysis of trials (or indeed observational studies) may specify, a priori, a set of prognostic factors (confounders) to be adjusted for [49]; their inclusion may be based on evidence in previous studies, for which prognostic value at cut-points may only be known.”
BackgroundBaseline data in clinical trials
Burgess, D., Gebski, V., & KEECH, A. C. (2003) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2003.tb05447.x · Cited by 40
A Randomized Trial of Mindfulness-Based Cognitive Therapy with Psoriasis Patients
Maddock, A., Hevey, D., D’Alton, P., & Kirby, B. (2019) · Mindfulness · doi:10.1007/s12671-019-01242-3 · Cited by 39
“This study used analysis of covariance (ANCOVA), as this method increases the power of RCTs by reducing any unintentional baseline differences due to random allocation, which increases a study’s capacity to obtain a valid estimation of the intervention effect between groups (Fitzmaurice et al. 2011; Senn 1994).”
MethodRajji, T. K., Bowie, C. R., Herrmann, N., Pollock, B. G., Lanctôt, K. L., Kumar, S., Flint, A. J., Mah, L., Fischer, C. E., Butters, M. A., et al. (2024) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2024.3241 · Cited by 55
Conditional equivalence testing: An alternative remedy for publication bias
Campbell, H., & Gustafson, P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195145 · Cited by 46
“It would also be worthwhile considering whether CET is appropriate for testing for baseline balance, Senn (1994).”
BackgroundEvaluation of randomized controlled trials: a primer and tutorial for mental health researchers
Harrer, M., Cuijpers, P. J., Schuurmans, L., Kaiser, T., Buntrock, C., van Straten, A., & Ebert, D. D. (2023) · Trials · doi:10.1186/s13063-023-07596-3 · Cited by 48
Goyder, E., Hind, D., Breckon, J. D., Dimairo, M., Minton, J., Everson-Hock, E., Read, S., Copeland, R. J., Crank, H., Horspool, K., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18130 · Cited by 46
“No statistical significance testing has been carried out to test baseline imbalances between the intervention arms but any noted differences are descriptively reported.(43,44) METHODS”
MethodVorland, C. J., Brown, A. W., Dawson, J., Dickinson, S., Golzarri‐Arroyo, L., Hannon, B. A., Heo, M., Heymsfield, S. B., Jayawardene, W. P., Kahathuduwa, C. N., et al. (2021) · International Journal of Obesity · doi:10.1038/s41366-021-00909-z · Cited by 43
Base Logic: Tests of Baseline Balance in Randomized Clinical Trials
Senn, S. J. (1995) · Clinical Research and Regulatory Affairs · doi:10.3109/10601339509019426 · Cited by 37
Self-citationSpears, C. A., Abroms, L. C., Glass, C. R., Hedeker, D., Eriksen, M. P., Cottrell-Daniels, C., Tran, B. Q., & Wetter, D. W. (2019) · JMIR mHealth and uHealth · doi:10.2196/13059 · Cited by 37
“Although statistical tests were not conducted to examine baseline differences between treatment groups [46,47], examination of the descriptive statistics suggests that participants in the iQuit Mindfully condition were more likely to be African American and have lower SES than those in MBAT.”
MethodInterpreting Randomized Controlled Trials
Msaouel, P., Lee, J., & Thall, P. F. (2023) · Cancers · doi:10.3390/cancers15194674 · Cited by 39
“Complete randomization cannot perfectly balance baseline covariates between the treatment groups enrolled in an RCT [8,89,100,101].”
BackgroundLee, P. H. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.02.004 · Cited by 39
“This practice has been advocated for more than 20 years [11], but not all published articles on RCTs have abided by the CONSORT Statement.”
BackgroundRandomized Trial of Drug Abuse Treatment-Linkage Strategies.
Sorensen, J. L., Masson, C. L., Delucchi, K., Sporer, K. A., Barnett, P. G., Mitsuishi, F., Lin, C. Y., Song, Y., Chen, T., & Hall, S. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.6.1026 · Cited by 37
“As participants were randomized to intervention, comparisons at baseline were not tested (Senn, 1994).”
BackgroundAssessment of QTc Prolongation for Non‐Cardiac‐Related Drugs from a Drug Development Perspective
Bonate, P. L., & Russell, T. (1999) · The Journal of Clinical Pharmacology · doi:10.1177/00912709922007912 · Cited by 37
Beckwée, D., Hertogh, W. D., Lievens, P., Bautmans, I., & Vaes, P. (2012) · Trials · doi:10.1186/1745-6215-13-21 · Cited by 47
“3, these covariates of prognostic values will be added as covariates in the ANOVA model [40].”
MethodAustin, P. C., Thomas, N., & Rubin, D. B. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280218817926 · Cited by 39
Measuring continuous baseline covariate imbalances in clinical trial data
Ciolino, J. D., Martin, R. H., Zhao, W., Hill, M. D., Jauch, E. C., & Palesch, Y. Y. (2011) · Statistical Methods in Medical Research · doi:10.1177/0962280211416038 · Cited by 34
“Balance in influential covariates is by no means meant to replace adjustment because adjustment should be made for influential covariates regardless of level of imbalance.(9,29,38,39) Perhaps Senn(29)”
BackgroundSchoenfeld, B. J., Grgić, J., Contreras, B. M., Delcastillo, K., Alto, A., Haun, C. T., Souza, E. O. D., & Vigotsky, A. D. (2020) · Frontiers in Physiology · doi:10.3389/fphys.2019.01571 · Cited by 38
Kotani, T., Ida, M., Naito, Y., & Kawaguchi, M. (2024) · Journal of Anesthesia · doi:10.1007/s00540-024-03311-x · Cited by 37
Cluster size variability and imbalance in cluster randomized controlled trials
Carter, B. (2010) · Statistics in Medicine · doi:10.1002/sim.4050 · Cited by 33
“Quantifying baseline imbalance and testing of covariates is carried out, but it is preferred to view the imbalances subjectively and any suggested differences implied from a standpoint of prior knowledge of the scientific importance of the covariates under scrutiny [9].”
BackgroundJohnson, S. R., Granton, J. T., TOMLINSON, G. A., Grosbein, H. A., HAWKER, G. A., & Feldman, B. M. (2010) · The Journal of Rheumatology · doi:10.3899/jrheum.100632 · Cited by 38
Comparisons of minimization and Atkinson's algorithm
Senn, S. J., Anisimov, V. V., & Fedorov, V. V. (2010) · Statistics in Medicine · doi:10.1002/sim.3763 · Cited by 33
Self-citationNguyen, T., Collins, G. S., Spence, J. D., Devereaux, P. J., Daurès, J., Landais, P., & Manach, Y. L. (2017) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4325 · Cited by 37
Okuhara, T., Ishikawa, H., OKADA, M., Kato, M., & Kiuchi, T. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00105 · Cited by 40
Making Effects Manifest in Randomized Experiments
Bowers, J. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921452.032 · Cited by 32
Analysis of Studies to Evaluate Immune Response to Combination Vaccines
Horne, A. D., Lachenbruch, P. A., Getson, P. R., & Hsu, H. (2001) · Clinical Infectious Diseases · doi:10.1086/322566 · Cited by 32
“For confirmatory analyses—that is, analyses that are inferential rather than exploratory in nature—there are compelling arguments that selection of covariates should be done prospectively and should be based on clinical and biological knowledge of the prognostic value of the covariates rather than on significance test…”
MethodBaseline comparisons and covariate fishing: Bad statistical habits we should have broken yesterdayPreprint
Gruijters, S. L. K. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qftwg · Cited by 33
“That being said, the use of NHSTs to establish the degree of baseline similarity is inappropriate, potentially misleading (Altman & Doré, 1990; De Boer, Waterlander, Kuijper, Steenhuis, & Twisk, 2015; Roberts & Torgerson, 1999; Senn, 1994), and, simply, logically incoherent.”
BackgroundMethodResultInfluentialThe Perils of Randomization Checks in the Analysis of Experiments
Mutz, D. C., & Pemantle, R. (2012) · ScholarlyCommons (University of Pennsylvania) · Cited by 31
The Dehydroepiandrosterone And WellNess (DAWN) study: Research design and methods
von Mühlen, D. G., Laughlin, G. A., Kritz‐Silverstein, D. C., & Barrett-Connor, E. L. (2006) · Contemporary Clinical Trials · doi:10.1016/j.cct.2006.04.009 · Cited by 34
“, age, bodymass index) will be identified for each outcome and fitted in analyses of covariance and other statistical analyses [88].”
MethodHartig, T., & Jahncke, H. (2017) · Journal of Toxicology and Environmental Health Part B · doi:10.1080/10937404.2017.1363101 · Cited by 39
“Such a test of baseline equivalence was done as a matter of convention, but we follow Ohly et al. in agreeing with Senn (1994) that researchers should orient to the absolute difference rather than to a statistical test result.”
Chu, R., Walter, S. D., Guyatt, G. H., Devereaux, P. J., Walsh, M. W., Thorlund, K., & Thabane, L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036677 · Cited by 34
“Despite randomization, imbalance in PFs as a result of chance (chance imbalance) may still arise, and with small to moderate sample sizes such imbalance may be substantial [2,3].”
BackgroundCovariate Imbalance and Adjustment for Logistic Regression Analysis of Clinical Trial Data
Ciolino, J. D., Martin, R. H., Zhao, W., Jauch, E. C., Hill, M. D., & Palesch, Y. Y. (2013) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2013.834912 · Cited by 30
Walwyn, R. E. A., Potts, L. C., McCrone, P., Johnson, A. L., DeCesare, J. C., Baber, H., Goldsmith, K., Sharpe, M., Chalder, T., & White, P. D. (2013) · Trials · doi:10.1186/1745-6215-14-386 · Cited by 32
“No statistical significance tests or CIs will be calculated for differences between randomised interventions on any participantlevel baseline variables [69-71].”
BackgroundPutting Public Policy Defaults to the Test: The Case of Organ Donor Registration
Moseley, A., & Stoker, G. (2015) · International Public Management Journal · doi:10.1080/10967494.2015.1012574 · Cited by 31
“See Senn (1994) and Mutz (2011) for alternative perspectives on controlling for randomly generated baseline imbalances within experimental designs.”
BackgroundMethodIs follow up by specialists routinely needed after elective surgery? A controlled trial.
Bailey, J., Roland, M. O., & Roberts, C. (1999) · Journal of Epidemiology & Community Health · doi:10.1136/jech.53.2.118 · Cited by 30
Assessing baseline comparability in randomised trials
Elkins, M. R. (2015) · Journal of physiotherapy · doi:10.1016/j.jphys.2015.07.005 · Cited by 29
Amino acids to prevent cardiac surgery-associated acute kidney injury: a randomized controlled trial
Kazawa, M., Kabata, D., Yoshida, H., Minami, K., Maeda, T., Yoshitani, K., Matsuda, H., & Shintani, A. (2024) · JA Clinical Reports · doi:10.1186/s40981-024-00703-6 · Cited by 29
“This adjustment is recommended to improve the precision of the analysis, even when the baseline prognostic variables are balanced [11].”
Robust extraction of covariate information to improve estimation efficiency in randomized trials
Moore, K. L., Neugebauer, R. S., Valappil, T., & van der Laan, M. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4301 · Cited by 35
“Because a perfect balance is very unlikely, it is a better strategy to include those covariates in the adjustment that are predictive of the outcome, based on the relation in formula (2), as recommended in [2, 4, 14, 27].”
BackgroundMethodRandomized trial of DVD, telephone, and usual care for increasing mammography adherence
Champion, V. L., Rawl, S. M., Bourff, S. A., Champion, K. M., Yazel-Smith, L. G., Buchanan, A. H., Fish, L. J., Monahan, P. O., Stump, T. E., Springston, J. K., et al. (2014) · Journal of Health Psychology · doi:10.1177/1359105314542817 · Cited by 30
“Demographic and other theoretically justified variables were entered as potential confounders of the relationship between the interventions and mammography adherence (Senn, 1994).”
BackgroundReporting of treatment effects from randomized trials: A plea for multivariable risk ratios
Groenwold, R. H. H., Moons, K. G. M., Peelen, L. M., Knol, M. J., & Hoes, A. W. (2011) · Contemporary Clinical Trials · doi:10.1016/j.cct.2010.12.011 · Cited by 27
“based on a comparison between the treatment groups (usually presented in the baseline table) [3,4].”
BackgroundThe Clinical Relevance of the Percentage Flow-Mediated Dilation Index
Atkinson, G., & Batterham, A. M. (2015) · Current Hypertension Reports · doi:10.1007/s11906-014-0514-0 · Cited by 31
Santoso, L. P., Stein, R. M., & Stevenson, R. T. (2016) · Political Analysis · doi:10.1093/pan/mpw016 · Cited by 25
Randomized Controlled Trial of Exercise to Improve Walking Energetics in Older Adults
Collins, K. J., Schrack, J. A., VanSwearingen, J. M., Glynn, N. W., Pospisil, M. C., Gant, V. E., & Mackey, D. C. (2018) · Innovation in Aging · doi:10.1093/geroni/igy022 · Cited by 29
Champion, V. L., Paskett, E. D., Stump, T. E., Biederman, E. B., Vachon, E. A., Katz, M. L., Rawl, S. M., Baltic, R. D., Kettler, C. D., Seiber, E. E., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.11004 · Cited by 26
Statistical issues in randomised controlled trials: a narrative synthesis
Egbewale, B. E. (2015) · Asian Pacific Journal of Tropical Biomedicine · doi:10.1016/s2221-1691(15)30367-1 · Cited by 30
“In addition, ignoring baseline covariates that have prognostic influence but not significantly different between groups is also an argument against the correctness of the use of hypothesis testing approach for covariate selection[20-23,25,27,28].”
MethodTringali, A., Manta, R., Sica, M., Bassotti, G., Marmo, R., & Mutignani, M. (2017) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13258 · Cited by 26
Havard, A., Shakeshaft, A. P., Conigrave, K. M., & Doran, C. M. (2011) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2011.01632.x · Cited by 24
“Consistent with recommendations regarding the reporting of RCTs, which emphasize that, by definition, any baseline differences between treatment groups are because of chance, comparisons between treatment groups at baseline were not conducted (Pocock et al., 2002; Senn, 1994).”
Minimization in randomized clinical trials
Coart, E., Bamps, P., Quinaux, E., Sturbois, G., Saad, E. D., Burzykowski, T., & Buyse, M. E. (2023) · Statistics in Medicine · doi:10.1002/sim.9916 · Cited by 35
Lawlor, D. A., Peters, T. J., Howe, L. D., Noble, S., Kipping, R., & Jago, R. (2013) · Trials · doi:10.1186/1745-6215-14-234 · Cited by 27
“We will not compare baseline characteristics between the two groups with a statistical test (p-value) as any low values simply represent a type-1 error under the assumption that we have adequately randomly allocated participants [19].”
MethodMurray, L., Jennings, S., Perry, H., Andrews, M., Wilde, K. D., Newell, A., Mortimer, A., Phillips, E., Liu, X., Hughes, C. H., et al. (2022) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2022.07.008 · Cited by 37
Adjusting for Ordinal Covariates by Inducing a Partial Ordering
Berger, V. W., Zhou, Y., Ivanova, A., & Tremmel, L. T. (2004) · Biometrical Journal · doi:10.1002/bimj.200410012 · Cited by 24
Daskalakis, Z. J., Tamminga, C., Throop, A., Palmer, L., Dimitrova, J., Farzan, F., Thorpe, K. E., McClintock, S. M., & Blumberger, D. M. (2021) · Trials · doi:10.1186/s13063-021-05730-7 · Cited by 23
Mantopoulos, T., Mitchell, P. M., Welton, N. J., McManus, R. J., & Andronis, L. (2015) · The European Journal of Health Economics · doi:10.1007/s10198-015-0731-8 · Cited by 26
“numbers of participants, or simply chance, can lead to imbalances in baseline covariates [2, 6, 7, 8], which will inevitably result in biased effectiveness and cost-effectiveness estimates [9–11].”
BackgroundGilbert, S. E., Tew, G. A., Bourke, L., Winter, E., & Rosario, D. J. (2013) · Experimental Physiology · doi:10.1113/expphysiol.2013.073353 · Cited by 24
“Although data presented by Herman et al. (1997) suggest that baseline diameter was similar between groups, this does not eradicate the influence of baseline diameter on estimates of endothelial function reported using the traditional approach to FMD (Senn, 1994).”
ResultBriggs, D., Dudley, C., Pattison, J. M., Pfeffer, P. F., Salmela, K. T., Rowe, P. A., & Tyd�n, G. (2003) · Transplantation · doi:10.1097/01.tp.0000069041.48226.dd · Cited by 22
Englis, B. G., & Frederiks, A. J. (2023) · Entrepreneurship Education and Pedagogy · doi:10.1177/25151274231161102 · Cited by 35
Randomization to treatment failure in experimental auctions: The value of data from training rounds
Briz, T., Drichoutis, A. C., & Nayga, R. M. (2017) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2017.09.004 · Cited by 27
“…randomization has been done fairly (that is, the researcher has not cheated the randomization process in order to favor a treatment; as a side note, Senn (1994) demonstrates how one could allocate units in a way which favors one treatment over another but which does not lead to statistically…”
BackgroundRusso, R., Coultas, D., Ashmore, J. A., PEOPLES, J. A., Sloan, J., Jackson, B. E., Uhm, M., Singh, K. P., Blair, S. N., & Bae, S. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.01.018 · Cited by 23
“[30–32].”
Guidelines for estimating causal effects in pragmatic randomized trialsPreprint
Murray, E. J., Swanson, S. A., & Hernán, M. Á. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.06030 · Cited by 29
Nguyen, T., & Xie, L. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.012 · Cited by 25
Two-stage matching-adjusted indirect comparison
Remiro‐Azócar, A. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01692-9 · Cited by 25
“As formulated by Senn [66], “over all randomizations the groups are balanced; for a particular randomization they are unbalanced.””
BackgroundInfluentialSherry, A. D., Msaouel, P., McCaw, Z. R., Jaoude, J. A., Hsu, E. J., Kouzy, R., Patel, R. R., Yang, Y., Lin, T. A., Taniguchi, C. M., et al. (2023) · European Journal of Cancer · doi:10.1016/j.ejca.2023.113357 · Cited by 24
“…in significance testing of baseline variable distributions after sound randomisation is not informative, since any baseline variable differences following unbiased randomisation are already known to be due to chance; in other words, significant findings are, by definition, false positives [6,7].”
BackgroundResultInfluentialHind, D., Mountain, G. A., Gossage-Worrall, R., Walters, S. J., Duncan, R., Newbould, L., Rex, S., Jones, C., Bowling, A., Cattan, M., et al. (2014) · Public Health Research · doi:10.3310/phr02070 · Cited by 26
Rajeev, S. P., Sprung, V. S., Roberts, C. A., Harrold, J. A., Halford, J. C. G., Stančák, A., Boyland, E. J., Kemp, G. J., Cuthbertson, D. J., & Wilding, J. P. H. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013539 · Cited by 20
Barrett, T. W., & Schriger, D. L. (2008) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2008.05.001 · Cited by 20
Advances in propensity score analysis
Austin, P. C. (2020) · Statistical Methods in Medical Research · doi:10.1177/0962280219899248 · Cited by 20
“Finally, in RCTs, investigators often conduct adjusted analyses in order to remove the effects of confounding due to residual imbalance between treatment groups.(7) In observational research, there is a history of combining matching-based methods with regression adjustment.”
MethodLessons from TGN1412 and TARGET: implications for observational studies and meta‐analysis
Senn, S. J. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.322 · Cited by 18
Self-citation
Metadata
- Authors
- Senn, S.
- Corresponding author
- Senn, Stephen
- ORCID
- Senn, Stephen
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1994-09-15
- Volume
- 13
- Issue
- 17
- Pages
- 1715-1726
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2121392364
- Cited by
- 503
- References
- 39
- Citations by year
- 2026: 18 · 2025: 18 · 2024: 25 · 2023: 17 · 2022: 36 · 2021: 25 · 2020: 47 · 2019: 19 · 2018: 43 · 2017: 24 · 2016: 15 · 2015: 28 · 2014: 21 · 2013: 22 · 2012: 19
- FWCI
- 3.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Royal Society
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- prognostic factors, covariance analysis, treatment effect estimation, clinical trial design, covariate selection
- MeSH terms
- Algorithms, Analysis of Variance, Data Interpretation, Statistical, Humans, Research Design, Selection Bias, Multivariate Analysis, Randomized Controlled Trials as Topic, Treatment Outcome, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.