Testing for baseline balance in clinical trials
The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
Once the data from a clinical trial are available for analysis it is common practice to carry out ‘tests of baseline homogeneity’ on prognostic covariates before proceeding to analyse the effects of treatment on outcome variables. It is argued that this practice is philosophically unsound, of no practical value and potentially misleading. Instead it is recommended that prognostic variables be identified in the trial‐plan and fitted in an analysis of covariance regardless of their baseline distribution (statistical significance).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Between-group differences on change scores of the outcomes were tested using a General Linear Model (GLM) while adjusting for theoretically-important covariates (i.e., age, stage of cancer, education)39 and cancer treatments received, which differed significantly between arms at baseline.”
From Acceptance and commitment therapy for breast cancer survivors with fear of cancer recurrence: A 3-arm pilot randomized controlled trial. (2020) · cites this paper as [39]
Citations
Cites
Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,155
Cross-Over Trials in Clinical Research
(1994) · Technometrics · doi:10.1080/00401706.1994.10485798 · Cited by 763
Self-citationClinical Trials: Design, Conduct and Analysis
Meinert, C. L. (1986) · DigitalGeorgetown (Georgetown University Library) · doi:10.1093/acprof:oso/9780195035681.001.0001 · Cited by 756
GAIL, M. H., WIEAND, S., & PIANTADOSI, S. (1984) · Biometrika · doi:10.1093/biomet/71.3.431 · Cited by 698
Senn, S., Frison, L., & Pocock, S. (1994) · Statistics in Medicine · doi:10.1002/sim.4780130210 · Cited by 529
Self-citationRandomisation and baseline comparisons in clinical trials
Altman, D. G., & Doré, C. J. (1990) · The Lancet · doi:10.1016/0140-6736(90)90014-v · Cited by 508
On the Principle of Total Evidence
GOOD, I. J. (1967) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/17.4.319 · Cited by 329
Comparability of Randomised Groups
Altman, D. G. (1985) · The Statistician · doi:10.2307/2987510 · Cited by 328
Research works printed but not linked: 3
- Maxwell C., 1973, Clinical Research For All
- Lindley D. V., 1985, Making Decisions
- Miller D., 1991, On the Maximization of Expected Futility
Cited by
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758
“Senn writes that, in a RCT, ‘over all the randomizations the groups are balanced; and that for a particular randomization they are unbalanced’ [35].”
BackgroundMakkar, R. R., Smith, R. R., Cheng, K., Malliaras, K., Thomson, L. E., Berman, D., Czer, L. S., Marbán, L., Mendizabal, A., Johnston, P. V., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60195-0 · Cited by 1,422
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
“Senn writes that, in an RCT, ‘over all the randomizations the groups are balanced; and that for a particular randomization they are unbalanced’ [10].”
BackgroundSubgroup analysis and other (mis)uses of baseline data in clinical trials
Assmann, S. F., Pocock, S. J., Enos, L. E., & Kasten, L. E. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02039-0 · Cited by 1,167
Pocock, S. J., Assmann, S. E., Enos, L. E., & Kasten, L. E. (2002) · Statistics in Medicine · doi:10.1002/sim.1296 · Cited by 1,077
“Thus, P-values for baseline di�erences do not serve a useful purpose [ 23 , 24], since they are not testing a useful scienti�c hypothesis.”
BackgroundMisunderstandings Between Experimentalists and Observationalists about Causal Inference
Imai, K., King, G., & Stuart, E. A. (2008) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00527.x · Cited by 906
“Senn (1994), page 1716, explained that this ‘common procedure’ is ‘philosophically unsound, of no practical value, and potentially misleading’.”
BackgroundResultCausal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · Thammasat University Digital Collections · Cited by 838
Menon, U., Gentry-Maharaj, A., Hallett, R., Ryan, A., Burnell, M., Sharma, A., Lewis, S., Davies, S., Philpott, S., Lopes, A., et al. (2009) · The Lancet Oncology · doi:10.1016/s1470-2045(09)70026-9 · Cited by 829
Oral topiramate for treatment of alcohol dependence: A randomised controlled trial
Johnson, B. A., Ait-Daoud, N., Bowden, C. L., DiClemente, C. C., Roache, J. D., Lawson, K., Javors, M. A., & Ma, J. Z. (2003) · The Lancet · doi:10.1016/s0140-6736(03)13370-3 · Cited by 743
Morelli, A., Ertmer, C., Westphal, M., Rehberg, S., Kampmeier, T., Ligges, S., Orecchioni, A., D’Egidio, A., D’Ippoliti, F., Raffone, C., et al. (2013) · JAMA · doi:10.1001/jama.2013.278477 · Cited by 720
“001 Length of ICU stay, d Median (IQR) 19 (11-27) 14 (7-25) .”
Austin, P. C. (2007) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2007.07.021 · Cited by 589
The Econometrics of Randomized Experiments
(2017) · Handbook of Economic Field Experiments · doi:10.1016/bs.hefe.2016.10.003 · Cited by 562
“See for additional discussions Lesaffre and Senn (2003), Samii and Aronow (2012), Rosenbaum (2002), Lin (2013), Schochet (2010), Young (2016), Senn (1994).”
BackgroundStepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression Analysis
Steyerberg, E. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00103-1 · Cited by 495
“Following others, we would not recommend stepwise selection with a low a as the primary approach in these circumstances [1–3,35,37–40].”
BackgroundHemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Reporting attrition in randomised controlled trials
Dumville, J. C., Torgerson, D. J., & Hewitt, C. E. (2006) · BMJ · doi:10.1136/bmj.332.7547.969 · Cited by 443
Righini, M., Le Gal, G., Aujesky, D., Roy, P.-M., Sanchez, O., Verschuren, F., Rutschmann, O., Nonent, M., Cornuz, J., Thys, F., et al. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60594-2 · Cited by 420
Covariate Balance in Simple, Stratified and Clustered Comparative Studies
Hansen, B. B., & Bowers, J. (2008) · Statistical Science · doi:10.1214/08-sts254 · Cited by 414
“data drive the weighting scheme, upweighting discrepancies along variables with less variation in general, and has the advantage of easy calibration against χ2 tables. Altman (1985), Begg (1990) and Senn (1994) criticize the use of balance tests to decide which covariates to adjust for in the outcome analysis of a cli…”
BackgroundJohnson, B. A., Roache, J. D., Javors, M. A., DiClemente, C. C., Cloninger, C. R., Prihoda, T. J., Bordnick, P. S., Ait-Daoud, N., & Hensler, J. (2000) · JAMA · doi:10.1001/jama.284.8.963 · Cited by 414
Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars
Mayo, D. G. (2018) · doi:10.1017/9781107286184 · Cited by 376
Hermansen, K., Fontaine, P., Kukolja, K. K., Peterkova, V., Leth, G., & Gall, M.-A. (2004) · Diabetologia · doi:10.1007/s00125-004-1365-z · Cited by 365
A Weighting Analogue to Pair Matching in Propensity Score Analysis
Li, L., & Greene, T. (2013) · ijb · doi:10.1515/ijb-2012-0030 · Cited by 350
True and false interindividual differences in the physiological response to an intervention
Atkinson, G., & Batterham, A. M. (2015) · Experimental Physiology · doi:10.1113/ep085070 · Cited by 300
“Nevertheless, an approach involving ANCOVA, adjusting for any chance imbalance between trial arms at baseline, is known to be superior to Student’s unpaired t test on change scores (Senn, 1994; Vickers & Altman, 2001).”
MethodUnderstanding controlled trials: Baseline imbalance in randomised controlled trials
Roberts, C., & Torgerson, D. J. (1999) · BMJ · doi:10.1136/bmj.319.7203.185 · Cited by 286
“If we accept that statistical tests and visual inspection of differences between groups are unsound methods of choosing to adjust for baseline, one proposed strategy”
MethodLenze, E. J., Mulsant, B. H., Blumberger, D. M., Karp, J. F., Newcomer, J. W., Anderson, S. J., Dew, M. A., Butters, M. A., Stack, J. A., Begley, A. E., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)00308-6 · Cited by 283
Seven myths of randomisation in clinical trials
Senn, S. (2013) · Statistics in Medicine · doi:10.1002/sim.5713 · Cited by 274
“An analogous technique called analysis of covariance can be used to adjust for imbalances in continuous prognostic variables [8, 9].”
MethodSelf-citationMansournia, M. A., Collins, G. S., Nielsen, R. O., Nazemipour, M., Jewell, N. P., Altman, D. G., & Campbell, M. J. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103652 · Cited by 263
Hernández, A. V., Steyerberg, E. W., & Habbema, J. D. F. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.09.014 · Cited by 258
“Common methods of adjustment are baseline imbalance adjustment [5,9], subgroup analysis”
BackgroundMethodInfluentialHarvey, A. G., Soehner, A. M., Kaplan, K. A., Hein, K., Lee, J., Kanady, J., Li, D., Rabe-Hesketh, S., Ketter, T. A., Neylan, T. C., et al. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0038655 · Cited by 257
“Results The groups were similar in their demographics and baseline illness characteristics, with the exception of years of education (see Table 1) which was included as a covariate (Senn, 1994).”
BackgroundMusic improves social communication and auditory–motor connectivity in children with autism
Sharda, M., Tuerk, C., Chowdhury, R., Jamey, K., Foster, N., Custo-Blanch, M., Tan, M., Nadig, A., & Hyde, K. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0287-3 · Cited by 254
Allocation techniques for balance at baseline in cluster randomized trials: a methodological review
Ivers, N. M., Halperin, I. J., Barnsley, J., Grimshaw, J. M., Shah, B. R., Tu, K., Upshur, R., & Zwarenstein, M. (2012) · Trials · doi:10.1186/1745-6215-13-120 · Cited by 251
“Even when a priori adjusted analyses are appropriately [13] used to analyze a randomized trial, readers may find such analyses less transparent and thus less trustworthy, especially when adjusted and unadjusted results are grossly different [9].”
BackgroundEgbewale, B. E., Lewis, M., & Sim, J. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-49 · Cited by 234
“Several authors [2,34,36-39] argue that covariates should be selected a priori in terms of their prognostic importance, rather than on the basis of examining baseline imbalance in the trial data – even large imbalance is of little consequence in terms of bias if the covariate is not related to outcome.”
BackgroundPropensity score matching and variations on the balancing test
Lee, W.-S. (2013) · Empirical Economics · doi:10.1007/s00181-011-0481-0 · Cited by 224
“See, for example, Begg (1990) and Senn (1994).”
Allometric scaling of diameter change in the original flow-mediated dilation protocol
Atkinson, G., & Batterham, A. M. (2013) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2012.11.027 · Cited by 213
Analysis of Randomized Controlled Trials
Peduzzi, P. (2002) · Epidemiologic Reviews · doi:10.1093/epirev/24.1.26 · Cited by 201
“However, we find the arguments of Senn (94) persuasive, and we do not recommend the unweighted analysis.”
BackgroundMethodInfluentialAustin, P. C. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.11.004 · Cited by 195
The Perils of Balance Testing in Experimental Design: Messy Analyses of Clean Data
Mutz, D. C., Pemantle, R., & Pham, P. (2019) · The American Statistician · doi:10.1080/00031305.2017.1322143 · Cited by 195
“First, as pointed out on multiple occasions (e.g., Senn 1994), a statistical test for the hypothesis that the conditionswere randomly assigned ismeaningless if one already knows that the conditions were randomly assigned.”
BackgroundHow to Select Covariates to Include in the Analysis of a Clinical Trial
Raab, G. M., Day, S., & Sales, J. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00061-1 · Cited by 182
“This has been demonstrated and discussed by several investigators [8–14].”
BackgroundResultShelton, R. J., Clark, A. L., Goode, K., Rigby, A. S., Houghton, T., Kaye, G. C., & Cleland, J. G. F. (2009) · Heart · doi:10.1136/hrt.2008.158931 · Cited by 178
Detecting Selection Bias in Randomized Clinical Trials
Berger, V. W., & Exner, D. V. (1999) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00014-8 · Cited by 163
“Regardless of the patient population involved, such baseline between-group tests have been criticized [21] because when the integrity of the randomization is not in question, the null hypothesis (balance over all possible randomization sequences) must be true, so rejection would entail a type I error.”
BackgroundStatistical errors in medical research - a review of common pitfalls
Strasak, A., Zaman, Q., Pfeiffer, K., Göbel, G., & Ulmer, H. (2007) · Swiss Medical Weekly · doi:10.4414/smw.2007.11587 · Cited by 161
Austin, P. C., Manca, A., Zwarenstein, M., Juurlink, D. N., & Stanbrook, M. B. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.002 · Cited by 159
“argue that the covariates should be selected a priori, and that the selected covariates should be strongly prognostic of the outcome [1,9].”
BackgroundInfluentialIdentifiability, exchangeability and confounding revisited
Greenland, S., & Robins, J. M. (2009) · Epidemiologic Perspectives & Innovations · doi:10.1186/1742-5573-6-4 · Cited by 183
“Adjustment for Baseline Covariates under an Ignorable Mechanism As noted above, there have been many intuitive and mathematical arguments as to why adjustment for baseline covariates can be important, even with an ignorable exposure-assignment mechanism such as randomization (e.g., [17,20,21,55, 57-59 ]).”
BackgroundStatistical inference as severe testing how to get beyond the statistics wars
Mayo, D. G. (2018) · Cited by 159
Dimairo, M., Pallmann, P., Wason, J. M. S., Todd, S., Jaki, T., Julious, S. A., Mander, A., Weir, C. J., König, F., Walton, M. K., et al. (2020) · BMJ · doi:10.1136/bmj.m115 · Cited by 171
Quasi-experimental study designs series—paper 7: assessing the assumptions
Bärnighausen, T., Oldenburg, C. E., Tugwell, P., Bommer, C., Ebert, C. L., Barreto, M. L., Djimeu, E. W., Haber, N., Waddington, H. S., Rockers, P. C., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.017 · Cited by 163
Austin, P. C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.012 · Cited by 145
Johns, S. A., Stutz, P. V., Talib, T. L., Cohee, A. A., Beck‐Coon, K. A., Brown, L. F., Wilhelm, L. R., Monahan, P. O., LaPradd, M. L., Champion, V. L., et al. (2020) · Cancer · doi:10.1002/cncr.32518 · Cited by 141
A roadmap to using randomization in clinical trials
Berger, V. W., Bour, L. J., Carter, K., Chipman, J. J., Everett, C. C., Heussen, N., Hewitt, C., Hilgers, R.-D., Luo, Y. A., Renteria, J., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01303-z · Cited by 135
Atkinson, G., & Batterham, A. M. (2013) · Vascular Medicine · doi:10.1177/1358863x13508446 · Cited by 133
Controversies concerning randomization and additivity in clinical trials.
Senn, S. (2004) · Statistics in Medicine · doi:10.1002/sim.2074 · Cited by 132
Self-citationUnderstanding and Misunderstanding Randomized Controlled Trials
Deaton, A., & Cartwright, N. D. (2016) · National Bureau of Economic Research · doi:10.3386/w22595 · Cited by 182
Attarian, S., Vallat, J., Magy, L., Funalot, B., Gonnaud, P., Lacour, A., Péréon, Y., Dubourg, O., Pouget, J., Micallef, J., et al. (2014) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-014-0199-0 · Cited by 130
“Baseline analysis Demographic and clinical patient characteristics were presented for each group [34].”
MethodCuoco, F. A. (2010) · Yearbook of Cardiology · doi:10.1016/s0145-4145(10)79886-5 · Cited by 124
How to run an experimental auction: a review of recent advances
Canavari, M., Drichoutis, A. C., Lusk, J. L., & Nayga, R. M. (2019) · European Review of Agricultural Economics · doi:10.1093/erae/jbz038 · Cited by 139
“Shogren (2009). Earned wealth, engaged bidders? Evidence from a second-price auction.”
BackgroundClinical trials in acute myocardial infarction: Should we adjust for baseline characteristics?
Steyerberg, E. W., Bossuyt, P. M., & Lee, K. L. (2000) · American Heart Journal · doi:10.1016/s0002-8703(00)90001-2 · Cited by 122
Selection of confounding variables should not be based on observed associations with exposure
Groenwold, R. H. H., Klungel, O. H., Grobbee, D. E., & Hoes, A. W. (2011) · European Journal of Epidemiology · doi:10.1007/s10654-011-9606-1 · Cited by 119
“For example, relatively small imbalances (indicated by large P values) of strong prognostic factors may still result in bias, when omitting such variables from an adjustment model [3].”
BackgroundBarrett, C., Mann, G. E., Taylor, P., & Strike, P. W. (2009) · Multiple Sclerosis Journal · doi:10.1177/1352458508101320 · Cited by 115
“As a precautionary measure, both variables were used as covariates in subsequent ANCOVA analysis to assess their possible impact on treatment response at 18 weeks.”
InfluentialJohns, S. A., Brown, L. F., Beck-Coon, K., Talib, T. L., Monahan, P. O., Giesler, R. B., Tong, Y., Wilhelm, L., Carpenter, J. S., Von Ah, D., et al. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3220-4 · Cited by 112
“10 [42], including cancer type and income.”
Johns, S. A., Ah, D. M. V., Brown, L. F., Beck‐Coon, K., Talib, T. L., Alyea, J. M., Monahan, P. O., Tong, Y., Wilhelm, L. R., & Giesler, R. B. (2015) · Journal of Cancer Survivorship · doi:10.1007/s11764-015-0494-3 · Cited by 125
Standards for Experimental Research: Encouraging a Better Understanding of Experimental Methods
Mutz, D. C., & Pemantle, R. (2015) · Journal of Experimental Political Science · doi:10.1017/xps.2015.4 · Cited by 120
“This point has been made many times in the literature in political science (Imai et al. 2008) as well as in other disciplines (Boers 2011; Senn 1994).”
BackgroundFeuille, M., & Pargament, K. (2015) · Journal of Health Psychology · doi:10.1177/1359105313508459 · Cited by 101
“This is in keeping with recommendations by Senn (1994) and Permutt (1990) that baseline variables not significantly correlated with outcomes should not be used as covariates, even if these baseline variables differ significantly between groups at pre-test.”
ResultRiley, R. D., Kauser, I., Bland, M., Thijs, L., Staessen, J. A., Wang, J., Gueyffier, F., & Deeks, J. J. (2013) · Statistics in Medicine · doi:10.1002/sim.5726 · Cited by 104
Pedroza, C., & Truong, V. T. T. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0217-0 · Cited by 105
“, stratifying variables) or for baseline covariates that are strong predictors of outcome (to gain efficiency) [12].”
BackgroundTwelve-Month Follow-up of Cognitive Behavioral Therapy for Children With Functional Abdominal Pain
Levy, R. L., Langer, S. L., Walker, L. S., Romano, J. M., Christie, D. L., Youssef, N. N., DuPen, M. M., Ballard, S., Labus, J. S., Welsh, E. M., et al. (2012) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/2013.jamapediatrics.282 · Cited by 103
“In addition, participants assigned to the interventions shouldbestratifiedon thesepainmeasures.(34,35) This study is the largest, to date, randomized controlled trial with a lengthy follow-up period of a psychological in-”
Austin, P. C., & Laupacis, A. (2011) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1285 · Cited by 106
“Several authors have suggested that regression adjustment be used to adjust for potential differences in baseline covariates that are predictive of the outcome (Senn,1989; Senn, 1994; Altman and Dore, 1991; Lavori et al., 1983).”
BackgroundMethodDouble propensity-score adjustment: A solution to design bias or bias due to incomplete matching
Austin, P. C. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280214543508 · Cited by 110
“Our proposed method of double propensity-score adjustment is similar to the practice of using regression adjustment in RCTs.(4,31) Regression adjustment in RCTs has been advocated for the following reasons: first, it allows for the removal of residual confounding due to minor differences in the distribution of measure…”
InfluentialFlodgren, G., Deane, K., Dickinson, H. O., Kirk, S., Alberti, H., Beyer, F. R., Brown, J. G., Penney, T. L., Summerbell, C. D., & Eccles, M. P. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000984.pub2 · Cited by 90
“Senn 1994 Senn S. Testing for base-line balance in clinical trials.”
Sassenhagen, J., & Alday, P. M. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.08.001 · Cited by 91
Zhao, W., Hill, M. D., & Palesch, Y. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280212436447 · Cited by 87
Springborg, J. B., Møller, C., Gideon, P., Jørgensen, O. S., Juhler, M., & Olsen, N. V. (2007) · Acta Neurochirurgica · doi:10.1007/s00701-007-1284-z · Cited by 85
“As suggested by Altman [3] and others [32] variables of prognostic value were identified at the planning stage of the study on the basis of available evidence.”
BackgroundGreenland, S., & Mansournia, M. A. (2015) · European Journal of Epidemiology · doi:10.1007/s10654-015-9995-7 · Cited by 86
“The blindness of DAGs and ignorability conditions to random imbalance and confounding is addressed by traditional recommendations to adjust for baseline prognostic factors to improve precision [7, 12], and to use estimated treatment probabilities even if the true treatment probabilities are known [26].”
BackgroundOlsén, T., Øvrebø, B., Haj‐Yasein, N. N., Lee-Ødegård, S., Svendsen, K., Hjorth, M., Bastani, N. E., Norheim, F., Drevon, C. A., Refsum, H., et al. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02288-x · Cited by 89
Cogo‐Moreira, H., de Ávila, C. R. B., Ploubidis, G. B., & Mari, J. D. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059984 · Cited by 106
Comparison of Interdental Cleaning Methods: A Randomized Controlled Trial
Jackson, M. A., Kellett, M., Worthington, H. V., & Clerehugh, V. (2006) · Journal of Periodontology · doi:10.1902/jop.2006.050360 · Cited by 96
Plotkin, D. L., Coleman, M., Every, D. W. V., Maldonado, J., Oberlin, D. J., Israetel, M. A., Feather, J., Alto, A., Vigotsky, A. D., & Schoenfeld, B. J. (2022) · PeerJ · doi:10.7717/peerj.14142 · Cited by 112
“Neither baseline nor within-group inferential statistics were calculated, as baseline significance testing is inconsequential (34) and within-232 group outcomes are irrelevant to this research question (8) .”
Consensus and Controversy in Pharmaceutical Statistics
Senn, S. J. (2000) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1111/1467-9884.00227 · Cited by 88
Self-citationA systematic review and meta-analysis of the probiotics and synbiotics effects on oxidative stress
Heshmati, J., Farsi, F., Shokri, F., Rezaeinejad, M., Almasi‐Hashiani, A., Vesali, S., & Sepidarkish, M. (2018) · Journal of Functional Foods · doi:10.1016/j.jff.2018.04.049 · Cited by 81
Isaranuwatchai, W., Brydges, R., Carnahan, H., Backstein, D. J., & Dubrowski, A. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-013-9464-6 · Cited by 75
“estimate the true treatment effect; however, in any particular RCT, the characteristics may not be balanced (Senn 1994).”
BackgroundBerg, S. K., Pedersen, P. U., Zwisler, A., Winkel, P., Gluud, C. N., Pedersen, B. D., & Svendsen, J. H. (2014) · European Journal of Cardiovascular Nursing · doi:10.1177/1474515114521920 · Cited by 79
“NYHA class I, n (%) 30 (31) 18 (19) NYHA class II, n (%) 42 (43) 44 (46) NYHA class III, n (%) 24 (25) 32 (33) NYHA class IV, n (%) 2 (2) 1(1)”
Fu, R., & Holmer, H. K. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.034 · Cited by 71
Althouse, A. D., Below, J. E., Claggett, B. L., Cox, N. J., de Lemos, J. A., Deo, R. C., Duval, S., Hachamovitch, R., Kaul, S., Keith, S. W., et al. (2021) · Circulation · doi:10.1161/circulationaha.121.055393 · Cited by 79
Stress recovery from virtual exposure to a brown (desert) environment versus a green environment
Yin, J., Bratman, G. N., Browning, M. H. E. M., Spengler, J. D., & Alvarez, H. A. O. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101775 · Cited by 74
Graziani, F., Palazzolo, A., Gennai, S., Karapetsa, D., Giuca, M., Cei, S., Filice, N., Petrini, M., & Nisi, M. (2017) · International Journal of Dental Hygiene · doi:10.1111/idh.12318 · Cited by 86
Schnipper, J. L., Roumie, C. L., Cawthon, C. R., Businger, A., Dalal, A. K., Mugalla, I. C., Eden, S., Jacobson, T. A., Rask, K. J., Vaccarino, V., et al. (2010) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.109.921833 · Cited by 71
Simple randomization did not protect against bias in smaller trials
Nguyen, T., Collins, P. G. S., Lamy, A. L., Devereaux, P. J., Daurès, J., Landais, P., & Manach, Y. L. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.010 · Cited by 77
“As the balance is a sample property rather than a population property, we did not asses s covariates balance with significance tests [14-18].”
BackgroundLong-Term Effects of Nasoalveolar Molding on Three-Dimensional Nasal Shape in Unilateral Clefts
Maull, D. J., Grayson, B. H., Cutting, C. B., Brecht, L. L., Bookstein, F. L., Khorrambadi, D., Webb, J. A., & Hurwitz, D. J. (1999) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569(1999)036<0391:lteonm>2.3.co;2 · Cited by 236
Adaptive randomization for balancing over covariates
Hu, F., Hu, Y., Ma, Z., & Rosenberger, W. F. (2014) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1309 · Cited by 84
“, v ∗ J ) are observed, that is, his or her jth covariate value is at level vj , j= 1, · · ·, J; (2) the patient is tentatively assigned to treatment k, k=1, · · ·, K; (3) assuming the assignment of treatment k, the patient numbers at the vj -th level (or margin) of covariate j, j= 1, · · ·, J, across the treatment gr…”
BackgroundHernández, A. V., Eijkemans, M. J. C., & Steyerberg, E. W. (2006) · Annals of Epidemiology · doi:10.1016/j.annepidem.2005.09.007 · Cited by 65
Ensuring the comparability of comparison groups: is randomization enough?
Berger, V. W., & Weinstein, S. (2004) · Controlled Clinical Trials · doi:10.1016/j.cct.2004.04.001 · Cited by 67
“Contrary to popular opinion [63,64], then, baseline covariate testing is logical (to test for selection bias), although better tests of selection bias exist, especially considering the multiplicity of covariates and the fact that some are not observed.”
Randomization, balance, and the validity and efficiency of design-adaptive allocation methods
Aickin, M. G. (2001) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00228-7 · Cited by 69
Ondansetron reduces mood disturbance among biologically predisposed, alcohol-dependent individuals.
Johnson, B., Ait-Daoud, N., Ma, J.-N. Z., & Wang, Y. (2003) · Alcoholism: Clinical and Experimental Research · doi:10.1097/01.alc.0000095635.46911.5d · Cited by 64
Zer, A., Pond, G. R., Razak, A. R. A., Tirona, K., Gan, H. K., Chen, E. X., O’Sullivan, B., Waldron, J. N., Goldstein, D. P., Weinreb, I., et al. (2017) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2017.2235 · Cited by 64
Zhang, R., Meng, J., Lian, Q., Chen, X., Bauman, B. D., Chu, H., Segura, B. J., & Roy, S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190362 · Cited by 66
Subgroup Analyses in Randomized Clinical Trials: Statistical and Regulatory Issues
Grouin, J., Coste, M., & Lewis, J. A. (2005) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-200067988 · Cited by 61
“The correct response to the latter would be to question the validity of the randomization process itself (Senn, 1994 1995 ).”
BackgroundWyatt, K. M., Lloyd, J., Creanor, S., Green, C., Dean, S. G., Hillsdon, M. M., Abraham, C., Tomlinson, R., Pearson, V. A. H., Taylor, R. S., et al. (2018) · Public Health Research · doi:10.3310/phr06010 · Cited by 68
“We prespecified that should there be any substantial imbalance between randomised groups at baseline, in terms of any relevant variables not already being adjusted for in the primary analysis, further adjusted sensitivity analyses may be performed, to allow for such variable(s), in addition to the prespecified variabl…”
MethodTrowman, R., Dumville, J. C., Torgerson, D. J., & Cranny, G. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.014 · Cited by 59
Dimairo, M., Pallmann, P., Wason, J., Todd, S., Jaki, T., Julious, S. A., Mander, A. P., Weir, C. J., Koenig, F., Walton, M. K., et al. (2020) · Trials · doi:10.1186/s13063-020-04334-x · Cited by 58
Ariel, B., & Farrington, D. P. (2009) · Springer eBooks · doi:10.1007/978-0-387-77650-7_21 · Cited by 66
Ludington, E. A., & Dexter, F. (1998) · Anesthesia & Analgesia · doi:10.1097/00000539-199809000-00045 · Cited by 75
Metadata
- Authors
- Senn, S.
- Corresponding author
- Senn, Stephen
- ORCID
- Senn, Stephen
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1994-09-15
- Volume
- 13
- Issue
- 17
- Pages
- 1715-1726
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2121392364
- Cited by
- 503
- References
- 39
- Citations by year
- 2026: 18 · 2025: 18 · 2024: 25 · 2023: 17 · 2022: 36 · 2021: 25 · 2020: 47 · 2019: 19 · 2018: 43 · 2017: 24 · 2016: 15 · 2015: 28 · 2014: 21 · 2013: 22 · 2012: 19
- FWCI
- 3.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Royal Society
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- prognostic factors, covariance analysis, treatment effect estimation, clinical trial design, covariate selection
- MeSH terms
- Algorithms, Analysis of Variance, Data Interpretation, Statistical, Humans, Research Design, Selection Bias, Multivariate Analysis, Randomized Controlled Trials as Topic, Treatment Outcome, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.