Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Certain important nonlinear regression models lead to biased estimates of treatment effect, even in randomized experiments, if needed covariates are omitted. The asymptotic bias is determined both for estimates based on the method of moments and for maximum likelihood estimates. The asymptotic bias from omitting covariates is shown to be zero if the regression of the response variable on treatment and covariates is linear or exponential, and, in regular cases, this is a necessary condition for zero bias. Many commonly used models do have such exponential regressions; thus randomization ensures unbiased treatment estimates in a large number of important nonlinear models. For moderately censored exponential survival data, analysis with the exponential survival model yields less biased estimates of treatment effect than analysis with the proportional hazards model of Cox, if needed covariates are omitted. Simulations confirm that calculations of asymptotic bias are in excellent agreement with the bias observed in experiments of modest size.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Nelder, J. A., & Wedderburn, R. W. M. (1972) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344614 · Cited by 7,194
Nonparametrics: Statistical Methods Based on Ranks
Mergenthaler, M. J., & Lehmann, E. L. (1979) · Technometrics · doi:10.2307/1268531 · Cited by 3,329
Plackett, R. L., & Cox, D. R. (1971) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344247 · Cited by 2,264
The Analysis of Cross-Classified Categorical Data
Drane, J. W. (1979) · Technometrics · doi:10.1080/00401706.1979.10489789 · Cited by 1,941
(1958) · Medical Entomology and Zoology · Cited by 1,059
Forcing a sequential experiment to be balanced
EFRON, B. (1971) · Biometrika · doi:10.1093/biomet/58.3.403 · Cited by 873
The Analysis of Cross-Classified Categorical Data
Stuart, A., & Fienberg, S. E. (1980) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402421 · Cited by 591
Randomized Clinical Trials: Perspectives on Some Recent Ideas
Byar, D. P., Simon, R. M., Friedewald, W. T., Schlesselman, J. J., DeMets, D. L., Ellenberg, J. H., Gail, M. H., & Ware, J. H. (1976) · New England Journal of Medicine · doi:10.1056/nejm197607082950204 · Cited by 537
Self-citationA Large Sample Study of Cox's Regression Model
Tsiatis, A. A. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345335 · Cited by 476
Cited by
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
“However, when the outcome is either binary or time-to-event in nature and if the odds ratio or the hazard ratio is used as the measure of treatment effect, then, even in the absence of confounding, the marginal and conditional estimates of the treatment effect need not coincide ( Gail, Wieand, & Piantadosi, 1984 ; Gre…”
BackgroundApplied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
A Modified Poisson Regression Approach to Prospective Studies with Binary Data
Zou, G. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh090 · Cited by 9,615
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758
“When the outcome is continuous and a linear treatment effect is used, then the marginal and conditional treatment effects coincide [39].”
BackgroundMethodModels for Longitudinal Data: A Generalized Estimating Equation Approach
Zeger, S. L., Liang, K.-Y., & Albert, P. S. (1988) · Biometrics · doi:10.2307/2531734 · Cited by 4,505
Adjustment for total energy intake in epidemiologic studies
Willett, W., Howe, G., & Kushi, L. (1997) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/65.4.1220s · Cited by 3,758
Logistic Regression: Why We Cannot Do What We Think We Can Do, and What We Can Do About It
Mood, C. (2010) · European Sociological Review · doi:10.1093/esr/jcp006 · Cited by 3,158
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
The Robust Inference for the Cox Proportional Hazards Model
Lin, D. Y., & Wei, L. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478874 · Cited by 2,695
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336
Statistical Analysis of Correlated Data Using Generalized Estimating Equations: An Orientation
Hanley, J. A. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwf215 · Cited by 2,185
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.5984 · Cited by 1,422
Austin, P. C., Grootendorst, P., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2580 · Cited by 1,137
Comparing Logit and Probit Coefficients Across Groups
ALLISON, P. D. (1999) · Sociological Methods & Research · doi:10.1177/0049124199028002003 · Cited by 1,047
The performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
Meeker, D., Linder, J. A., Fox, C. R., Friedberg, M. W., Persell, S. D., Goldstein, N. J., Knight, T. K., Hay, J. W., & Doctor, J. N. (2016) · JAMA · doi:10.1001/jama.2016.0275 · Cited by 860
Cepeda, M. S. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg115 · Cited by 859
“Still, the average of individual odds ratios and the total cohort odds ratio approximate each other when the incidence of the disease is low, all subjects have low risks (11), and both odds ratios are the same when there is no association between the exposure and the outcome (14).”
BackgroundDuration Models: Specification, Identification and Multiple Durations
Van Den Berg, G. J. (2001) · Handbook of Econometrics · doi:10.1016/s1573-4412(01)05008-5 · Cited by 776
Multivariate Regression Analyses for Categorical Data
Liang, K.-Y., Zeger, S. L., & Qaqish, B. (1992) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1992.tb01862.x · Cited by 761
Assessing the sensitivity of regression results to unmeasured confounders in observational studies
Lin, D. Y., Psaty, B. M., & Kronmal, R. A. (1998) · Biometrics · doi:10.2307/2533848 · Cited by 742
Matched Sampling for Causal Effects
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725 · Cited by 676
Choice of time‐scale in Cox's model analysis of epidemiologic cohort data: a simulation study
Thiébaut, A. C. M., & Bénichou, J. (2004) · Statistics in Medicine · doi:10.1002/sim.2098 · Cited by 627
Neuhaus, J. M., Kalbfleisch, J. D., & Hauck, W. W. (1991) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403572 · Cited by 543
Testing for baseline balance in clinical trials
Senn, S. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131703 · Cited by 503
A Tutorial on Multilevel Survival Analysis: Methods, Models and Applications
Austin, P. C. (2017) · International Statistical Review · doi:10.1111/insr.12214 · Cited by 483
Interpreting and Understanding Logits, Probits, and Other Nonlinear Probability Models
Breen, R., Karlson, K. B., & Holm, A. (2018) · Annual Review of Sociology · doi:10.1146/annurev-soc-073117-041429 · Cited by 468
Frailty Models in Survival Analysis
Wienke, A. (2010) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420073911 · Cited by 454
Sturmer, T., Rothman, K. J., Avorn, J., & Glynn, R. J. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq198 · Cited by 446
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.540480 · Cited by 420
Making Americans healthier: social and economic policy as health policy
(2009) · Choice Reviews Online · doi:10.5860/choice.46-5680 · Cited by 409
Dealing With Missing Outcome Data in Randomized Trials and Observational Studies
Groenwold, R. H. H., Donders, A. R. T., Roes, K. C. B., Harrell, F. E., & Moons, K. G. M. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kwr302 · Cited by 398
Misspecified proportional hazard models
STRUTHERS, C. A., & KALBFLEISCH, J. D. (1986) · Biometrika · doi:10.1093/biomet/73.2.363 · Cited by 398
Estimating Exposure Effects by Modelling the Expectation of Exposure Conditional on Confounders
Robins, J. M., Mark, S. D., & Newey, W. K. (1992) · Biometrics · doi:10.2307/2532304 · Cited by 391
Confounding in Health Research
Greenland, S., & Morgenstern, H. (2001) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.22.1.189 · Cited by 388
Methods for Estimating Adjusted Risk Ratios
Cummings, P. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900201 · Cited by 324
The Use of Resampling Methods to Simplify Regression Models in Medical Statistics
Sauerbrei, W. (1999) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00155 · Cited by 310
Log Odds and the Interpretation of Logit Models
Norton, E. C., & Dowd, B. E. (2018) · Health Services Research · doi:10.1111/1475-6773.12712 · Cited by 273
Pirracchio, R., Resche-Rigon, M., & Chevret, S. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-70 · Cited by 263
Hernández, A. V., Steyerberg, E. W., & Habbema, J. D. F. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.09.014 · Cited by 258
The concept of residual confounding in regression models and some applications
Becher, H. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111308 · Cited by 168
Tests for no treatment effect in randomized clinical trials
GAIL, M. H., TAN, W. Y., & PIANTADOSI, S. (1988) · Biometrika · doi:10.1093/biomet/75.1.57 · Cited by 143
Self-citationArbogast, P. G., & Ray, W. A. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr143 · Cited by 138
Controversies concerning randomization and additivity in clinical trials.
Senn, S. (2004) · Statistics in Medicine · doi:10.1002/sim.2074 · Cited by 132
A review of causal estimation of effects in mediation analyses
Ten Have, T. R., & Joffe, M. M. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210391076 · Cited by 103
Rubin, D. B. (2010) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2009.08.024 · Cited by 88
A comparison of methods to adjust for continuous covariates in the analysis of randomised trials
Kahan, B. C., Rushton, H., Morris, T. P., & Daniel, R. M. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0141-3 · Cited by 74
Hernández, A. V., Eijkemans, M. J. C., & Steyerberg, E. W. (2006) · Annals of Epidemiology · doi:10.1016/j.annepidem.2005.09.007 · Cited by 65
Linear and Non-Linear Regression Methods in Epidemiology and Biostatistics
Vittinghoff, E., McCulloch, C. E., Glidden, D. V., & Shiboski, S. C. (2011) · Essential Statistical Methods for Medical Statistics · doi:10.1016/b978-0-444-53737-9.50006-2 · Cited by 6
Metadata
- Authors
- GAIL, M. H., WIEAND, S., & PIANTADOSI, S.
- Venue
- Biometrika
- Publisher
- Oxford University Press (OUP)
- Published
- 1984
- Volume
- 71
- Issue
- 3
- Pages
- 431-444
- ISSN
- 0006-3444 (ISSN-L)
- 1464-3510
- OpenAlex
- W2006623746
- Cited by
- 698
- References
- 12
- FWCI
- 3.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.