The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Targeted Maximum Likelihood Estimation for Causal Inference in Observational Studies
Abstract
Estimation of causal effects using observational data continues to grow in popularity in the epidemiologic literature. While many applications of causal effect estimation use propensity score methods or G-computation, targeted maximum likelihood estimation (TMLE) is a well-established alternative method with desirable statistical properties. TMLE is a doubly robust maximum-likelihood-based approach that includes a secondary "targeting" step that optimizes the bias-variance tradeoff for the target parameter. Under standard causal assumptions, estimates can be interpreted as causal effects. Because TMLE has not been as widely implemented in epidemiologic research, we aim to provide an accessible presentation of TMLE for applied researchers. We give step-by-step instructions for using TMLE to estimate the average treatment effect in the context of an observational study. We discuss conceptual similarities and differences between TMLE and 2 common estimation approaches (G-computation and inverse probability weighting) and present findings on their relative performance using simulated data. Our simulation study compares methods under parametric regression misspecification; our results highlight TMLE's property of double robustness. Additionally, we discuss best practices for TMLE implementation, particularly the use of ensembled machine learning algorithms. Our simulation study demonstrates all methods using super learning, highlighting that incorporation of machine learning may outperform parametric regression in observational data settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242 · cited 3×
“Propensity score methods first estimate the propensity score, which is then used to create comparable exposure groups via matching, weighting, or stratification (8, 10).”
MethodClassification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,742
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“outcome for an individual; we observe Y1 only for persons in the exposure group and Y0 only for those in the unexposed group (16, 17).”
BackgroundAustin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6607 · Cited by 4,495
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Robins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451
Rothman, K. J., Greenland, S., & Lash, T. L. (1998) · Cited by 2,096
van der Laan, M. J., Polley, E. C., & Hubbard, A. E. (2007) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1309 · Cited by 1,719
Lunceford, J. K., & Davidian, M. (2004) · Statistics in Medicine · doi:10.1002/sim.1903 · Cited by 1,674
Burgess, S., & Thompson, S. G. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu283 · Cited by 1,605
A tutorial on propensity score estimation for multiple treatments using generalized boosted models
McCaffrey, D. F., Griffin, B. A., Almirall, D., Slaughter, M. E., Ramchand, R., & Burgette, L. F. (2013) · Statistics in Medicine · doi:10.1002/sim.5753 · Cited by 1,450 · cited 1×
“(47, 48) proposed propensity score weighting methods using generalized boosted regression; Westreich et al.”
MethodRandomization Analysis of Experimental Data: The Fisher Randomization Test Comment
Rubin, D. B. (1980) · Journal of the American Statistical Association · doi:10.2307/2287653 · Cited by 1,368
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · cited 1×
“(47, 48) proposed propensity score weighting methods using generalized boosted regression; Westreich et al.”
MethodDoubly robust estimation of causal effects
Funk, M. J., Westreich, D., Wiesen, C., Stürmer, T., Brookhart, M. A., & Davidian, M. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq439 · Cited by 1,158
Estimating causal effects from epidemiological data
Hernán, M. A., & Robins, J. M. (2006) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2004.029496 · Cited by 1,028
Unified Methods for Censored Longitudinal Data and Causality
van der Laan, M. J., & Robins, J. M. (2003) · Springer Series in Statistics · doi:10.1007/978-0-387-21700-0 · Cited by 959
Burgess, S., Dudbridge, F., & Thompson, S. G. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv017 · Cited by 934
Misunderstandings Between Experimentalists and Observationalists about Causal Inference
Imai, K., King, G., & Stuart, E. A. (2008) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00527.x · Cited by 906
Targeted Learning: Causal Inference for Observational and Experimental Data
van der Laan, M. J., & Rose, S. (2011) · Springer Series in Statistics · doi:10.1007/978-1-4419-9782-1 · Cited by 864
Self-citationTargeted Maximum Likelihood Learning
van der Laan, M. J., & Rubin, D. (2006) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1043 · Cited by 823
Kang, J. D. Y., & Schafer, J. L. (2007) · Statistical Science · doi:10.1214/07-sts227 · Cited by 797
Identifiability, Exchangeability, and Epidemiological Confounding
GREENLAND, S., & ROBINS, J. M. (1986) · International Journal of Epidemiology · doi:10.1093/ije/15.3.413 · Cited by 686
Neural Networks: Methodology and Applications
Dreyfus, G. (2010) · doi:10.1007/3-540-28847-3 · Cited by 581
Diagnosing and responding to violations in the positivity assumption
Petersen, M. L., Porter, K. E., Gruber, S., Wang, Y., & van der Laan, M. J. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210386207 · Cited by 548
Snowden, J. M., Rose, S., & Mortimer, K. M. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq472 · Cited by 511
Self-citationWestreich, D., Lessler, J., & Funk, M. J. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.020 · Cited by 502
Statistics and Causal Inference: Comment: Which Ifs Have Causal Answers
Rubin, D. B. (1986) · Journal of the American Statistical Association · doi:10.2307/2289065 · Cited by 501
Weight Trimming and Propensity Score Weighting
Lee, B. K., Lessler, J., & Stuart, E. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018174 · Cited by 500
Kang, J., & Schafer, J. L. (2007) · Statistical Science · Cited by 389
Robins, J. M., Sued, M., Lei-Gomez, Q., Rotnitzky, A. G., Ciencias, F., & Naturales, E. (2010) · Cited by 346
Propensity Scores: An Introduction and Experimental Test
Luellen, J. K., Shadish, W. R., & Clark, M. H. (2005) · Evaluation Review · doi:10.1177/0193841x05275596 · Cited by 336
Robins, J., Sued, M., Lei-Gomez, Q., & Rotnitzky, A. (2007) · Statistical Science · doi:10.1214/07-sts227d · Cited by 313
On principles for modeling propensity scores in medical research
Rubin, D. B. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.968 · Cited by 287
Evaluating uses of data mining techniques in propensity score estimation: a simulation study
Setoguchi, S., Schneeweiss, S., Brookhart, M. A., Glynn, R. J., & Cook, E. F. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1555 · Cited by 271
tmle: An R Package for Targeted Maximum Likelihood Estimation
Gruber, S., & Laan, M. J. V. D. (2012) · Journal of Statistical Software · doi:10.18637/jss.v051.i13 · Cited by 211
Mortality Risk Score Prediction in an Elderly Population Using Machine Learning
Rose, S. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kws241 · Cited by 193
Self-citationImproving propensity score estimators’ robustness to model misspecification using super learner.
Pirracchio, R., Petersen, M. L., & van der Laan, M. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu253 · Cited by 186
Asymptotics of cross-validated risk estimation in estimator selection and performance assessment
Dudoit, S., & van der Laan, M. J. (2005) · Statistical Methodology · doi:10.1016/j.stamet.2005.02.003 · Cited by 168
Ahern, J., Hubbard, A., & Galea, S. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp015 · Cited by 164
Invited Commentary: G-Computation-Lost in Translation?
Vansteelandt, S., & Keiding, N. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq474 · Cited by 132
Hill, J., Weiss, C. C., & Zhai, F. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.570161 · Cited by 67
Naimi, A. I., Richardson, D. B., & Cole, S. R. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kwt215 · Cited by 52
VanderWeele, T. J., & Vansteelandt, S. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr334 · Cited by 49
Kreif, N., Gruber, S., Radice, R., Grieve, R., & Sekhon, J. S. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280214521341 · Cited by 45
Gruber, J. S., Arnold, B. F., Reygadas, F., Hubbard, A., & Colford, J. M. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu015 · Cited by 30
Cited by
Principles of confounder selection
VanderWeele, T. J. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00494-6 · Cited by 1,535
Supervised Machine Learning: A Brief Primer
Jiang, T., Gradus, J. L., & Rosellini, A. J. (2020) · Behavior Therapy · doi:10.1016/j.beth.2020.05.002 · Cited by 847
What is Machine Learning? A Primer for the Epidemiologist
Bi, Q., Goodman, K. E., Kaminsky, J., & Lessler, J. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz189 · Cited by 496
Causal inference and counterfactual prediction in machine learning for actionable healthcare
Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459
Outcome-Wide Longitudinal Designs for Causal Inference: A New Template for Empirical Studies
VanderWeele, T. J., Mathur, M. B., & Chen, Y. (2020) · Statistical Science · doi:10.1214/19-sts728 · Cited by 310
Metadata
- Authors
- Schuler, M. S., & Rose, S.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-12-09
- Volume
- 185
- Issue
- 1
- Pages
- 65-73
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2560774707
- Cited by
- 399
- References
- 55
- FWCI
- 13.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.