The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
The performance of inverse probability of treatment weighting and full matching on the propensity score in the presence of model misspecification when estimating the effect of treatment on survival outcomes
Open accessAbstract
There is increasing interest in estimating the causal effects of treatments using observational data. Propensity-score matching methods are frequently used to adjust for differences in observed characteristics between treated and control individuals in observational studies. Survival or time-to-event outcomes occur frequently in the medical literature, but the use of propensity score methods in survival analysis has not been thoroughly investigated. This paper compares two approaches for estimating the Average Treatment Effect (ATE) on survival outcomes: Inverse Probability of Treatment Weighting (IPTW) and full matching. The performance of these methods was compared in an extensive set of simulations that varied the extent of confounding and the amount of misspecification of the propensity score model. We found that both IPTW and full matching resulted in estimation of marginal hazard ratios with negligible bias when the ATE was the target estimand and the treatment-selection process was weak to moderate. However, when the treatment-selection process was strong, both methods resulted in biased estimation of the true marginal hazard ratio, even when the propensity score model was correctly specified. When the propensity score model was correctly specified, bias tended to be lower for full matching than for IPTW. The reasons for these biases and for the differences between the two methods appeared to be due to some extreme weights generated for each method. Both methods tended to produce more extreme weights as the magnitude of the effects of covariates on treatment selection increased. Furthermore, more extreme weights were observed for IPTW than for full matching. However, the poorer performance of both methods in the presence of a strong treatment-selection process was mitigated by the use of IPTW with restriction and full matching with a caliper restriction when the propensity score model was correctly specified.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Self-citationMatching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Self-citationRosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
MatchIt : Nonparametric Preprocessing for Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i08 · Cited by 4,385 · cited 2×
“4-21).(21,22) Full matching with a caliper restriction was implemented using the fullmatch function from the optmatch package (version 0.”
BackgroundMethodSelf-citationMatching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,205
Self-citationAustin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949 · cited 1×
“This caliper width was selected as it was found to result in superior performance across a range of scenarios when using pair-matching.(32) Crump et al.”
MethodSelf-citationCausal Inference without Balance Checking: Coarsened Exact Matching
Iacus, S. M., King, G., & Porro, G. (2012) · Political Analysis · doi:10.1093/pan/mpr013 · Cited by 3,563
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
The Robust Inference for the Cox Proportional Hazards Model
Lin, D. Y., & Wei, L. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478874 · Cited by 2,695
(2007) · Cited by 1,428
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · cited 1×
“Different approaches have been proposed to address the presence of extreme weights, including the use of standardized weights, trimmed weights or truncated weights,(25,40) or the use of a non-parametric estimation procedure, such as random forests or generalized boosted models, for estimating the propensity score mode…”
MethodA critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
Self-citationCounterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146
Dealing with limited overlap in estimation of average treatment effects
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2009) · Biometrika · doi:10.1093/biomet/asn055 · Cited by 1,007
The performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
Self-citationRosenbaum, P. R. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478441 · Cited by 997
Improving propensity score weighting using machine learning
Lee, B. K., Lessler, J., & Stuart, E. A. (2010) · Statistics in Medicine · doi:10.1002/sim.3782 · Cited by 896
Self-citationGenerating survival times to simulate Cox proportional hazards models
Bender, R., Augustin, T., & Blettner, M. (2005) · Statistics in Medicine · doi:10.1002/sim.2059 · Cited by 889
Adjusted survival curves with inverse probability weights
Cole, S. R., & Hernán, M. A. (2004) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2003.10.004 · Cited by 814
Kang, J. D. Y., & Schafer, J. L. (2007) · Statistical Science · doi:10.1214/07-sts227 · Cited by 797
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702
Austin, P. C. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq224 · Cited by 673
Self-citationReader's guide to critical appraisal of cohort studies: 2. Assessing potential for confounding
Mamdani, M., Sykora, K., Li, P., Normand, S.-L. T., Streiner, D. L., Austin, P. C., Rochon, P. A., & Anderson, G. M. (2005) · BMJ · doi:10.1136/bmj.330.7497.960 · Cited by 646
Self-citationFull Matching in an Observational Study of Coaching for the SAT
Hansen, B. B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000647 · Cited by 605
Austin, P. C. (2007) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2007.07.021 · Cited by 589
Self-citationWeight Trimming and Propensity Score Weighting
Lee, B. K., Lessler, J., & Stuart, E. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018174 · Cited by 500
Self-citationA Characterization of Optimal Designs for Observational Studies
Rosenbaum, P. R. (1991) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1991.tb01848.x · Cited by 330
Evaluating uses of data mining techniques in propensity score estimation: a simulation study
Setoguchi, S., Schneeweiss, S., Brookhart, M. A., Glynn, R. J., & Cook, E. F. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1555 · Cited by 271
Model Selection, Confounder Control, and Marginal Structural Models: Review and New Applications
Joffe, M. M., Ten Have, T. R., Feldman, H. I., & Kimmel, S. E. (2004) · The American Statistician · doi:10.1198/000313004x5824 · Cited by 266
Substantial Gains in Bias Reduction from Matching with a Variable Number of Controls
Ming, K., & Rosenbaum, P. R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00118.x · Cited by 258
Austin, P. C., & Small, D. S. (2014) · Statistics in Medicine · doi:10.1002/sim.6276 · Cited by 258
Self-citationAustin, P. C., Grootendorst, P., Normand, S. T., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2618 · Cited by 230
Self-citationAustin, P. C., & Schuster, T. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280213519716 · Cited by 191
Self-citationAustin, P. C. (2008) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.108.790634 · Cited by 168
Self-citationAustin, P. C., Manca, A., Zwarenstein, M., Juurlink, D. N., & Stanbrook, M. B. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.002 · Cited by 159
Self-citationGayat, E., Resche‐Rigon, M., Mary, J., & Porcher, R. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.537 · Cited by 136
Optimal full matching for survival outcomes: a method that merits more widespread use
Austin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6602 · Cited by 126
Self-citationAustin, P. C. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.640600 · Cited by 66
Self-citationAustin, P. C., & Stafford, J. E. (2008) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610910801942430 · Cited by 30
Self-citationA Data-Generation Process for Data with Specified Risk Differences or Numbers Needed to Treat
Austin, P. C. (2010) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610910903528301 · Cited by 28
Self-citationSzafara, K. L., Kruse, R. L., Mehr, D. R., Ribbe, M. W., & van der Steen, J. T. (2011) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2011.03.004 · Cited by 25
Cited by
Brown, J. W. L., Coles, A., Horakova, D., Havrdova, E., Izquierdo, G., Prat, A., Girard, M., Duquette, P., Trojano, M., Lugaresi, A., et al. (2019) · JAMA · doi:10.1001/jama.2018.20588 · Cited by 546
Nguyen, T.-L., Collins, G. S., Spence, J., Daurès, J.-P., Devereaux, P. J., Landais, P., & Le Manach, Y. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0338-0 · Cited by 512
A flexible, interpretable framework for assessing sensitivity to unmeasured confounding
Dorie, V., Harada, M., Carnegie, N. B., & Hill, J. (2016) · Statistics in Medicine · doi:10.1002/sim.6973 · Cited by 104
Xie, Y., Bowe, B., Xian, H., Loux, T., McGill, J. B., & Al-Aly, Z. (2023) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(23)00171-7 · Cited by 104
Patel, N., Gaonkar, M., Pampana, A., Shetty, N. S., Vekariya, N., Li, P., Arora, G., & Arora, P. (2026) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2025.01.003 · Cited by 2
Metadata
- Authors
- Austin, P. C., & Stuart, E. A.
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2015-04-30
- Volume
- 26
- Issue
- 4
- Pages
- 1654-1670
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2035404753
- Cited by
- 316
- References
- 42
- FWCI
- 13.14
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.