The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
The use of propensity score methods with survival or time‐to‐event outcomes: reporting measures of effect similar to those used in randomized experiments
Open accessAbstract
Propensity score methods are increasingly being used to estimate causal treatment effects in observational studies. In medical and epidemiological studies, outcomes are frequently time‐to‐event in nature. Propensity‐score methods are often applied incorrectly when estimating the effect of treatment on time‐to‐event outcomes. This article describes how two different propensity score methods (matching and inverse probability of treatment weighting) can be used to estimate the measures of effect that are frequently reported in randomized controlled trials: (i) marginal survival curves, which describe survival in the population if all subjects were treated or if all subjects were untreated; and (ii) marginal hazard ratios. The use of these propensity score methods allows one to replicate the measures of effect that are commonly reported in randomized controlled trials with time‐to‐event outcomes: both absolute and relative reductions in the probability of an event occurring can be determined. We also provide guidance on variable selection for the propensity score model, highlight methods for assessing the balance of baseline covariates between treated and untreated subjects, and describe the implementation of a sensitivity analysis to assess the effect of unmeasured confounding variables on the estimated treatment effect when outcomes are time‐to‐event in nature. The methods in the paper are illustrated by estimating the effect of discharge statin prescribing on the risk of death in a sample of patients hospitalized with acute myocardial infarction. In this tutorial article, we describe and illustrate all the steps necessary to conduct a comprehensive analysis of the effect of treatment on time‐to‐event outcomes. © 2013 The authors. Statistics in Medicine published by John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Self-citationEstimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Harrell, F. E. (2001) · Springer Series in Statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,195
Modeling Survival Data: Extending the Cox Model
Therneau, T. M., & Grambsch, P. M. (2000) · Statistics for Biology and Health · doi:10.1007/978-1-4757-3294-8 · Cited by 8,674
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758
Self-citationMarginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Self-citationSurvival Analysis, Techniques for Censored and Truncated Data
Rao, M. B. (1998) · Technometrics · doi:10.1080/00401706.1998.10485206 · Cited by 3,617
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
The Robust Inference for the Cox Proportional Hazards Model
Lin, D. Y., & Wei, L. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478874 · Cited by 2,695
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
The number needed to treat: a clinically useful measure of treatment effect
Cook, R. J., & Sackett, D. L. (1995) · BMJ · doi:10.1136/bmj.310.6977.452 · Cited by 1,885
An Assessment of Clinically Useful Measures of the Consequences of Treatment
Laupacis, A., Sackett, D. L., & Roberts, R. S. (1988) · New England Journal of Medicine · doi:10.1056/nejm198806303182605 · Cited by 1,681
Lunceford, J. K., & Davidian, M. (2004) · Statistics in Medicine · doi:10.1002/sim.1903 · Cited by 1,674
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
Self-citationNormand, S.-L. T., Landrum, M. B., Guadagnoli, E., Ayanian, J. Z., Ryan, T. J., Cleary, P. D., & McNeil, B. J. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00321-8 · Cited by 1,235
Design of Observational Studies
Rosenbaum, P. R. (2010) · Springer Series in Statistics · doi:10.1007/978-1-4419-1213-8 · Cited by 1,150
Austin, P. C., Grootendorst, P., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2580 · Cited by 1,137
Self-citationRosenbaum, P. R., & Rubin, D. B. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01242.x · Cited by 1,124
Rubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027
The performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
Self-citationRosenbaum, P. R. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478441 · Cited by 997
Misunderstandings Between Experimentalists and Observationalists about Causal Inference
Imai, K., King, G., & Stuart, E. A. (2008) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00527.x · Cited by 906
Adjusted survival curves with inverse probability weights
Cole, S. R., & Hernán, M. A. (2004) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2003.10.004 · Cited by 814
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702 · cited 1×
“While one-to-one matching, in which pairs of treated and untreated subjects are formed, appears to be the most common approach to propensity score matching, other approaches are possible [26–28].”
BackgroundGAIL, M. H., WIEAND, S., & PIANTADOSI, S. (1984) · Biometrika · doi:10.1093/biomet/71.3.431 · Cited by 698
Klein, J. P., & Moeschberger, M. L. (1997) · Statistics for Biology and Health · doi:10.1007/978-1-4757-2728-9 · Cited by 685
Matched Sampling for Causal Effects
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725 · Cited by 676
Full Matching in an Observational Study of Coaching for the SAT
Hansen, B. B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000647 · Cited by 605
Austin, P. C. (2007) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2007.07.021 · Cited by 589
Self-citationAustin, P. C., & Mamdani, M. M. (2006) · Statistics in Medicine · doi:10.1002/sim.2328 · Cited by 560
Self-citationINTERPRETATION AND CHOICE OF EFFECT MEASURES IN EPIDEMIOLOGIC ANALYSES1
GREENLAND, S. (1987) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114593 · Cited by 543
Neuhaus, J. M., Kalbfleisch, J. D., & Hauck, W. W. (1991) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403572 · Cited by 543
Xie, J., & Liu, C. (2005) · Statistics in Medicine · doi:10.1002/sim.2174 · Cited by 510
Weight Trimming and Propensity Score Weighting
Lee, B. K., Lessler, J., & Stuart, E. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018174 · Cited by 500
Austin, P. C. (2009) · Medical Decision Making · doi:10.1177/0272989x09341755 · Cited by 454
Self-citationCovariate Balance in Simple, Stratified and Clustered Comparative Studies
Hansen, B. B., & Bowers, J. (2008) · Statistical Science · doi:10.1214/08-sts254 · Cited by 414
Lipid-Lowering Therapy With Statins in High-Risk Elderly Patients: The Treatment-Risk Paradox
Ko, D. T., Mamdani, M., & Alter, D. A. (2004) · JAMA · doi:10.1001/jama.291.15.1864 · Cited by 412
Austin, P. C. (2010) · Statistics in Medicine · doi:10.1002/sim.3854 · Cited by 356
Self-citationCONFOUNDING: ESSENCE AND DETECTION1
MIETTINEN, O. S., & COOK, E. F. (1981) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113225 · Cited by 349
Austin, P. C. (2011) · Statistics in Medicine · doi:10.1002/sim.4200 · Cited by 315
Self-citationOn principles for modeling propensity scores in medical research
Rubin, D. B. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.968 · Cited by 287
Model Selection, Confounder Control, and Marginal Structural Models: Review and New Applications
Joffe, M. M., Ten Have, T. R., Feldman, H. I., & Kimmel, S. E. (2004) · The American Statistician · doi:10.1198/000313004x5824 · Cited by 266
Tu, J. V., Donovan, L. R., Lee, D. S., Wang, J. T., Austin, P. C., Alter, D. A., & Ko, D. T. (2009) · JAMA · doi:10.1001/jama.2009.1731 · Cited by 258
Self-citationSubstantial Gains in Bias Reduction from Matching with a Variable Number of Controls
Ming, K., & Rosenbaum, P. R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00118.x · Cited by 258
Risk-Treatment Mismatch in the Pharmacotherapy of Heart Failure
Lee, D. S. (2005) · JAMA · doi:10.1001/jama.294.10.1240 · Cited by 257
Propensity Score Matching with Time‐Dependent Covariates
Lu, B. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00356.x · Cited by 253
Austin, P. C. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1673 · Cited by 238
Self-citationAustin, P. C., Grootendorst, P., Normand, S. T., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2618 · Cited by 230
Self-citation6. A Diagnostic Routine for the Detection of Consequential Heterogeneity of Causal Effects
Morgan, S. L., & Todd, J. J. (2008) · Sociological Methodology · doi:10.1111/j.1467-9531.2008.00204.x · Cited by 207
Austin, P. C. (2009) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1146 · Cited by 186
Self-citationAustin, P. C., Manca, A., Zwarenstein, M., Juurlink, D. N., & Stanbrook, M. B. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.002 · Cited by 159
Self-citationAustin, P. C. (2008) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.108.790634 · Cited by 153
Self-citationGayat, E., Resche‐Rigon, M., Mary, J., & Porcher, R. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.537 · Cited by 136
Basic statistics for clinicians: 1. Hypothesis testing.
Guyatt, G. H., Jaeschke, R., Heddle, N. M., Cook, D., Shannon, H. S., & Walter, S. D. (1995) · Europe PMC (PubMed Central) · Cited by 118
Basic statistics for clinicians: 3. Assessing the effects of treatment: measures of association.
Jaeschke, R., Guyatt, G. H., Shannon, H. S., Walter, S. D., Cook, D., & Heddle, N. M. (1995) · Europe PMC (PubMed Central) · Cited by 111
Austin, P. C., & Laupacis, A. (2011) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1285 · Cited by 101
Self-citationLinear Rank Tests in Survival Analysis
Harrington, D. T. (2005) · Encyclopedia of Biostatistics · doi:10.1002/0470011815.b2a11047 · Cited by 54
Rosenbaum, P. R. (2005) · Wiley eBooks · doi:10.1002/0470011815.b2a03101 · Cited by 25
Cited by
A comparison of 12 algorithms for matching on the propensity score
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.6004 · Cited by 1,085
Self-citationSurvival after Minimally Invasive Radical Hysterectomy for Early-Stage Cervical Cancer
Melamed, A., Margul, D. J., Chen, L., Keating, N. L., del Carmen, M. G., Yang, J., Seagle, B.-L. L., Alexander, A., Barber, E. L., Rice, L. W., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1804923 · Cited by 709
Austin, P. C. (2016) · Statistics in Medicine · doi:10.1002/sim.7084 · Cited by 542
Self-citationCoronary Atherosclerotic Precursors of Acute Coronary Syndromes
Chang, H.-J., Lin, F. Y., Lee, S.-E., Andreini, D., Bax, J., Cademartiri, F., Chinnaiyan, K., Chow, B. J. W., Conte, E., Cury, R. C., et al. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.02.079 · Cited by 494
Semaglutide vs Tirzepatide for Weight Loss in Adults With Overweight or Obesity
Rodriguez, P. J., Goodwin Cartwright, B. M., Gratzl, S., Brar, R., Baker, C., Gluckman, T. J., & Stucky, N. L. (2024) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2024.2525 · Cited by 334
Metadata
- Authors
- Austin, P. C.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2013-09-30
- Volume
- 33
- Issue
- 7
- Pages
- 1242-1258
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2144168223
- Cited by
- 1,422
- References
- 67
- FWCI
- 34.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.