The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Propensity score matching with R: conventional methods and new features
Open accessAbstract
It is increasingly important to accurately and comprehensively estimate the effects of particular clinical treatments. Although randomization is the current gold standard, randomized controlled trials (RCTs) are often limited in practice due to ethical and cost issues. Observational studies have also attracted a great deal of attention as, quite often, large historical datasets are available for these kinds of studies. However, observational studies also have their drawbacks, mainly including the systematic differences in baseline covariates, which relate to outcomes between treatment and control groups that can potentially bias results. Propensity score methods, which are a series of balancing methods in these studies, have become increasingly popular by virtue of the two major advantages of dimension reduction and design separation. Within this approach, propensity score matching (PSM) has been empirically proven, with outstanding performances across observational datasets. While PSM tutorials are available in the literature, there is still room for improvement. Some PSM tutorials provide step-by-step guidance, but only one or two packages have been covered, thereby limiting their scope and practicality. Several articles and books have expounded upon propensity scores in detail, exploring statistical principles and theories; however, the lack of explanations on function usage in programming language has made it difficult for researchers to understand and follow these materials. To this end, this tutorial was developed with a six-step PSM framework, in which we summarize the recent updates and provide step-by-step guidance to the R programming language. This tutorial offers researchers with a broad survey of PSM, ranging from data preprocessing to estimations of propensity scores, and from matching to analyses. We also explain generalized propensity scoring for multiple or continuous treatments, as well as time-dependent PSM. Lastly, we discuss the advantages and disadvantages of propensity score methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
(2002) · Cited by 13,211
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
(2010) · Cited by 7,034
Sensitivity analysis in observational research: Introducing the E-value
VanderWeele, T. J., & Ding, P. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2607 · Cited by 6,350
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
MatchIt : Nonparametric Preprocessing for Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i08 · Cited by 4,385
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
The Book of Why: The New Science of Cause and Effect
Pearl, J., & Mackenzie, D. N. (2018) · Cited by 3,779
The Central Role of the Propensity Score in Observational Studies for Causal Effects
Rosenbaum, P. R., & Rubin, D. B. (1983) · Biometrika · doi:10.2307/2335942 · Cited by 3,261
Large sample properties of matching estimators for average treatment effects
Abadie, A., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00655.x · Cited by 2,908
Causal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336
Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173
(2009) · Cited by 1,811
The role of the propensity score in estimating dose-response functions
Imbens, G. (2000) · Biometrika · doi:10.1093/biomet/87.3.706 · Cited by 1,776
The Book of Why: The New Science of Cause and Effect
Goldberg, L. R. (2019) · Notices of the American Mathematical Society · doi:10.1090/noti1912 · Cited by 1,655
A tutorial on propensity score estimation for multiple treatments using generalized boosted models
McCaffrey, D. F., Griffin, B. A., Almirall, D., Slaughter, M. E., Ramchand, R., & Burgette, L. F. (2013) · Statistics in Medicine · doi:10.1002/sim.5753 · Cited by 1,450
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
MatchIt: Nonparametric Preprocessing for Parametric Causal Inference
Ho, D., Imai, K., King, G., Stuart, E., & Greifer, N. (2005) · CRAN: Contributed Packages · doi:10.32614/cran.package.matchit · Cited by 1,206
Austin, P. C., Grootendorst, P., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2580 · Cited by 1,137
Diamond, A., & Sekhon, J. S. (2013) · Review of Economics and Statistics · doi:10.1162/rest_a_00318 · Cited by 1,102
A comparison of 12 algorithms for matching on the propensity score
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.6004 · Cited by 1,085
The Propensity Score with Continuous Treatments
Hirano, K., & Imbens, G. W. (2004) · Wiley Series in Probability and Statistics · doi:10.1002/0470090456.ch7 · Cited by 1,064
Rubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047
Balance diagnostics after propensity score matching
written on behalf of AME Big-Data Clinical Trial Collaborative Group, Zhang, Z., Kim, H. J., Lonjon, G., & Zhu, Y. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2018.12.10 · Cited by 1,031
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958
Misunderstandings Between Experimentalists and Observationalists about Causal Inference
Imai, K., King, G., & Stuart, E. A. (2008) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00527.x · Cited by 906
Improving propensity score weighting using machine learning
Lee, B. K., Lessler, J., & Stuart, E. A. (2010) · Statistics in Medicine · doi:10.1002/sim.3782 · Cited by 896
Smoking and Lung Cancer: Recent Evidence and a Discussion of Some Questions
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.1.173 · Cited by 841
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831
Random forest missing data algorithms
Tang, F., & Ishwaran, H. (2017) · Statistical Analysis and Data Mining: The ASA Data Science Journal · doi:10.1002/sam.11348 · Cited by 777
Web Site and R Package for Computing E-values
Mathur, M. B., Ding, P., Riddell, C. A., & VanderWeele, T. J. (2018) · Epidemiology · doi:10.1097/ede.0000000000000864 · Cited by 761
Optimal Matching for Observational Studies
Rosenbaum, P. R. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478868 · Cited by 715
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702
Full Matching in an Observational Study of Coaching for the SAT
Hansen, B. B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000647 · Cited by 605
Sensitivity Analysis Without Assumptions
Ding, P., & VanderWeele, T. J. (2016) · Epidemiology · doi:10.1097/ede.0000000000000457 · Cited by 570
The Planning of Observational Studies of Human Populations
Cochran, W. G., & Chambers, S. P. (1965) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344179 · Cited by 564
Austin, P. C., & Mamdani, M. M. (2006) · Statistics in Medicine · doi:10.1002/sim.2328 · Cited by 560
Groenwold, R. H. H., White, I. R., Donders, A. R. T., Carpenter, J. R., Altman, D. G., & Moons, K. G. M. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110977 · Cited by 538
Bias Reduction Using Mahalanobis-Metric Matching
Rubin, D. B. (1980) · Biometrics · doi:10.2307/2529981 · Cited by 530
Average causal effects from nonrandomized studies: A practical guide and simulated example.
Schafer, J. L., & Kang, J. (2008) · Psychological Methods · doi:10.1037/a0014268 · Cited by 529
Westreich, D., Lessler, J., & Funk, M. J. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.020 · Cited by 502
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2_1 · Cited by 484
Austin, P. C. (2009) · Medical Decision Making · doi:10.1177/0272989x09341755 · Cited by 454
VanderWeele, T. J., & Arah, O. A. (2011) · Epidemiology · doi:10.1097/ede.0b013e3181f74493 · Cited by 452
The Comparative Safety of Analgesics in Older Adults With Arthritis
Solomon, D. H. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.391 · Cited by 416
Missing data imputation: focusing on single imputation.
Zhang, Z. (2016) · PubMed · doi:10.3978/j.issn.2305-5839.2015.12.38 · Cited by 410
Guidelines for reinforcement learning in healthcare
Gottesman, O., Johansson, F., Komorowski, M., Faisal, A., Sontag, D., Doshi-Velez, F., & Celi, L. A. (2019) · Nature Medicine · doi:10.1038/s41591-018-0310-5 · Cited by 395
Yao, X. I., Wang, X., Speicher, P. J., Hwang, E. S., Cheng, P., Harpole, D. H., Berry, M. F., Schrag, D., & Pang, H. H. (2017) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djw323 · Cited by 386
Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
(2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.030 · Cited by 340
Linear Network Optimization: Algorithms and Codes.
Wagner, D. K., & Bertsekas, D. P. (1993) · Mathematics of Computation · doi:10.2307/2153140 · Cited by 321
Austin, P. C. (2011) · Statistics in Medicine · doi:10.1002/sim.4200 · Cited by 315
The Role of the Propensity Score in Estimating Dose-Response Functions
Imbens, G. (1999) · National Bureau of Economic Research · doi:10.3386/t0237 · Cited by 290
On principles for modeling propensity scores in medical research
Rubin, D. B. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.968 · Cited by 287
Bia, M., & Mattei, A. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800303 · Cited by 285
Causal Diagrams for Empirical Research
Pearl, J. (1995) · Biometrika · doi:10.2307/2337329 · Cited by 283
A comparison of two methods of estimating propensity scores after multiple imputation
Mitra, R., & Reiter, J. P. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280212445945 · Cited by 282
A Review of Propensity-Score Methods and Their Use in Cardiovascular Research
Deb, S., Austin, P. C., Tu, J. V., Ko, D. T., Mazer, C. D., Kiss, A., & Fremes, S. E. (2016) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2015.05.015 · Cited by 275
Evaluating uses of data mining techniques in propensity score estimation: a simulation study
Setoguchi, S., Schneeweiss, S., Brookhart, M. A., Glynn, R. J., & Cook, E. F. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1555 · Cited by 271
Association of Tramadol With All-Cause Mortality Among Patients With Osteoarthritis
Zeng, C., Dubreuil, M., LaRochelle, M. R., Lu, N., Wei, J., Choi, H. K., Lei, G., & Zhang, Y. (2019) · JAMA · doi:10.1001/jama.2019.1347 · Cited by 256
Self-citationRegression calibration method for correcting measurement-error bias in nutritional epidemiology
Spiegelman, D., McDermott, A., & Rosner, B. (1997) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/65.4.1179s · Cited by 254
Propensity Score Matching with Time‐Dependent Covariates
Lu, B. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00356.x · Cited by 253
The Comparative Safety of Opioids for Nonmalignant Pain in Older Adults
Solomon, D. H. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.450 · Cited by 253
Leyrat, C., Seaman, S. R., White, I. R., Douglas, I., Smeeth, L., Kim, J., Resche-Rigon, M., Carpenter, J. R., & Williamson, E. J. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280217713032 · Cited by 249
Optimal Caliper Width for Propensity Score Matching of Three Treatment Groups: A Monte Carlo Study
Wang, Y., Cai, H., Li, C., Jiang, Z., Wang, L., Song, J., & Xia, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0081045 · Cited by 198
Liu, W., Kuramoto, S. J., & Stuart, E. A. (2013) · Prevention Science · doi:10.1007/s11121-012-0339-5 · Cited by 195
Propensity score method: a non-parametric technique to reduce model dependence
Zhang, Z. (2017) · Annals of Translational Medicine · doi:10.21037/atm.2016.08.57 · Cited by 192
Austin, P. C. (2009) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1146 · Cited by 186
A comparison of different methods to handle missing data in the context of propensity score analysis
Choi, J., Dekkers, O. M., & le Cessie, S. (2018) · European Journal of Epidemiology · doi:10.1007/s10654-018-0447-z · Cited by 179
Practical Propensity Score Methods Using R
Leite, W. (2017) · Sage eBooks · doi:10.4135/9781071802854 · Cited by 179
Matching by Propensity Score in Cohort Studies with Three Treatment Groups
Rassen, J. A., Shelat, A. A., Franklin, J. M., Glynn, R. J., Solomon, D. H., & Schneeweiss, S. (2013) · Epidemiology · doi:10.1097/ede.0b013e318289dedf · Cited by 177
A Step-by-Step Guide to Propensity Score Matching in R
Randolph, J., Falbe, K. N., Manuel, A. K., & Balloun, J. L. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/n3pv-tx27 · Cited by 166
Linear Network Optimization: Algorithms and Codes
Boffey, T. B., & Bertsekas, D. P. (1994) · Journal of the Operational Research Society · doi:10.1057/jors.1994.70 · Cited by 156
Why prefer double robust estimators in causal inference?
Neugebauer, R. S., & van der Laan, M. J. (2004) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2004.06.060 · Cited by 132
West, S. G., Cham, H., Thoemmes, F. J., Renneberg, B., Schulze, J., & Weiler, M. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036387 · Cited by 131
Effectiveness of sodium bicarbonate infusion on mortality in septic patients with metabolic acidosis
Zhang, Z., Zhu, C., Mo, L., & Hong, Y. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5379-2 · Cited by 118
Dual and simultaneous sensitivity analysis for matched pairs
Gastwirth, J. L. (1998) · Biometrika · doi:10.1093/biomet/85.4.907 · Cited by 116
Matching on Generalized Propensity Scores with Continuous Exposures
Wu, X., Mealli, F., Kioumourtzoglou, M., Dominici, F., & Braun, D. (2022) · Journal of the American Statistical Association · doi:10.1080/01621459.2022.2144737 · Cited by 107
Missing data imputation through the use of the random forest algorithm
Pantanowitz, A., & Marwala, T. (2009) · Advances in Intelligent and Soft Computing · doi:10.1007/978-3-642-03156-4_6 · Cited by 106
Using Super Learner Prediction Modeling to Improve High-dimensional Propensity Score Estimation
Wyss, R., Schneeweiß, S., van der Laan, M. J., Lendle, S., Ju, C., & Franklin, J. M. (2017) · Epidemiology · doi:10.1097/ede.0000000000000762 · Cited by 84
[Propensity score matching in SPSS].
Huang, F., Chunlin, D. U., Sun, M., Ning, B., Luo, Y., & Shengli, A. (2015) · PubMed · doi:10.3969/j.issn.1673-4254.2015.11.15 · Cited by 70
Zakrison, T. L., Austin, P. C., & McCredie, V. A. (2018) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-017-0786-6 · Cited by 69
Which covariates should be controlled in propensity score matching? Evidence from a simulation study
Nguyen, C. V. (2012) · Statistica Neerlandica · doi:10.1111/stan.12000 · Cited by 62
Advances in Computational Intelligence
Batyrshin, I., & Potosí, S. M. 2. S. L. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37798-3 · Cited by 56
Causal inference with a quantitative exposure
Zhang, Z., Zhou, J., Cao, W., & Zhang, J. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280212452333 · Cited by 45
Malla, L., Perera, R., McFadden, E. C., Ogero, M. O., Stepniewska, K., & English, M. (2017) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2017-0071 · Cited by 45
Lan, P., Wang, T., Li, H.-Y., Yan, R., Liao, W.-C., Yu, B.-W., Wang, Q., Lin, L., Pan, K.-H., Yu, Y., et al. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2019.10.79 · Cited by 41
Propensity Score Analysis in R: A Software Review
Keller, B., & Tipton, E. (2016) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998616631744 · Cited by 38
Propensity score analysis for time-dependent exposure
Zhang, Z., Li, X., Wu, X., Qiu, H., & Shi, H. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.01.33 · Cited by 33
Tein, J., Mazza, G. L., Gunn, H., Kim, H., Stuart, E. A., Sandler, I. N., & Wolchik, S. A. (2018) · Evaluation & the Health Professions · doi:10.1177/0163278718763499 · Cited by 26
de Vries, B. B. L. P., van Smeden, M., & Groenwold, R. H. H. (2018) · Epidemiologic Methods · doi:10.1515/em-2017-0020 · Cited by 10
Covariance adjustment on propensity parameters for continuous treatment in linear models
Yang, W. P., Joffe, M. M., Hennessy, S., & Feldman, H. I. (2014) · Statistics in Medicine · doi:10.1002/sim.6252 · Cited by 8
Cited by
Wine, L. D., Pribesh, S., Kimmel, S. C., Dickinson, G., & Church, A. P. (2023) · Library & Information Science Research · doi:10.1016/j.lisr.2023.101252 · Cited by 10
Metadata
- Authors
- Zhao, Q.-Y., Luo, J.-C., Su, Y., Zhang, Y.-J., Tu, G.-W., & Luo, Z.
- Venue
- Annals of Translational Medicine
- Publisher
- AME Publishing Company
- Published
- 2021-05
- Volume
- 9
- Issue
- 9
- Pages
- 812-812
- ISSN
- 2305-5839 (ISSN-L)
- 2305-5847
- OpenAlex
- W3126606011
- Cited by
- 291
- References
- 97
- FWCI
- 28.90
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.