Some Methods of Propensity‐Score Matching had Superior Performance to Others: Results of an Empirical Investigation and Monte Carlo simulations
The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Propensity‐score matching is increasingly being used to reduce the impact of treatment‐selection bias when estimating causal treatment effects using observational data. Several propensity‐score matching methods are currently employed in the medical literature: matching on the logit of the propensity score using calipers of width either 0.2 or 0.6 of the standard deviation of the logit of the propensity score; matching on the propensity score using calipers of 0.005, 0.01, 0.02, 0.03, and 0.1; and 5 → 1 digit matching on the propensity score. We conducted empirical investigations and Monte Carlo simulations to investigate the relative performance of these competing methods. Using a large sample of patients hospitalized with a heart attack and with exposure being receipt of a statin prescription at hospital discharge, we found that the 8 different methods produced propensity‐score matched samples in which qualitatively equivalent balance in measured baseline variables was achieved between treated and untreated subjects. Seven of the 8 propensity‐score matched samples resulted in qualitatively similar estimates of the reduction in mortality due to statin exposure. 5 → 1 digit matching resulted in a qualitatively different estimate of relative risk reduction compared to the other 7 methods. Using Monte Carlo simulations, we found that matching using calipers of width of 0.2 of the standard deviation of the logit of the propensity score and the use of calipers of width 0.02 and 0.03 tended to have superior performance for estimating treatment effects (© 2009 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, calliper matchings with widths of 0.2, 0.02 and 0.03 have been reported to have superior results [49], which prompted us to use this method.”
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
Self-citationAustin, P. C., Grootendorst, P., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2580 · Cited by 1,137
Self-citationThe performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
Self-citationControlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958
Reducing bias in a propensity score matched-pair sample using greedy matching techniques
Parsons, L. (2001) · Medical Entomology and Zoology · Cited by 733
Austin, P. C. (2007) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2007.07.021 · Cited by 589
Self-citation
Cited by
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758
“2 of the standard deviation of the logit of the propensity score [3, 17, 18].”
BackgroundSelf-citationAustin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
“10) [27].”
Self-citationWhy Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706
“Then, following the most common implementation of either PSM or MDM (see Austin 2009, p.173 and the content analysis below) we (greedily) match the first treated unit to the closest control; then, we match the second treated unit with the closest control unit that has not already been matched, and…”
MethodA comparison of 12 algorithms for matching on the propensity score
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.6004 · Cited by 1,085
“Although prior studies have compared the relative performance of different caliper widths when using nearest neighbor matching within specified caliper widths [10, 11], there is a paucity of research comparing different matching algorithms.”
ResultSelf-citationThe performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
“This approach was included as it has been found to perform well compared with other commonly used alternatives [34].”
MethodSelf-citationAustin, P. C. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq224 · Cited by 673
Self-citationNetwork-based approach to prediction and population-based validation of in silico drug repurposing
Cheng, F., Desai, R. J., Handy, D. E., Wang, R., Schneeweiss, S., Barabási, A.-L., & Loscalzo, J. (2018) · Nature Communications · doi:10.1038/s41467-018-05116-5 · Cited by 552
One‐to‐many propensity score matching in cohort studies
Rassen, J. A., Shelat, A. A., Myers, J., Glynn, R. J., Rothman, K. J., & Schneeweiss, S. (2012) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3263 · Cited by 510
Pham, T., Combes, A., Rozé, H., Chevret, S., Mercat, A., Roch, A., Mourvillier, B., Ara-Somohano, C., Bastien, O., Zogheib, E., et al. (2013) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201205-0815oc · Cited by 500
Austin, P. C. (2009) · Medical Decision Making · doi:10.1177/0272989x09341755 · Cited by 454
“001 Blood urea nitrogen, mmol/L 8 (6-12) 8 (6-12) 0.”
Self-citationLarsen, T. B., Skjøth, F., Nielsen, P. B., Kjældgaard, J. N., & Lip, G. Y. H. (2016) · BMJ · doi:10.1136/bmj.i3189 · Cited by 441
“18 Ordinary logistic regression was used to evaluate the association of baseline characteristics on treatment choice versus any of the alternatives.”
MethodIatrogenic Gastric Acid Suppression and the Risk of Nosocomial Clostridium difficile Infection
Howell, M. D. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.89 · Cited by 437
“10.(27,28) Only cases with 2 controls matched were included in the analysis.”
MethodUeda, P., Svanström, H., Melbye, M., Eliasson, B., Svensson, A.-M., Franzén, S., Gudbjörnsdottir, S., Hveem, K., Jonasson, C., & Pasternak, B. (2018) · BMJ · doi:10.1136/bmj.k4365 · Cited by 367
A Weighting Analogue to Pair Matching in Propensity Score Analysis
Li, L., & Greene, T. (2013) · ijb · doi:10.1515/ijb-2012-0030 · Cited by 350
Austin, P. C. (2010) · Statistics in Medicine · doi:10.1002/sim.3854 · Cited by 356
“While a wide variety of calipers have been used in the medical literature [12--14], there has been little research into the relative performance of different propensity-score matching methods [15].”
MethodSelf-citationNielsen, P. B., Skjøth, F., Søgaard, M., Kjældgaard, J. N., Lip, G. Y. H., & Larsen, T. B. (2017) · BMJ · doi:10.1136/bmj.j510 · Cited by 346
Johnson, S. B., Park, H. S., Gross, C. P., & Yu, J. B. (2018) · JAMA Oncology · doi:10.1001/jamaoncol.2018.2487 · Cited by 325
Dregan, A., Charlton, J., Chowienczyk, P., & Gulliford, M. C. (2014) · Circulation · doi:10.1161/circulationaha.114.009990 · Cited by 303
“Females, n (%) 2954 (52) 43 645 (51) 2457 (57) 4243 (56) 5969 (49) 18 747 (69) 6230 (83) 4295 (68) 213 972 (57)”
Stürmer, T., Wyss, R., Glynn, R. J., & Brookhart, M. A. (2014) · Journal of Internal Medicine · doi:10.1111/joim.12197 · Cited by 302
Wong, C. K. H., Au, I. C. H., Lau, K. T. K., Lau, E. H. Y., Cowling, B. J., & Leung, G. M. (2022) · The Lancet · doi:10.1016/s0140-6736(22)01586-0 · Cited by 299
Schlomm, T., Tennstedt, P., Huxhold, C., Steuber, T., Salomon, G., Michl, U., Heinzer, H., Hansen, J., Budäus, L., Steurer, S., et al. (2012) · European Urology · doi:10.1016/j.eururo.2012.04.057 · Cited by 285
Lalani, T. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.8203 · Cited by 284
Callaghan, R. C., Cunningham, J. K., Sykes, J., & Kish, S. J. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.06.013 · Cited by 272
Wong, C. K. H., Au, I. C. H., Lau, K. T. K., Lau, E. H. Y., Cowling, B. J., & Leung, G. M. (2022) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(22)00507-2 · Cited by 269
Pirracchio, R., Resche-Rigon, M., & Chevret, S. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-70 · Cited by 263
“Austin PC: Some methods of propensity-score matching had superior performance to others: results of an empirical investigation and Monte Carlo simulations.”
BackgroundMethodInfluentialAre propensity scores really superior to standard multivariable analysis?
Biondi-Zoccai, G., Romagnoli, E., Agostoni, P., Capodanno, D., Castagno, D., D'Ascenzo, F., Sangiorgi, G., & Modena, M. G. (2011) · Contemporary Clinical Trials · doi:10.1016/j.cct.2011.05.006 · Cited by 227
“in quintiles or deciles), generation of inverse probability of selection weights, or incorporation into straightforward regression models [14,31,34–36].”
Chen, J. W., Maldonado, D. R., Kowalski, B. L., Miecznikowski, K. B., Kyin, C., Gornbein, J. A., & Domb, B. G. (2022) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2021.06.037 · Cited by 193
Ondansetron in Pregnancy and Risk of Adverse Fetal Outcomes
Pasternak, B., Svanström, H., & Hviid, A. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1211035 · Cited by 208
Optimal Caliper Width for Propensity Score Matching of Three Treatment Groups: A Monte Carlo Study
Wang, Y., Cai, H., Li, C., Jiang, Z., Wang, L., Song, J., & Xia, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0081045 · Cited by 198
“Austin summarized eight caliper widths commonly employed in two treatment group scenario [10].”
MethodLau, W. C. Y., Chan, E. W., Cheung, C.-L., Sing, C. W., Man, K. K. C., Lip, G. Y. H., Siu, C.-W., Lam, J. K. Y., Lee, A. C. H., & Wong, I. C. K. (2017) · JAMA · doi:10.1001/jama.2017.1363 · Cited by 202
Propensity score matching and complex surveys
Austin, P. C., Jembere, N., & Chiu, M. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280216658920 · Cited by 181
“This method was selected because it was shown to have superior performance compared to NNM and optimal matching.(14,20) Subjects were matched on only the propensity score and not on stratum or cluster, as these identifiers are often not available to the analyst (e.”
BackgroundMethodSelf-citationMuriel, A., Jiménez, D., Aujesky, D., Bertoletti, L., Decousus, H., Laporte, S., Mismetti, P., Muñoz, F. J., Yusen, R., & Monreal, M. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2014.01.058 · Cited by 190
Helwani, M. A., Avidan, M. S., Ben Abdallah, A., Kaiser, D. J., Clohisy, J. C., Hall, B. L., & Kaiser, H. A. (2015) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.n.00612 · Cited by 181
Wahbi, K., Meune, C., Porcher, R., Bécane, H. M., Lazarus, A., Laforêt, P., Stojkovic, T., Béhin, A., Radvanyi-Hoffmann, H., Eymard, B., et al. (2012) · JAMA · doi:10.1001/jama.2012.346 · Cited by 180
“Athird analysisreliedonpropensityscorematching, which has been found to be one of the most appropriate means of limiting biases with propensity scores.(21) Because the number of patients who underwent the invasive strategy was 2-fold greater thanthenumberwhounderwentthenoninvasivestrategy,weapplieda2:1matchingalgorith…”
MethodChanges in hospital efficiency after privatization
Tiemann, O., & Schreyögg, J. (2012) · Health Care Management Science · doi:10.1007/s10729-012-9193-z · Cited by 169
Rassen, J. A., Glynn, R. J., Brookhart, M. A., & Schneeweiss, S. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr001 · Cited by 181
“This approach makes strong assumptions about the functional relation between propensity score and outcome, but in line with findings that the assumptions are likely to be more of a theoretical concern than a practical one, (39, 40) we observed results closer to the referent value in the smallest sizes of the non-SSRI…”
ResultStroke in Adults With Congenital Heart Disease: Incidence, Cumulative Risk, and Predictors
Lanz, J., Brophy, J. M., Therrien, J., Kaouache, M., Guo, L., & Marelli, A. J. (2015) · Circulation · doi:10.1161/circulationaha.115.011241 · Cited by 178
“2 SDs, the pair was dropped from the analysis.(27) Sensitivity analyses were conducted to assess the impact of excluding strokes, which occurred within 90 days of acute events (myocardial infarction, endocarditis, or high-risk surgery), on the results of the nested case–control and the propensity score–matched cohort.”
Matching by Propensity Score in Cohort Studies with Three Treatment Groups
Rassen, J. A., Shelat, A. A., Franklin, J. M., Glynn, R. J., Solomon, D. H., & Schneeweiss, S. (2013) · Epidemiology · doi:10.1097/ede.0b013e318289dedf · Cited by 177
Comparative Effectiveness of Matching Methods for Causal Inference
King, G., Nielsen, R. A., Coberley, C. R., Pope, J. E., & Wells, A. R. (2011) · Cited by 260
Using balance statistics to determine the optimal number of controls in matching studies
Linden, A., & Samuels, S. J. (2013) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12072 · Cited by 178
“Following the data generating process described by Austin [26], we created five continuous and five dichotomous covariates.”
BackgroundMethodThe Green Corporate Bond Issuance Premium
Caramichael, J., & Rapp, A. C. (2022) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2024.107126 · Cited by 204
Propensity Score Methods: Theory and Practice for Anesthesia Research
Schulte, P. J., & Mascha, E. J. (2018) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002920 · Cited by 179
Michl, U., Tennstedt, P., Feldmeier, L., Mandel, P., Oh, S. J., Ahyai, S., Budäus, L., Chun, F. K. H., Haese, A., Heinzer, H., et al. (2016) · European Urology · doi:10.1016/j.eururo.2015.07.037 · Cited by 164
“scores, onepatient from theNSorNNS groupwasmatched (bestmatch) to one patient of the secNNS group by caliper matching [10,11] and using nonrandom R package (R Project for Statistical Computing; www.”
MethodBias from self selection and loss to follow-up in prospective cohort studies
Biele, G., Gustavson, K., Czajkowski, N. O., Nilsen, R. M., Reichborn‐Kjennerud, T., Magnus, P. M., Stoltenberg, C., & Aase, H. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00550-1 · Cited by 172
“Typically, bias estimates are standardised by the standard deviation of the unbiased parameter estimate [28], which we here replaced with the standard deviation of the corrected (IPPW) estimate.”
MethodApplying Propensity Score Methods in Clinical Research in Neurology
Austin, P. C., Yu, A., Vyas, M. V., & Kapral, M. K. (2021) · Neurology · doi:10.1212/wnl.0000000000012777 · Cited by 165
“Readers are referred elsewhere for a discussion and examination of different matching algorithms.(8,9) An alternative to greedy matching is optimal matching, which forms matched pairs to minimize the total within-pair difference in the propensity score.”
BackgroundSelf-citationBeadle, B. M., Liao, K.-P. E., Elting, L. S., Buchholz, T. A., Ang, K. K., Garden, A. S., & Guadagnolo, B. A. (2014) · Cancer · doi:10.1002/cncr.28372 · Cited by 154
“2*standard deviation) and without replacement.(26) A frailty model accommodating random error for matched pairs was used to compare survival between those patients treated with IMRT and those treated with non-IMRT.”
MethodPropensity‐score matching with competing risks in survival analysis
Austin, P. C., & Fine, J. P. (2018) · Statistics in Medicine · doi:10.1002/sim.8008 · Cited by 159
Self-citationKumada, T., Toyoda, H., Tada, T., Kiriyama, S., Tanikawa, M., Hisanaga, Y., Kanamori, A., Niinomi, T., Yasuda, S., Andou, Y., et al. (2012) · Journal of Hepatology · doi:10.1016/j.jhep.2012.10.025 · Cited by 142
“We sought to match each patient who received NA therapy to a patient who did not receive NA therapy, having a propensity by using greedy 5–1 digit matching [20].”
MethodPropensity scores in intensive care and anaesthesiology literature: a systematic review
Gayat, É., Pirracchio, R., Resche‐Rigon, M., Mebazaa, A., Mary, J., & Porcher, R. (2010) · Intensive Care Medicine · doi:10.1007/s00134-010-1991-5 · Cited by 145
“The performance of different propensity score matching methods that are commonly employed in the medical literature have been compared recently [13].”
BackgroundMethodInfluentialGayat, E., Resche‐Rigon, M., Mary, J., & Porcher, R. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.537 · Cited by 136
“Many methods for matching PS have been used in the literature, and the most frequently used have been compared in a recent paper [12].”
MethodA miRNA-based diagnostic model predicts resectable lung cancer in humans with high accuracy
Asakura, K., Kadota, T., Matsuzaki, J., Yoshida, Y., Yamamoto, Y., Nakagawa, K., Takizawa, S., Aoki, Y., Nakamura, E., Miura, J., et al. (2020) · Communications Biology · doi:10.1038/s42003-020-0863-y · Cited by 136
Beyer, B., Schlomm, T., Tennstedt, P., Böehm, K., Adam, M., Schiffmann, J., Sauter, G., Wittmer, C., Steuber, T. P., Graefen, M., et al. (2013) · European Urology · doi:10.1016/j.eururo.2013.12.014 · Cited by 134
“Based on propensity scores, two patients from the NeuroSAFE group were matched to one patient from the non-NeuroSAFE group by caliper matching [6,7] using nonrandom methods via the R package (R Project for Statistical Computing, Vienna, Austria) [8].”
MethodLee, R., McCarthy, P. M., Wang, E. C., Vaduganathan, M., Kruse, J. T., Malaisrie, S. C., & McGee, E. C. (2012) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2012.02.006 · Cited by 134
“In an effort to assess whether the return to AF was a marker or cause of mortality, after 1 year, 77 patients successfully treatedwere propensitymatched (1:1) with 77 patients with unsuccessful treatment using the caliper matching method.(17,18)We again imposed a 0.”
MethodZhou, H., Taber, C. R., Arcona, S., & Li, Y. (2016) · Applied Health Economics and Health Policy · doi:10.1007/s40258-016-0249-y · Cited by 144
Keers, R., Coleman, J. R. I., Lester, K. J., Roberts, S., Breen, G., Thastum, M., Bögels, S., Schneider, S., Heiervang, E., Meiser-Stedman, R., et al. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000444023 · Cited by 127
“Indeed, a recent meta-analysis reported that individual CBT or group CBT were as effective as lower intensity self-help approaches [2].”
To use or not to use propensity score matching?
Wang, J. (2020) · Pharmaceutical Statistics · doi:10.1002/pst.2051 · Cited by 125
Shin, S. H., Kim, S. C., Song, K. B., Hwang, D. W., Lee, J. H., Lee, D., Lee, J. W., Jun, E., Park, K., & Lee, Y. J. (2014) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2014.10.014 · Cited by 128
Kim, S. C., Schneeweiß, S., Glynn, R. J., Doherty, M., Goldfine, A. B., & Solomon, D. H. (2014) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2014-205216 · Cited by 125
van Haren, F., Pham, T. O., Brochard, L. J., Bellani, G., Laffey, J. G., Dres, M., Fan, E., Goligher, E. C., Heunks, L. M. A., Lynch, J. M., et al. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003519 · Cited by 125
Cardiovascular Risk in Rheumatoid Arthritis: Comparing TNF-α Blockade with Nonbiologic DMARDs
Solomon, D. H., Curtis, J. R., Saag, K. G., Lii, J., Chen, L., Harrold, L. R., Herrinton, L. J., Graham, D. J., Kowal, M. K., Kuriya, B., et al. (2013) · The American Journal of Medicine · doi:10.1016/j.amjmed.2013.02.016 · Cited by 111
Mølgaard-Nielsen, D., Svanström, H., Melbye, M., Hviid, A., & Pasternak, B. (2016) · JAMA · doi:10.1001/jama.2015.17844 · Cited by 108
Transradial Versus Transfemoral Intervention for Acute Myocardial Infarction
Valgimigli, M., Saia, F., Guastaroba, P., Menozzi, A., Magnavacchi, P., Santarelli, A., Passerini, F., Sangiorgio, P., Manari, A., Tarantino, F. F., et al. (2012) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2011.08.018 · Cited by 107
“25 because this value has been shown to eliminate more than 90% of the bias in observed confounders (17).”
Andersen, N. N., Pasternak, B., Friis‐Møller, N., Andersson, M., & Jess, T. (2015) · BMJ · doi:10.1136/bmj.h2809 · Cited by 106
Pasternak, B., Wintzell, V., Melbye, M., Eliasson, B., Svensson, A., Franzén, S., Guðbjörnsdóttir, S., Hveem, K., Jonasson, C., Svanström, H., et al. (2020) · BMJ · doi:10.1136/bmj.m1186 · Cited by 113
Tran, K. L., Bell, C. M., Stall, N. M., TOMLINSON, G. A., McGeer, A., Morris, A. M., Gardam, M. A., & Abrams, H. B. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3862-4 · Cited by 112
“[29] [30] [31] With this approach, isolated patients are randomly ordered, and the first isolated patient is selected and matched to the control patient with the closest propensity score that is within the caliper.”
MethodMetoclopramide in Pregnancy and Risk of Major Congenital Malformations and Fetal Death
Pasternak, B., Svanström, H., Mølgaard‐Nielsen, D., Melbye, M., & Hviid, A. P. (2013) · JAMA · doi:10.1001/jama.2013.278343 · Cited by 103
Abdollah, F., Novara, G., Briganti, A., Scattoni, V., Raber, M., Roscigno, M., Suardi, N. R., Andrea Gallina, A., Artibani, W., Ficarra, V., et al. (2010) · Urology · doi:10.1016/j.urology.2010.08.048 · Cited by 109
Sills, E. O., de Sassi, C., Jagger, P., Lawlor, K., Miteva, D. A., Pattanayak, S. K., & Sunderlin, W. D. (2017) · Global Environmental Change · doi:10.1016/j.gloenvcha.2017.02.002 · Cited by 113
“We adopt Eq.1 from Austin (2009) and Abadie and Imbens (2011), where ~ indicates the mean and the subscripts i and c refer to intervention and control.”
BackgroundMethodInfluentialArpino, B., & Cannas, M. (2016) · Statistics in Medicine · doi:10.1002/sim.6880 · Cited by 121
“20 standard deviations of the estimated propensity score [32].”
BackgroundLemiale, V., Resche‐Rigon, M., Mokart, D., Pène, F., Argaud, L., Mayaux, J., Guitton, C., Rabbat, A., Girault, C., Kouatchet, A., et al. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000002085 · Cited by 97
“Then, two patients with identical propensity score value but in the two different treatment groups (HFNO vs standard oxygen) can be considered as comparable, and matching on the propensity score has been shown as one of the most efficient method for treatment effect assessment (16, 17).”
MethodAbdollah, F., Schmitges, J., Sun, M., Claudio Jeldres, A., Tian, Z., Briganti, A., Shariat, S. F., Perrotte, P., Montorsi, F., & Karakiewicz, P. I. (2012) · International Journal of Urology · doi:10.1111/j.1442-2042.2012.03052.x · Cited by 98
Acute Kidney Injury Induces Remote Cardiac Damage and Dysfunction Through the Galectin-3 Pathway
Prudhomme, M., Coutrot, M., Thibault, M., Boutin, L., Genest, M., Poirier, F., Launay, J., Kane, B., Kinugasa, S., Prakoura, N., et al. (2019) · JACC Basic to Translational Science · doi:10.1016/j.jacbts.2019.06.005 · Cited by 93
Rocha, R. V., Manlhiot, C., Feindel, C. M., Yau, T. M., Mueller, B., David, T. E., & Ouzounian, M. (2017) · Circulation · doi:10.1161/circulationaha.117.030525 · Cited by 94
Domb, B. G., Kyin, C., Rosinsky, P. J., Shapira, J., Yelton, M. J., Meghpara, M. B., Lall, A. C., & Maldonado, D. R. (2020) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2020.02.014 · Cited by 90
TRIVEDI, R. B., Beaver, K. A., Bouldin, E. D., Eugenio, E. C., Zeliadt, S. B., Nelson, K. M., Rosland, A.-M. M., Szarka, J. G., & Piette, J. D. (2013) · Chronic Illness · doi:10.1177/1742395313506947 · Cited by 89
Si, A., Li, J., Yang, Z., Xia, Y., Yang, T., Lei, Z., Cheng, Z., Pawlik, T. M., Lau, W. Y., & Shen, F. (2019) · Annals of Surgical Oncology · doi:10.1245/s10434-019-07260-8 · Cited by 88
Feldman, C. H., Marty, F. M., Winkelmayer, W. C., Guan, H., Franklin, J. M., Solomon, D. H., Costenbader, K. H., & Kim, S. C. (2016) · Arthritis & Rheumatology · doi:10.1002/art.39849 · Cited by 91
“025 on the propensity score at a fixed ratio of 1:1 for both the MMF versus AZA and MMF versus CYC comparisons (45,46).”
ResultAustin, P. C. (2018) · Statistics in Medicine · doi:10.1002/sim.7615 · Cited by 99
Self-citationWang, T. Y., Kaltenbach, L. A., Cannon, C. P., Fonarow, G. C., Choudhry, N. K., Henry, T. D., Cohen, D. J., Bhandary, D., Khan, N. D., Anstrom, K. J., et al. (2019) · JAMA · doi:10.1001/jama.2018.19791 · Cited by 89
Kim, S. C., Schneeweiß, S., Choudhry, N. K., Liu, J., Glynn, R. J., & Solomon, D. H. (2015) · The American Journal of Medicine · doi:10.1016/j.amjmed.2015.01.013 · Cited by 91
“025 on the PS at a fixed ratio of 1:1.(27,28) For the primary as-treated analysis, the follow-up time was calculated from a day after the index date to the first of any of the following events: XOI discontinuation for XOI initiators or XOI initiation for the untreated group, outcome occurrence, disenrollment, end of s…”
MethodReitz, K. M., Marroquin, O. C., Zenati, M. S., Kennedy, J. N., Korytkowski, M. T., Tzeng, E., Koscum, S., Newhouse, D., Garcia, R. M., Vates, J., et al. (2020) · JAMA Surgery · doi:10.1001/jamasurg.2020.0416 · Cited by 87
Austin, P. C., & Cafri, G. (2020) · Statistics in Medicine · doi:10.1002/sim.8502 · Cited by 89
Self-citationAssociation Between Proton Pump Inhibitor Use and Risk of Fracture in Children
Wang, Y.-H., Wintzell, V., Ludvigsson, J. F., Svanström, H., & Pasternak, B. (2020) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2020.0007 · Cited by 84
A Brief Guide to Decisions at Each Step of the Propensity Score Matching Process
Harris, H. D., & Horst, S. J. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/xar3-bj83 · Cited by 76
Prinja, S., Nimesh, R., Gupta, A., Bahuguna, P., Gupta, M., & Thakur, J. S. (2017) · Tropical Medicine & International Health · doi:10.1111/tmi.12895 · Cited by 81
“03 have been reported to have superior results [49], which prompted us to use this method.”
MethodYang, J. Y., Webster‐Clark, M., Lund, J. L., Sandler, R. S., Dellon, E. S., & Stürmer, T. (2019) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2019.04.236 · Cited by 84
Health systems: changes in hospital efficiency and profitability
Büchner, V. A., Hinz, V., & Schreyögg, J. (2014) · Health Care Management Science · doi:10.1007/s10729-014-9303-1 · Cited by 96
“Through simulation, Austin [54] identifies this caliper width as the most appropriate.”
MethodProtective effect of antirheumatic drugs on dementia in rheumatoid arthritis patients
Judge, A., Garriga, C., Arden, N., Lovestone, S., Prieto‐Alhambra, D., Cooper, C. C., & Edwards, C. J. (2017) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1016/j.trci.2017.10.002 · Cited by 80
“02–standard deviation caliper width [15].”
Propensity Score Methods for Bias Reduction in Observational Studies of Treatment Effect
Johnson, S. R., TOMLINSON, G. A., HAWKER, G. A., Granton, J. T., & Feldman, B. M. (2018) · Rheumatic Disease Clinics of North America · doi:10.1016/j.rdc.2018.01.002 · Cited by 84
Bergold, S., Wirthwein, L., & Steinmayr, R. (2020) · Gifted Child Quarterly · doi:10.1177/0016986220932533 · Cited by 85
“As recommended (e.g., Austin, 2009), the caliper width was set at c¼ .2 standard deviations of the logit of the propensity score.”
MethodAssociation Between Proton Pump Inhibitor Use and Risk of Asthma in Children
Wang, Y., Wintzell, V., Ludvigsson, J. F., Svanström, H., & Pasternak, B. (2021) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2020.5710 · Cited by 78
Smith, G. D., Pickles, T., Crook, J. M., Martin, A., Vigneault, É., Cury, F., Morris, J., Catton, C., Lukka, H. R., Warner, A., et al. (2015) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2014.11.018 · Cited by 79
Chan, B., Cadarette, S. M., Wodchis, W. P., Krahn, M. D., & Mittmann, N. (2018) · Journal of Spinal Cord Medicine · doi:10.1080/10790268.2018.1486622 · Cited by 76
Kendal, A. R., Prieto‐Alhambra, D., Arden, N., Carr, A. J., & Judge, A. (2013) · BMJ · doi:10.1136/bmj.f6549 · Cited by 76
Bottigliengo, D., Baldi, I., Lanera, C., Lorenzoni, G., Bejko, J., Bottio, T., Tarzia, V., Carrozzini, M., Gerosa, G., Berchialla, P., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01454-z · Cited by 85
Deng, G., Li, D., Sun, Y., Jin, L., Zhou, Q., Xiao, C., Wu, Q., Sun, H., Dian, Y., Zeng, F., et al. (2023) · Journal of Medical Virology · doi:10.1002/jmv.28756 · Cited by 75
“1 indicating covariate imbalance.(15) Hazard ratios (HRs) with 95% confidence intervaIs (CIs) for each outcome”
BackgroundJennings, W. G., Fridell, L. A., Lynch, M., Jetelina, K. K., & Reingle Gonzalez, J. M. (2017) · Deviant Behavior · doi:10.1080/01639625.2016.1248711 · Cited by 67
Svanström, H., Ueda, P., Melbye, M., Eliasson, B., Svensson, A.-M., Franzén, S., Gudbjörnsdottir, S., Hveem, K., Jonasson, C., & Pasternak, B. (2019) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(18)30320-6 · Cited by 71
Thrombolytic therapy and outcome of patients with an acute symptomatic pulmonary embolism
Riera-Mestre, A., Jiménez, D., Muriel, A., Lobo, J. L., Moores, L. K., Yusen, R. D., Casado, I., Nauffal, D., Oribe, M., & Monréal, M. (2012) · Journal of Thrombosis and Haemostasis · doi:10.1111/j.1538-7836.2012.04698.x · Cited by 74
A critical examination of “being Black” in the juvenile justice system.
Peck, J. H., & Jennings, W. G. (2016) · Law and Human Behavior · doi:10.1037/lhb0000180 · Cited by 78
Metadata
- Authors
- Austin, P. C.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Austin, Peter C.
- ORCID
- Austin, Peter C.
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2009-02
- Volume
- 51
- Issue
- 1
- Pages
- 171-184
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W2016403661
- Cited by
- 769
- References
- 42
- Citations by year
- 2026: 29 · 2025: 50 · 2024: 54 · 2023: 61 · 2022: 78 · 2021: 72 · 2020: 62 · 2019: 48 · 2018: 53 · 2017: 42 · 2016: 48 · 2015: 34 · 2014: 40 · 2013: 33 · 2012: 35
- FWCI
- 18.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrical Journal (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- propensity score matching, treatment selection bias, observational data, statin exposure, myocardial infarction, mortality reduction, method comparison
- MeSH terms
- Algorithms, Biometry, Canada, Data Interpretation, Statistical, Humans, Monte Carlo Method, Myocardial Infarction, Bias, Confounding Factors, Epidemiologic, Incidence, Survival Rate, Proportional Hazards Models, Survival Analysis, Hydroxymethylglutaryl-CoA Reductase Inhibitors, Prescriptions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.