Some Methods of Propensity‐Score Matching had Superior Performance to Others: Results of an Empirical Investigation and Monte Carlo simulations
The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Propensity‐score matching is increasingly being used to reduce the impact of treatment‐selection bias when estimating causal treatment effects using observational data. Several propensity‐score matching methods are currently employed in the medical literature: matching on the logit of the propensity score using calipers of width either 0.2 or 0.6 of the standard deviation of the logit of the propensity score; matching on the propensity score using calipers of 0.005, 0.01, 0.02, 0.03, and 0.1; and 5 → 1 digit matching on the propensity score. We conducted empirical investigations and Monte Carlo simulations to investigate the relative performance of these competing methods. Using a large sample of patients hospitalized with a heart attack and with exposure being receipt of a statin prescription at hospital discharge, we found that the 8 different methods produced propensity‐score matched samples in which qualitatively equivalent balance in measured baseline variables was achieved between treated and untreated subjects. Seven of the 8 propensity‐score matched samples resulted in qualitatively similar estimates of the reduction in mortality due to statin exposure. 5 → 1 digit matching resulted in a qualitatively different estimate of relative risk reduction compared to the other 7 methods. Using Monte Carlo simulations, we found that matching using calipers of width of 0.2 of the standard deviation of the logit of the propensity score and the use of calipers of width 0.02 and 0.03 tended to have superior performance for estimating treatment effects (© 2009 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, calliper matchings with widths of 0.2, 0.02 and 0.03 have been reported to have superior results [49], which prompted us to use this method.”
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
Self-citationAustin, P. C., Grootendorst, P., & Anderson, G. M. (2007) · Statistics in Medicine · doi:10.1002/sim.2580 · Cited by 1,137
Self-citationThe performance of different propensity score methods for estimating marginal hazard ratios
Austin, P. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5705 · Cited by 1,006
Self-citationControlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958
Reducing bias in a propensity score matched-pair sample using greedy matching techniques
Parsons, L. (2001) · Medical Entomology and Zoology · Cited by 733
Austin, P. C. (2007) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2007.07.021 · Cited by 589
Self-citation
Cited by
Items 301–400 of 795
Fröhlich, H., Henning, F., Täger, T., Schellberg, D., Grundtvig, M., Goode, K. M., Corletto, A., Kazmi, S., Hole, T., Katus, H. A., et al. (2017) · European Heart Journal - Cardiovascular Pharmacotherapy · doi:10.1093/ehjcvp/pvx013 · Cited by 21
Red blood cell transfusion in the resuscitation of septic patients with hematological malignancies
Mirouse, A., Resche‐Rigon, M., Lemiale, V., Mokart, D., Kouatchet, A., Mayaux, J., Vincent, F., Nyunga, M., Bruneel, F., Rabbat, A., et al. (2017) · Annals of Intensive Care · doi:10.1186/s13613-017-0292-3 · Cited by 21
“2 of the standard deviation of the logit of the propensity score [17].”
BackgroundWu, B., Bruns, E. J., Tai, M., Lee, B. R., Raghavan, R., & dosReis, S. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700357 · Cited by 22
“2 to preserve sample size without sacrificing performance (36,37).”
BackgroundGuo, L., Qu, P., Zhang, R., Zhao, D., Wang, H., Liu, R., Mi, B., Yan, H., & Dang, S. (2018) · Scientific Reports · doi:10.1038/s41598-018-23306-5 · Cited by 21
The RIETE Investigators, Mellado, M., Trujillo‐Santos, J., Bikdeli, B., Jiménez, D., Núñez, M. J., Ellis, M., Marchena, P. J., Vela, J. R., Clarà, A. B. I., et al. (2019) · Internal and Emergency Medicine · doi:10.1007/s11739-019-02077-5 · Cited by 21
Tang, Y., Zhang, X., Yang, C., Yang, L., Wang, H., & Zhang, X. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-183 · Cited by 23
“003 [28].”
Shen, M., Xiao, C., Sun, Y., Li, D., Wu, P., Jin, L., Wu, Q., Dian, Y., Meng, Y., Zeng, F., et al. (2023) · medRxiv · doi:10.1101/2023.01.23.23284899 · Cited by 21
“We used the SMDs to assess the balance of each baseline covariate between the groups before and after propensity-score matching, with an SMD greater than 0.1 indicating covariate imbalance 16,17 .”
InfluentialTinney, F. J., Ivanics, T., Stracke, J., Malinzak, L. E., Elsabbagh, A. M., McEvoy, T., Nagai, S., & Yoshida, A. (2022) · Transplantation Direct · doi:10.1097/txd.0000000000001320 · Cited by 20
Arraut, J., Thomas, J., Oakley, C. T., Barzideh, O. S., Rozell, J. C., & Schwarzkopf, R. M. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.02.007 · Cited by 20
Du, H., Hui, E. C. M., & Chen, L. (2023) · Cities · doi:10.1016/j.cities.2023.104643 · Cited by 20
Pereira, D. E., Momtaz, D., Gonuguntla, R. K., Mittal, M. M., Singh, A., Dave, D., & Hosseinzadeh, P. (2023) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000002957 · Cited by 20
“The value of this technique is well described [1, 3, 14].”
MethodIncretin‐based therapy and the risk of diabetic foot ulcers and related events
Werkman, N. C. C., Driessen, J. H. M., Klungel, O. H., Schaper, N. C., Souverein, P. C., Stehouwer, C. D. A., & Nielen, J. T. H. (2024) · Diabetes Obesity and Metabolism · doi:10.1111/dom.15721 · Cited by 20
Demystifying the “July Effect” in Plastic Surgery: A Multi-Institutional Study
Blough, J. T., Jordan, S. W., Oliveira, G. S. D., Vu, M. M., & Kim, J. Y. (2017) · Aesthetic Surgery Journal · doi:10.1093/asj/sjx099 · Cited by 20
Yamamoto, M., Tanaka, K., Masubuchi, S., Ishii, M., Hamamoto, H., Suzuki, S., Ueda, Y., Okuda, J., & Uchiyama, K. (2017) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2017.09.031 · Cited by 20
Luca, L. D., Zeymer, U., Claeys, M. J., Dörler, J., Erné, P., Matter, C. M., Radovanović, D., Weidinger, F. F., Lüscher, T. F., Jukema, J. W., et al. (2020) · European Heart Journal - Cardiovascular Pharmacotherapy · doi:10.1093/ehjcvp/pvaa002 · Cited by 21
“The balance in baseline characteristics between matched patients was assessed by standardized differences.(8) Odds ratio (OR) and 95% confidence interval (CI) of new P2Y12 receptor inhibitors group compared with clopidogrel group on in-hospital events was estimated using the conditional logistic regression model strat…”
MethodPreoperative Chemoradiation Versus Chemotherapy in Gastroesophageal Junction Adenocarcinoma
Zafar, S. N., Blum, M. A., Chiang, Y., Ajani, J. A., Estrella, J. S., Das, P., Minsky, B. D., Hofstetter, W. L., Mansfield, P., Badgwell, B. D., et al. (2020) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2020.03.024 · Cited by 20
Rodrigues, G., Oberije, C., Senan, S., Tsujino, K., Wiersma, T., Moreno, M., Kim, T. H., Marks, L. B., Rengan, R., Petris, L. D., et al. (2014) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2014.09.033 · Cited by 19
Maiolino, G., Lenzini, L., Pedon, L., Cesari, M., Seccia, T. M., Frigo, A. C., Rossitto, G., Caroccia, B., & Rossi, G. P. (2014) · Journal of Cardiovascular Medicine · doi:10.2459/jcm.0000000000000057 · Cited by 19
Spaniolas, K., Yang, J., Zhu, C., Maria, A., Bates, A. T., Docimo, S., Talamini, M. A., & Pryor, A. D. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000003332 · Cited by 19
“2 standard deviations of the logit of the estimated score.(28) The success of the propensity score matching was assessed by checking standardized differences between groups before and after matching.”
MethodMohammad, H. R., Judge, A., & Murray, D. W. (2022) · The Journal of Arthroplasty · doi:10.1016/j.arth.2022.08.004 · Cited by 19
Milk sales and dietary diversity among the Maasai
Loos, T. K., & Zeller, M. (2014) · Agricultural Economics · doi:10.1111/agec.12131 · Cited by 19
Open treatment of ankle fracture as inpatient increases risk of complication
Shen, M. S., Dodd, A. C., Lakomkin, N., Mousavi, I., Bulka, C. M., Jahangir, A. A., & Sethi, M. K. (2017) · Journal of Orthopaedics and Traumatology · doi:10.1007/s10195-017-0472-9 · Cited by 19
Association Between Fexofenadine Use During Pregnancy and Fetal Outcomes
Andersson, N. W., Torp-Pedersen, C. T., & Andersen, J. T. (2020) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2020.1316 · Cited by 19
One anastomosis gastric bypass versus Roux-en-Y gastric bypass: a 30-day follow-up review
Docimo, S., Yang, J., Zhang, X., Pryor, A. D., & Spaniolas, K. (2021) · Surgical Endoscopy · doi:10.1007/s00464-021-08309-0 · Cited by 19
Simcox, T., Singh, V., Oakley, C. T., Koenig, J. A., Schwarzkopf, R., & Rozell, J. C. (2022) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-21-00698 · Cited by 19
Wang, M., Huang, Y., Lai, J., Lee, C., Wang, P.-C., Pan, H.-Y., Lin, C., Liou, J., & Hsu, Y. (2022) · Diabetes Care · doi:10.2337/dc21-1779 · Cited by 21
Home visiting for first-time mothers and subsequent pregnancy spacing
Goyal, N. K., Folger, A. T., Hall, E. S., Greenberg, J. M., Ginkel, J. B. V., & Ammerman, R. T. (2016) · Journal of Perinatology · doi:10.1038/jp.2016.192 · Cited by 19
Callaghan, R. C., Halliday, M., Gatley, J. M., Sykes, J. R., Taylor, L., Benny, C., & Kish, S. J. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.03.030 · Cited by 20
Farag, E. S., Makarova, N., ARGALIOUS, M. Y., Cywiński, J. B., Benzel, E., Kalfas, I. H., & Sessler, D. I. (2019) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000003982 · Cited by 19
Treatment of first-time traumatic anterior shoulder dislocation: the UK TASH-D cohort study
Rees, J. L., Shah, A., Edwards, K., Sanchez-Santos, M. T., Robinson, D. E., Delmestri, A., Carr, A. J., Arden, N., Lamb, S. E., Rangan, A., et al. (2019) · Health Technology Assessment · doi:10.3310/hta23180 · Cited by 19
“013 No 62 (18) 17 (27) 765 (18) 174 (23) 58 (20) 16 (28) 642 (20) 117 (18) CCI score 0 330 (96) 60 (18) 3945 (92) 792 (20) –0.”
BackgroundInfluentialEvaluating a Key Instrumental Variable Assumption Using Randomization Tests
Branson, Z., & Keele, L. J. (2020) · American Journal of Epidemiology · doi:10.1093/aje/kwaa089 · Cited by 24
Mohammad, H. R., Judge, A., & Murray, D. W. (2021) · Acta Orthopaedica · doi:10.1080/17453674.2021.1956744 · Cited by 18
“Greedy matching without replacement was used given its superior performance for estimating treatment effects (Austin 2009a).”
MethodWang, X., Chen, R., Ge, L., Gu, Y., Zhang, L., Wang, L., Zhuang, C., & Wu, Q. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1076835 · Cited by 18
Ashkenazi, I., Thomas, J., Lawrence, K. W., Meftah, M., Rozell, J. C., & Schwarzkopf, R. M. (2024) · The Journal of Arthroplasty · doi:10.1016/j.arth.2024.02.066 · Cited by 18
Hong, W., Wu, Z., Li, L., Wang, B., & Li, X. (2024) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17793 · Cited by 19
“37,38 Women with a history of other hysteroscopic operations, with amen-orrhea/oligomenorrhea and with intrauterine adhesions indicated by ultrasound, but who had not received hystero-scopic surgery, were further excluded from the matched controls ( n = 43).”
Pavlik, M., & Michalski, G. M. (2025) · International Journal of Financial Studies · doi:10.3390/ijfs13020049 · Cited by 18
Desloratadine Use During Pregnancy and Risk of Adverse Fetal Outcomes: A Nationwide Cohort Study
Andersson, N. W., Poulsen, H. E., & Andersen, J. T. (2020) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2020.02.017 · Cited by 18
“02 on the propensity score scale).(22,23) Balance of covariates between matched groups was assessed by the standardized differences.”
MethodMaldonado, D. R., Diulus, S. C., Annin, S., Shapira, J., Rosinsky, P. J., Kyin, C., Lall, A. C., & Domb, B. G. (2021) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2021.03.034 · Cited by 18
Pathologic Findings on Hip Arthroscopy in High-Level Athletes Competing in Flexibility Sports
Saks, B. R., Monahan, P. F., Maldonado, D. R., Jimenez, A. E., Ankem, H. K., Sabetian, P. W., Lall, A. C., & Domb, B. G. (2022) · The American Journal of Sports Medicine · doi:10.1177/03635465221077002 · Cited by 19
“Patients who were outside the caliper (propensity range) were excluded from analysis.(4,5) The covariates were body mass index, age at time of surgery, sex, sports competition level, and labral treatment.”
BackgroundNg, M., El-Alawi, H., Toutant, D. B., Choi, E. H., Wright, N., Khanam, M., Paunovic, B. N., & Ko, J. H. (2022) · Neurotherapeutics · doi:10.1007/s13311-022-01317-5 · Cited by 18
Varas, J., Pérez‐Sáez, M. J., Ramos, R., Merello, J. I., de Francisco, Á. L. M., Luño, J., Praga, M., Aljama, P., Pascual, J., Optimizing Results in Dialysis (ORD) group, et al. (2018) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfy215 · Cited by 18
Katzman, J. L., Haider, M. A., Cardillo, C., Rozell, J. C., Schwarzkopf, R. M., & Lajam, C. M. (2025) · The Journal of Arthroplasty · doi:10.1016/j.arth.2025.02.042 · Cited by 19
RETRACTED: Robust policy evaluation from large-scale observational studies
Islam, M. S., Morshed, M. S., Young, G. J., & Noor‐E‐Alam, M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223360 · Cited by 20
“Over the years, researchers developed a wide array of algorithms to find such pairs, for example, Propensity Score matching [14], Mahalanobis Distance matching [14], Nearest Neighbour Greedy matching [28], Coarsed Exact Matching [29], and Genetic matching [30] are among the most popular algorithms.”
RetractedOutcomes of preoperative antiplatelet therapy in patients with acute type A aortic dissection
Jiang, X., Khan, F., Shi, E., Fan, R., Qian, X., Zhang, H., & Gu, T. (2021) · Journal of Cardiac Surgery · doi:10.1111/jocs.16080 · Cited by 17
“03 of the logit of the propensity score.(13) The sample remaining after PSM was 30 in the APT group and 80 in the non‐APT group.”
MethodMohammad, H. R., Judge, A., & Murray, D. W. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.11.039 · Cited by 17
Effectiveness of Long-Term Opioid Therapy for Chronic Low Back Pain
Licciardone, J. C., Rama, K., Nguyen, A., Prado, C. R., Stanteen, C., & Aryal, S. (2023) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2023.230140r1 · Cited by 19
Lagebrant, A., Lee, B. K., Youn, C. S., Sandroni, C., Bělohlávek, J., Cariou, A., Carrai, R., Dankiewicz, J., Friberg, H., Grejs, A. M., et al. (2025) · Resuscitation · doi:10.1016/j.resuscitation.2025.110747 · Cited by 17
Guo, Q., Xu, J., Shi, Q., & Du, B. (2021) · BMC Infectious Diseases · doi:10.1186/s12879-021-05964-5 · Cited by 17
Beyond correlation: Towards matching strategy for causal inference in Information Science
Dong, X., Xu, J., Bu, Y., Zhang, C., Ding, Y., Hu, B., & Ding, Y. (2021) · Journal of Information Science · doi:10.1177/0165551520979868 · Cited by 18
“The advantage is that such matching minimises the overall difference of the PSs in the matching samples and maximises the match for individuals in SG [53, 56, 57].”
BackgroundSimcox, T. G., Singh, V., Oakley, C. T., Barzideh, O. S., Schwarzkopf, R. M., & Rozell, J. C. (2022) · Knee Surgery and Related Research · doi:10.1186/s43019-022-00143-5 · Cited by 17
“This method of cohort matching has been established by previous literature as an optimal method for estimating differences between treatment groups [24].”
MethodSkjøth, F., Vadmann, H., Hjortshøj, S. P., Riahi, S., Lip, G. Y. H., & Larsen, T. B. (2018) · International Journal of Clinical Practice · doi:10.1111/ijcp.13258 · Cited by 17
Grove, E. L., Skjøth, F., Nielsen, P. B., Christensen, T. D., & Larsen, T. B. (2018) · Scientific Reports · doi:10.1038/s41598-018-33531-7 · Cited by 17
Matharu, G. S., Judge, A., Deere, K. C., Blom, A. W., Reed, M. R., & Whitehouse, M. R. (2019) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.19.00195 · Cited by 17
The Effect of Propensity Score Matching Method on the Quantity and Quality of Matches
Jacovidis, J., Foelber, K. J., & Horst, S. J. (2016) · The Journal of Experimental Education · doi:10.1080/00220973.2016.1250209 · Cited by 16
“Although the greedy algorithm does not minimize the overall distance between each matched pair (due to its sequential nature), it tends to perform as well as the stricter optimal matching algorithm (Austin, 2009, 2014; Gu & Rosenbaum, 1993).”
BackgroundMethodInfluentialOwens, J. S., Jimenez, A. E., Monahan, P. F., Maldonado, D. R., Kyin, C., Saks, B. R., Ankem, H. K., Sabetian, P. W., Lall, A. C., & Domb, B. G. (2021) · The American Journal of Sports Medicine · doi:10.1177/03635465211043491 · Cited by 16
“Previous studies have shown that the optimal method for group comparison is greedy matching without replacement.(3,8,9) The groups were matched according to age at the time of surgery, sex, BMI, Tönnis grade, followup time, and competition level.”
Methodvan Sloten, T. T., Souverein, P. C., Stehouwer, C. D. A., & Driessen, J. H. M. (2022) · Journal of Psychopharmacology · doi:10.1177/02698811221082470 · Cited by 16
“We used multivariable logistic regression to estimate the propensity score and matched 1:1 ACEI/ARB initiators to thiazide(-like) diuretic initiators using the nearest neighbor matching algorithm with a matching caliper of 0.02 on the propensity score scale (Austin, 2009).”
MethodInfluentialAnkem, H. K., Diulus, S. C., Kyin, C., Jimenez, A. E., Saks, B. R., Sabetian, P. W., Maldonado, D. R., Lall, A. C., & Domb, B. G. (2022) · The American Journal of Sports Medicine · doi:10.1177/03635465221108955 · Cited by 16
“As previously mentioned, propensity score matching was performed using R, consequently enhancing the study’s power while decreasing the potential influence of confounding variables.(4) All statistical analyses beyond propensity score matching were conducted using Excel (Microsoft) with the Real Statistics Add-in.”
MethodHuang, Y., Tian, C., & Ma, Y. (2023) · Journal of Data and Information Science · doi:10.2478/jdis-2023-0003 · Cited by 17
Vogl, M., Leidl, R., Plötz, W., & Gutacker, N. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0782-9 · Cited by 16
Röttger, J., Scheller‐Kreinsen, D., & Busse, R. (2012) · Value in Health · doi:10.1016/j.jval.2012.06.008 · Cited by 17
Böehm, K., Schiffmann, J., Tian, Z., Lesmana, H., Larcher, A., Mandel, P., Karakiewicz, P. I., Graefen, M., Schwarz, R., Krüll, A., et al. (2015) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2015.09.012 · Cited by 16
“Based on estimated propensity scores, 1 patient from the RP group was matched (nearest) to each patient of the HDR-BT group by caliper matching [17,18].”
MethodShaw, B. P. (2021) · Journal of Research in Music Education · doi:10.1177/00224294211006415 · Cited by 20
Mussa, E. C., Agegnehu, D., & Nshakira‐Rukundo, E. (2022) · SSM - Population Health · doi:10.1016/j.ssmph.2022.101030 · Cited by 16
“Covariate Balancing: We also checked the balance between covariates between insured and non-insured households using the recommended absolute standardised mean difference (ASMD) (in covariates) method (Austin, 2009) and ratio between variances (Ali et al., 2019; Rubin, 2001). Balanced covariates between treated and no…”
MethodInfluentialPeng, W., Han, J., Li, S., Zhang, L., Yang, C., Guo, J., & Cao, Y. (2022) · Journal of Human Lactation · doi:10.1177/08903344221078237 · Cited by 17
“03 caliper was performed to compare the short-term outcomes between the two groups (Austin, 2009).”
MethodInfluentialWong, C. K. H., Lau, K. T. K., Chung, M. S. H., Au, I. C. H., Cheung, K. W., Lau, E. H. Y., Daoud, Y., Cowling, B. J., & Leung, G. M. (2023) · Nature Medicine · doi:10.1038/s41591-023-02674-0 · Cited by 18
“27).”
How Do Propensity Score Methods Measure Up in the Presence of Measurement Error? A Monte Carlo Study
de Gil, P. R., Bellara, A. P., Lanehart, R. E., Lee, R. S., Kim, E., & Kromrey, J. D. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1022643 · Cited by 16
“…disciplines, methodological studies have examined the conditions under which different PSM are able to adequately estimate treatment effects (e.g. Austin, 2009; Austin, Grootendorst, Normand, & Anderson, 2007; Michalopolous, Bloom, & Hill, 2004; Rubin, 2001; Steiner, Cook, Shadish, & Clark,…”
BackgroundVieira, B. L., Lanier, S. T., Mlodinow, A. S., Bethke, K. P., Murphy, R. X., Hume, K. M., GUTOWSKI, K. A., Fine, N. A., & Kim, J. Y. S. (2014) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000000207 · Cited by 16
Ross, J. S., Bates, J., Parzynski, C. S., Akar, J. G., Curtis, J. P., Desai, N., Freeman, J. V., Gamble, G. M., Kuntz, R. E., Li, S., et al. (2017) · Medical Devices Evidence and Research · doi:10.2147/mder.s138158 · Cited by 16
“Patients were matched 1:1 within a fixed PS caliper of 0.05 using a “greedy” matching algorithm 27 that accounted for the date of implantation (within 30 days) and 13 patient characteristics (total of 18 covariates), all of which were identified prior to analyses based on clinical judgment and…”
InfluentialHumanistic and economic burden of fibromyalgia in Japan
Lee, L. K., Ebata, N., Hlavacek, P., DiBonaventura, M., Cappelleri, J. C., & Sadosky, A. (2016) · Journal of Pain Research · doi:10.2147/jpr.s110707 · Cited by 19
Gupta, P., & Rettiganti, M. R. (2015) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000000557 · Cited by 15
Berardinis, L. D., Senarighi, M., Farinelli, L., Qordja, F., Gallo, A., Spezia, M., & Gigante, A. P. (2023) · Journal of Orthopaedic Surgery and Research · doi:10.1186/s13018-023-04084-x · Cited by 15
“This type of matching, which is considered as an ideal method to assess differences between treatment groups was used to reduce the effect of potential confounding variables between DAA and PLA individuals [36].”
MethodWei, Y., Wu, T., Tong, D. K. H., Law, B. T. T., Leung, D. K. W., Lam, C. L. K., & Wong, C. K. H. (2020) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2020.04.050 · Cited by 15
de Botton, S., Brandwein, J. M., Wei, A. H., Pigneux, A., Quesnel, B., Thomas, X., Legrand, O., Récher, C., Chantepie, S., Hunault, M., et al. (2021) · Cancer Medicine · doi:10.1002/cam4.4182 · Cited by 17
Sun, Y., Luo, X., Yang, X., Zhu, X., Yang, C., Pan, T., Du, Y., Zhang, R., & Wang, D. (2021) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2021.110489 · Cited by 15
Chen, Y., Wei, M., Shen, S., Chen, S., Li, D., Wang, Y., Kuang, M., & Peng, Z. (2022) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2022.03.019 · Cited by 16
Shichman, I., Oakley, C. T., Konopka, J. A., Ashkenazi, I., Rozell, J. C., & Schwarzkopf, R. M. (2022) · The Journal of Arthroplasty · doi:10.1016/j.arth.2022.12.039 · Cited by 15
KASHANI, K. B., Thongprayoon, C., Cheungpasitporn, W., Iacovella, G. M., Akhoundi, A., & Albright, R. C. (2017) · PLoS ONE · doi:10.1371/journal.pone.0185064 · Cited by 15
Mohammad, H. R., Judge, A., & Murray, D. W. (2022) · Acta Orthopaedica · doi:10.2340/17453674.2022.2743 · Cited by 15
“11 2009 14,106 (5) 34 (1) 42 (1) 34 (1) 2010 22,414 (9) 81 (2) 97 (2) 81 (2) 2011 24,678 (9) 120 (2) 157 (3) 120 (3) 2012 24,922 (10) 213 (4) 209 (4) 213 (4) 2013 27,176 (11) 318 (7) 297 (6) 318 (6) 2014 29,682 (12) 517 (11) 442 (9) 517 (11) 2015 29,154 (11) 654 (13) 664 (14) 652 (13) 2016 29,896 (12) 940 (19) 872 (18…”
The use of valproic acid and multiple sclerosis
Nielsen, N. M., Svanström, H., Stenager, E., Magyari, M., Koch‐Henriksen, N., Pasternak, B., & Hviid, A. P. (2014) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3692 · Cited by 16
Optimal Matching Ratios in Drug Safety Surveillance
Wang, S. V., Schneeweiß, S., & Rassen, J. A. (2014) · Epidemiology · doi:10.1097/ede.0000000000000148 · Cited by 15
Reich, K. M., Gill, S. S., Eckenhoff, R. G., Berger, M., Austin, P. C., Rochon, P. A., Nguyen, P., Goodarzi, Z., & Seitz, D. P. (2024) · Journal of the American Geriatrics Society · doi:10.1111/jgs.18736 · Cited by 14
“33 After matching, imbalances between groups were evaluated using the standardized difference, with a standardized difference of 0.1 or less being taken as indicative of negligible imbalance between groups.”
MethodInfluentialSelf-citationLui, D. T. W., Xiong, X., Cheung, C., Lai, F. T. T., Li, X., Wan, E. Y. F., Chui, C. S. L., Chan, E. W., Cheng, F. W. T., Chung, M. S. H., et al. (2024) · Journal of Bone and Mineral Research · doi:10.1093/jbmr/zjae041 · Cited by 15
Domb, B. G., Owens, J. S., Lall, A. C., Harris, W. T., & Kuhns, B. D. (2024) · The American Journal of Sports Medicine · doi:10.1177/03635465241270291 · Cited by 14
Kumar, S. K., Durie, B. G. M., Nahi, H., Vij, R., Dimopoulos, M. A., Kastritis, E., Terpos, E., Leleu, X. P., Beksaç, M., Goldschmidt, H., et al. (2018) · Leukemia & lymphoma/Leukemia and lymphoma · doi:10.1080/10428194.2018.1459609 · Cited by 15
“Based on findings from a simulation study and recommendations that compared statistical approaches to implementation of matching algorithms [12], the primary analysis used a local/greedy caliper matching algorithm with a caliper width of 25% of the observed SD of the LTPS, sampling SOC patients without replacement fro…”
MethodMenich, B. E., Miano, T. A., Patel, G. P., & Hammond, D. A. (2019) · Annals of Pharmacotherapy · doi:10.1177/1060028019843664 · Cited by 16
Police Performance As Symbolic Politics? Public Recognition and the Value of Awards
Federman, P. S. (2019) · Public Performance & Management Review · doi:10.1080/15309576.2019.1676275 · Cited by 16
“…to analyzing small n data, it has also been shown to be relatively effective in mitigating some of those drawbacks, including when tested against difference-in-difference estimators (Austin, 2009a,b; Hajage, Tubach, Steg, Bhatt, & De Rycke, 2016; O’Neill, Kreif, Grieve, Sutton, & Sekhon, 2016)1.”
MethodMaldonado, D. R., Kyin, C., Shapira, J., Meghpara, M. B., Rosinsky, P. J., Lall, A. C., & Domb, B. G. (2021) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2021.04.037 · Cited by 14
Ording, A. G., Søgaard, M., Skjøth, F., Grove, E. L., Lip, G. Y. H., Larsen, T. B., & Nielsen, P. B. (2021) · Cancer Medicine · doi:10.1002/cam4.4012 · Cited by 16
Jimenez, A. E., Monahan, P. F., Maldonado, D. R., Saks, B. R., Ankem, H. K., Sabetian, P. W., Lall, A. C., & Domb, B. G. (2021) · The American Journal of Sports Medicine · doi:10.1177/03635465211041763 · Cited by 14
Hasegawa, H., Tsukada, Y., Wakabayashi, M., Nomura, S., Sasaki, T., Nishizawa, Y., Ikeda, K., Takeshita, N., Teramura, K., & Ito, M. (2022) · Techniques in Coloproctology · doi:10.1007/s10151-022-02631-y · Cited by 14
“20 of the standard deviation of the logit transformation of the estimated propensity score (EPS) was applied [35].”
MethodDual-mobility versus Fixed-bearing in Primary Total Hip Arthroplasty: Outcome Comparison
Singh, V., Loloi, J., Macaulay, W. B., Hepinstall, M. S., Schwarzkopf, R. M., & Aggarwal, V. K. (2022) · Hip & Pelvis · doi:10.5371/hp.2022.34.2.96 · Cited by 14
Owens, J. S., Lee, M. S., Jimenez, A. E., Maldonado, D. R., Lall, A. C., & Domb, B. G. (2022) · The American Journal of Sports Medicine · doi:10.1177/03635465221123060 · Cited by 15
“Previous studies have shown that the optimal method for group comparison is greedy matching without replacement.(2,5,6) The groups were matched according to age at the time of surgery, BMI, Tönnis grade, LCEA, competition level, and sport type.”
MethodAshkenazi, I., Thomas, J., Lawrence, K. W., Rozell, J. C., Lajam, C. M., & Schwarzkopf, R. M. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.02.065 · Cited by 14
Insani, W. N., Whittlesea, C., Ju, C., Man, K. K. C., Adesuyan, M., Chapman, S., & Wei, L. (2023) · British Journal of General Practice · doi:10.3399/bjgp.2023.0153 · Cited by 14
Outcomes following prolonged mechanical ventilation: Analysis of a countywide trauma registry
Rubano, J. A., Paccione, M. F., Rutigliano, D. N., Vosswinkel, J. A., McCormack, J. E., Huang, E. C., Yang, J., Shapiro, M. J., & Jawa, R. S. (2015) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000000515 · Cited by 19
“The optimal matching was on the logit of the PS using calipers ofwidth of 0.2 of the SDof the logit of the PS.14 Balance diagnostic was performed using the standardized differences among predictors between matched patients from RTC and ATCs.12 McNemar’s test was used to compare the mortality risk based on PS-matched p…”
MethodInfluentialMisraï, V., Kerever, S., Pasquie, M., Bordier, B., Guillotreau, J., Palasse, J., Guillotreau, V., Rijo, E., Vincendeau, S., Huet, R., et al. (2018) · World Journal of Urology · doi:10.1007/s00345-018-2532-z · Cited by 14
Yu, Y., Zhang, M., Shi, X., Caram, M. E. V., Little, R. J. A., & Mukherjee, B. (2021) · Statistics in Medicine · doi:10.1002/sim.8862 · Cited by 14
“The 95% CIs were calculated using: (1) bootstrapped standard errors from 200 bootstrap samples for OREG, IPW, AIPW, MW, AMW, OW, AOW, and CBPS-based MGPSS; (2) Wald-type CI based on original data for NAIVE; (3) Abadie and Imbens24,31 CI for MCOV and both GLMPS- and CBPS-based MGPSV; (4) Abadie and Imbens24,50 CI for G…”
MethodSieger, M. H. L., Becker, J., & Brook, J. (2021) · Child & Family Social Work · doi:10.1111/cfs.12836 · Cited by 14
“According to standards in the literature, balance is reflected in a post-match standardized percentage bias ( β ) below 25% and R (the variance ratio) above 0.5 and below 2.0 (Austin, 2009; Kainz et al., 2017).”
InfluentialZhou, Y., Wang, M., Wang, S., Li, N., Zhang, S., Tang, S., Shi, Q., Zhao, Y., Li, J., Zeng, Y., et al. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.727188 · Cited by 16
Primary care diabetes bundle management: 3-year outcomes for microvascular and macrovascular events.
Bloom, F. J., Yan, X. S., Stewart, W. F., Graf, T. R., Anderer, T., Davis, D. E., Pierdon, S. B., Pitcavage, J. M., & Steele, G. D. (2014) · PubMed · Cited by 15
Metadata
- Authors
- Austin, P. C.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Austin, Peter C.
- ORCID
- Austin, Peter C.
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2009-02
- Volume
- 51
- Issue
- 1
- Pages
- 171-184
- ISSN
- 0323-3847 (ISSN-L)
- 1521-4036
- OpenAlex
- W2016403661
- Cited by
- 769
- References
- 42
- Citations by year
- 2026: 29 · 2025: 50 · 2024: 54 · 2023: 61 · 2022: 78 · 2021: 72 · 2020: 62 · 2019: 48 · 2018: 53 · 2017: 42 · 2016: 48 · 2015: 34 · 2014: 40 · 2013: 33 · 2012: 35
- FWCI
- 18.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrical Journal (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- propensity score matching, treatment selection bias, observational data, statin exposure, myocardial infarction, mortality reduction, method comparison
- MeSH terms
- Algorithms, Biometry, Canada, Data Interpretation, Statistical, Humans, Monte Carlo Method, Myocardial Infarction, Bias, Confounding Factors, Epidemiologic, Incidence, Survival Rate, Proportional Hazards Models, Survival Analysis, Hydroxymethylglutaryl-CoA Reductase Inhibitors, Prescriptions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.