The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Abstract
Propensity‐score methods are increasingly being used to reduce the impact of treatment‐selection bias in the estimation of treatment effects using observational data. Commonly used propensity‐score methods include covariate adjustment using the propensity score, stratification on the propensity score, and propensity‐score matching. Empirical and theoretical research has demonstrated that matching on the propensity score eliminates a greater proportion of baseline differences between treated and untreated subjects than does stratification on the propensity score. However, the analysis of propensity‐score‐matched samples requires statistical methods appropriate for matched‐pairs data. We critically evaluated 47 articles that were published between 1996 and 2003 in the medical literature and that employed propensity‐score matching. We found that only two of the articles reported the balance of baseline characteristics between treated and untreated subjects in the matched sample and used correct statistical methods to assess the degree of imbalance. Thirteen (28 per cent) of the articles explicitly used statistical methods appropriate for the analysis of matched data when estimating the treatment effect and its statistical significance. Common errors included using the log‐rank test to compare Kaplan–Meier survival curves in the matched sample, using Cox regression, logistic regression, chi‐squared tests, t‐tests, and Wilcoxon rank sum tests in the matched sample, thereby failing to account for the matched nature of the data. We provide guidelines for the analysis and reporting of studies that employ propensity‐score matching. Copyright © 2007 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Fish and Omega-3 Fatty Acid Intake and Risk of Coronary Heart Disease in Women
Hu, F. B. (2002) · JAMA · doi:10.1001/jama.287.14.1815 · Cited by 1,018
Exercise Type and Intensity in Relation to Coronary Heart Disease in Men
Tanasescu, M. (2002) · JAMA · doi:10.1001/jama.288.16.1994 · Cited by 928
Testing for baseline balance in clinical trials
Senn, S. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131703 · Cited by 503
Cited by
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Self-citationAustin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758
Self-citationRecent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Austin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6607 · Cited by 4,495
Self-citationAustin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Self-citationWang, X., & Cheng, Z. (2020) · CHEST · doi:10.1016/j.chest.2020.03.012 · Cited by 2,214
Why Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706
A comparison of 12 algorithms for matching on the propensity score
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.6004 · Cited by 1,085
Self-citationBalance diagnostics after propensity score matching
written on behalf of AME Big-Data Clinical Trial Collaborative Group, Zhang, Z., Kim, H. J., Lonjon, G., & Zhu, Y. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2018.12.10 · Cited by 1,031
Austin, P. C. (2009) · Biometrical Journal · doi:10.1002/bimj.200810488 · Cited by 769
Self-citationA Systematic Review of Propensity Score Methods in the Social Sciences
Thoemmes, F. J., & Kim, E. S. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.540475 · Cited by 577
Lunt, M. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt212 · Cited by 358
Johnson, M. L., Crown, W., Martin, B. C., Dormuth, C. R., & Siebert, U. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00602.x · Cited by 285
Xu, D., & Jaggars, S. S. (2011) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711413814 · Cited by 239
Impact of Cancer on Health-Related Quality of Life of Older Americans
Reeve, B. B., Potosky, A. L., Smith, A. W., Han, P. K., Hays, R. D., Davis, W. W., Arora, N. K., Haffer, S. C., & Clauser, S. B. (2009) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djp123 · Cited by 211
Dahabreh, I. J., Sheldrick, R. C., Paulus, J. K., Chung, M., Varvarigou, V., Jafri, H., Rassen, J. A., Trikalinos, T. A., & Kitsios, G. D. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs114 · Cited by 204
Ali, M. S., Prieto-Alhambra, D., Lopes, L. C., Ramos, D., Bispo, N., Ichihara, M. Y., Pescarini, J. M., Williamson, E., Fiaccone, R. L., Barreto, M. L., et al. (2019) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.00973 · Cited by 200
Relationship Between Antiepileptic Drugs and Suicide Attempts in Patients With Bipolar Disorder
Gibbons, R. D., Hur, K., Brown, C. H., & Mann, J. J. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.159 · Cited by 156
Dependent Stressful Life Events and Prior Depressive Episodes in the Prediction of Major Depression
Kendler, K. S., & Gardner, C. O. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.136 · Cited by 156
Allopurinol and Cardiovascular Outcomes in Adults With Hypertension
MacIsaac, R. L., Salatzki, J., Higgins, P., Walters, M. R., Padmanabhan, S., Dominiczak, A. F., Touyz, R. M., & Dawson, J. (2016) · Hypertension · doi:10.1161/hypertensionaha.115.06344 · Cited by 124
Use and cost of hospitalization in dementia: longitudinal results from a community-based study
Zhu, C. W., Cosentino, S., Ornstein, K., Gu, Y., Andrews, H., & Stern, Y. (2015) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4222 · Cited by 106
Clegg, L. E., Penland, R. C., Bachina, S., Boulton, D. W., Thuresson, M., Heerspink, H. J. L., Gustavson, S., Sjöström, C. D., Ruggles, J. A., Hernandez, A. F., et al. (2019) · Cardiovascular Diabetology · doi:10.1186/s12933-019-0942-x · Cited by 94
Schaffer, J. M., Singh, S. K., Joyce, D. L., Reitz, B. A., Robbins, R. C., Zamanian, R. T., & Mallidi, H. R. (2013) · Circulation · doi:10.1161/circulationaha.112.001080 · Cited by 69
Quantifying the Causal Effect of Individual Mobility on Health Status in Urban Space
Zhang, Y., Xu, F., Xia, T., & Li, Y. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494990 · Cited by 68
Hogan, M.-E., Taddio, A., Katz, J., Shah, V., & Krahn, M. (2017) · Pain · doi:10.1097/j.pain.0000000000000776 · Cited by 30
Fadini, G. P., Bonora, B. M., Ghiani, M., Anichini, R., Melchionda, E., Fattor, B., Fazion, S., Meregalli, G., Giaccari, A., Avogaro, A., et al. (2024) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.15554 · Cited by 27
Lin, C.-E., Chung, C.-H., Chen, L.-F., Chen, P.-C., Cheng, H.-Y., & Chien, W.-C. (2019) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1606-y · Cited by 18
McIntyre, R. S., Prieto, R., Schepman, P., Yeh, Y.-C., Boucher, M., Shelbaya, A., Chambers, R., Gao, X., & Pappadopulos, E. (2019) · Current Medical Research and Opinion · doi:10.1080/03007995.2019.1652053 · Cited by 15
Patient and caregiver outcomes and experiences with team-based memory care: A mixed methods study
Liu, T.-L., Yates, T. D., Taylor, Y. J., Rossman, W., Mangieri, D., Black, S., Stephens, C., Connor, C. D., & Skudlarska, B. (2021) · Journal of Applied Gerontology · doi:10.1177/0733464819888838 · Cited by 10
Lin, C., Chung, C., Chen, L., & Chien, W. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12497 · Cited by 7
Metadata
- Authors
- Austin, P. C.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2007-11-23
- Volume
- 27
- Issue
- 12
- Pages
- 2037-2049
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W1964475341
- Cited by
- 1,249
- References
- 4
- FWCI
- 27.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.