Reporting of covariate selection and balance assessment in propensity score analysis is suboptimal: a systematic review
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758 · cited 1×
“Absolute standardized difference The absolute difference in means between the two treatment groups divided by an estimate of the common standard deviation of that variable in the two treatment groups, that is, the pooled standard deviation [17,23,36,37] Easy to calculate Non-parametric Clear interpretation Scale invar…”
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082 · cited 3×
“are derived, an intermediate step is using one of the four possible methods: matching, stratification or subclassification, covariate adjustment, and inverse probability of treatment weighting (IPTW) using the PS and checking the balance of covariate distribution between treatment groups using appropriate metric [2].”
MethodInfluentialA structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336
A comparison of 12 algorithms for matching on the propensity score
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.6004 · Cited by 1,085
Indications for propensity scores and review of their use in pharmacoepidemiology
Glynn, R. J., Schneeweiss, S., & Stürmer, T. (2006) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2006.pto_293.x · Cited by 541 · cited 1×
“Lack of well-established standards for conducting and reporting of PS analysis may contribute to inconsistent and poor execution and reporting of the PS analysis despite substantial advances in the PS methodology in the last few years [3,17,18,22,24,40,42].”
MethodShah, B. R., Laupacis, A., Hux, J. E., & Austin, P. C. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.016 · Cited by 493 · cited 1×
“Although the use of PS methods has shown a dramatic increase in the medical literature [8], previous literature reviews indicated that most authors do not adequately report information on the PSmodel development [9,10], the balance of covariates between the treatment groups in PS analysis [8,9,11,12], and those who re…”
MethodLunt, M. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt212 · Cited by 358
Cited by
Nguyen, T.-L., Collins, G. S., Spence, J., Daurès, J.-P., Devereaux, P. J., Landais, P., & Le Manach, Y. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0338-0 · Cited by 512
DeFond, M., Erkens, D. H., & Zhang, J. (2017) · Management Science · doi:10.1287/mnsc.2016.2528 · Cited by 405
Ali, M. S., Prieto-Alhambra, D., Lopes, L. C., Ramos, D., Bispo, N., Ichihara, M. Y., Pescarini, J. M., Williamson, E., Fiaccone, R. L., Barreto, M. L., et al. (2019) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.00973 · Cited by 200
Self-citationOlsen, S. J., Schirmer, H., Wilsgaard, T., Bønaa, K. H., & Hanssen, T. A. (2018) · European Journal of Preventive Cardiology · doi:10.1177/2047487318778088 · Cited by 72
Raifman, J., Larson, E., Barry, C. L., Siegel, M., Ulrich, M., Knopov, A., & Galea, S. (2020) · BMJ · doi:10.1136/bmj.m2436 · Cited by 37
Metadata
- Authors
- Ali, M. S., Groenwold, R. H. H., Belitser, S. V., Pestman, W. R., Hoes, A. W., Roes, K. C. B., Boer, A. D., & Klungel, O. H.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2015-02
- Volume
- 68
- Issue
- 2
- Pages
- 122-131
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2048576379
- Cited by
- 222
- References
- 14
- FWCI
- 2.60
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.