Propensity Score Methods in Health Technology Assessment: Principles, Extended Applications, and Recent Advances
Open accessAbstract
Randomized clinical trials (RCT) are accepted as the gold-standard approaches to measure effects of intervention or treatment on outcomes. They are also the designs of choice for health technology assessment (HTA). Randomization ensures comparability, in both measured and unmeasured pretreatment characteristics, of individuals assigned to treatment and control or comparator. However, even adequately powered RCTs are not always feasible for several reasons such as cost, time, practical and ethical constraints, and limited generalizability. RCTs rely on data collected on selected, homogeneous population under highly controlled conditions; hence, they provide evidence on efficacy of interventions rather than on effectiveness. Alternatively, observational studies can provide evidence on the relative effectiveness or safety of a health technology compared to one or more alternatives when provided under the setting of routine health care practice. In observational studies, however, treatment assignment is a non-random process based on an individual's baseline characteristics; hence, treatment groups may not be comparable in their pretreatment characteristics. As a result, direct comparison of outcomes between treatment groups might lead to biased estimate of the treatment effect. Propensity score approaches have been used to achieve balance or comparability of treatment groups in terms of their measured pretreatment covariates thereby controlling for confounding bias in estimating treatment effects. Despite the popularity of propensity scores methods and recent important methodological advances, misunderstandings on their applications and limitations are all too common. In this article, we present a review of the propensity scores methods, extended applications, recent advances, and their strengths and limitations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Such approach has also been recommended for a more generalisable randomised trials where certain covariates exist by chance.
“Such approach has also been recommended for a more generalisable randomised trials where certain covariates exist by chance.52,53”
From Mindfulness-based interventions for psychological wellbeing and quality of life in men with prostate cancer: A systematic review and meta-analysis (2021) · cites this paper as [52]
The Variable Selection and Propensity Score Estimation section says propensity scores in randomized trials are known by design, apart from chance variations, and describes using propensity scores to balance measured covariates. It recommends estimating them for observational studies, however, not for making randomized trials more generalizable or addressing chance covariate imbalances in those trials. No page number is available in our copy. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · see citing works
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020 · see citing works
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242 · see citing works
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655 · see citing works
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299 · see citing works
Rosenbaum, P., & Rubin, D. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 6,854 · see citing works
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758 · see citing works
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581 · see citing works
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478 · see citing works
Propensity Score-Matching Methods for Nonexperimental Causal Studies
Dehejia, R., & Wahba, S. (2002) · The Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,777 · see citing works
Austin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6607 · Cited by 4,495 · see citing works
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.1080/00031305.1985.10479383 · Cited by 4,415 · see citing works
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,411 · see citing works
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230 · see citing works
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210 · see citing works
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072 · see citing works
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563 · see citing works
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. V. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 3,104 · see citing works
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082 · see citing works
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994 · see citing works
Constructing Inverse Probability Weights for Marginal Structural Models
Cole, S. R., & Hernan, M. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn164 · Cited by 2,796 · see citing works
Multiple Imputation After 18+ Years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.2307/2291635 · Cited by 2,686 · see citing works
Variable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336 · see citing works
Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228 · see citing works
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173 · see citing works
Peduzzi, P., Concato, J., Feinstein, A. R., & Holford, T. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00048-8 · Cited by 2,154 · see citing works
Hernán, M. Á., Brumback, B., & Robins, J. M. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00012 · Cited by 1,772 · see citing works
The role of the propensity score in estimating dose-response functions
Imbens, G. W. (2000) · Biometrika · doi:10.1093/biomet/87.3.706 · Cited by 1,747 · see citing works
Why Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706 · see citing works
Matching using estimated propensity scores: relating theory to practice.
Rubin, D., & Thomas, N. (1996) · Biometrics · doi:10.1017/cbo9780511810725.024 · Cited by 1,445 · see citing works
Covariate Balancing Propensity Score
Imai, K., & Ratkovic, M. (2013) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12027 · Cited by 1,330 · see citing works
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · see citing works
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2007) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249 · see citing works
Doubly robust estimation of causal effects
Funk, M. J., Westreich, D., Wiesen, C., Stürmer, T., Brookhart, M. A., & Davidian, M. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq439 · Cited by 1,158 · see citing works
Schneeweiss, S., Rassen, J. A., Glynn, R. J., Avorn, J., Mogun, H., & Brookhart, M. A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a663cc · Cited by 1,128 · see citing works
Invited commentary: propensity scores.
Joffe, M., & Rosenbaum, P. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010011 · Cited by 1,117 · see citing works
Matching Using Estimated Propensity Scores: Relating Theory to Practice
Rubin, D. B., & Thomas, N. (1996) · Biometrics · doi:10.2307/2533160 · Cited by 1,089 · see citing works
Rubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047 · see citing works
Hirano, K., & Imbens, G. W. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020371312283 · Cited by 1,039 · see citing works
Balancing Covariates via Propensity Score Weighting
Li, F., Morgan, K. L., & Zaslavsky, A. M. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1260466 · Cited by 1,033 · see citing works
Causal Inference With General Treatment Regimes
Imai, K., & van Dyk, D. V. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001187 · Cited by 1,022 · see citing works
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933 · cited 1× · see citing works
“…refers to a phenomenon in which, in the presence of a non-null treatment effect, the marginal (overall) treatment effect estimate is different from the conditional (stratum-specific) treatment effect estimate, even in the absence of confounding (Greenland et al., 1999; Austin, 2008b).”
ResultImproving propensity score weighting using machine learning
Lee, B. K., Lessler, J., & Stuart, E. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3782 · Cited by 888 · see citing works
Cepeda, M. S. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg115 · Cited by 859 · see citing works
Understanding controlled trials: Why are randomised controlled trials important?
Sibbald, B., & Roland, M. (1998) · BMJ · doi:10.1136/bmj.316.7126.201 · Cited by 807 · see citing works
Illustrating bias due to conditioning on a collider
Cole, S. R., Platt, R. W., Schisterman, E. F., Chu, H., Westreich, D., Richardson, D., & Poole, C. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp334 · Cited by 796 · see citing works
Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates
Rubin, D., & Thomas, N. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474233 · Cited by 796 · see citing works
Schneeweiß, S. (2006) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1200 · Cited by 731 · see citing works
Stürmer, T., Joshi, M., Glynn, R., Avorn, J., Rothman, K., & Schneeweiss, S. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.07.004 · Cited by 729 · see citing works
Full Matching in an Observational Study of Coaching for the SAT
Hansen, B. B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000647 · Cited by 648 · see citing works
Indications for propensity scores and review of their use in pharmacoepidemiology
Glynn, R. J., Schneeweiss, S., & Stürmer, T. (2006) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2006.pto_293.x · Cited by 541 · see citing works
Average causal effects from nonrandomized studies: A practical guide and simulated example.
Schafer, J. L., & Kang, J. (2008) · Psychological Methods · doi:10.1037/a0014268 · Cited by 529 · see citing works
Nguyen, T.-L., Collins, G. S., Spence, J., Daurès, J.-P., Devereaux, P. J., Landais, P., & Le Manach, Y. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0338-0 · Cited by 512 · see citing works
Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates
Thomas, N. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725.025 · Cited by 508 · see citing works
Weight Trimming and Propensity Score Weighting
Lee, B. K., Lessler, J., & Stuart, E. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018174 · Cited by 507 · see citing works
Westreich, D. J., Lessler, J., & Funk, M. J. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.020 · Cited by 505 · see citing works
Principles of multilevel modelling.
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.1.158 · Cited by 500 · see citing works
Shah, B. R., Laupacis, A., Hux, J. E., & Austin, P. C. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.016 · Cited by 493 · see citing works
Propensity Scores in Cardiovascular Research
D’Agostino, R. B. (2007) · Circulation · doi:10.1161/circulationaha.105.594952 · Cited by 451 · see citing works
Encyclopedia of Statistics in Behavioral Science
Guha, M. (2006) · Reference Reviews · doi:10.1108/09504120610664123 · Cited by 419 · see citing works
Multiple Imputation for Nonresponse in Surveys.
Kershaw, C. D., & Rubin, D. B. (1989) · Biometrics · doi:10.2307/2532070 · Cited by 392 · see citing works
Confounding in Health Research
Greenland, S., & Morgenstern, H. (2001) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.22.1.189 · Cited by 390 · see citing works
Multilevel modelling of medical data
Goldstein, H., Browne, W. J., & Rasbash, J. (2002) · Statistics in Medicine · doi:10.1002/sim.1264 · Cited by 388 · see citing works
The prognostic analogue of the propensity score
Hansen, B. B. (2008) · Biometrika · doi:10.1093/biomet/asn004 · Cited by 379 · see citing works
Eichler, H., Abadie, E., Breckenridge, A. M., Flamion, B., Gustafsson, L. L., Leufkens, H. G. M., Rowland, M., Schneider, C. K., & Bloechl‐Daum, B. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3501 · Cited by 378 · see citing works
What Is Real-World Data? A Review of Definitions Based on Literature and Stakeholder Interviews
Makady, A., de Boer, A., Hillege, H. L., et al. (2017) · Value in Health · doi:10.1016/j.jval.2017.03.008 · Cited by 375 · see citing works
Lunt, M. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt212 · Cited by 358 · see citing works
Causality and causal inference in epidemiology: the need for a pluralistic approach
Vandenbroucke, J. P., Broadbent, A., & Pearce, N. E. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyv341 · Cited by 328 · see citing works
Balancing Covariates via Propensity Score WeightingPreprint
Li, F., Lock, K., Alan, M., & Zaslavsky, M. (2014) · Cited by 313 · see citing works
On principles for modeling propensity scores in medical research
Rubin, D. B. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.968 · Cited by 288 · see citing works
Effects of Adjusting for Instrumental Variables on Bias and Precision of Effect Estimates
Myers, J. A., Rassen, J. A., Gagne, J. J., Huybrechts, K. F., Schneeweiß, S., Rothman, K. J., Joffe, M. M., & Glynn, R. J. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr364 · Cited by 286 · see citing works
Evaluating uses of data mining techniques in propensity score estimation: a simulation study
Setoguchi, S., Schneeweiß, S., Brookhart, M. A., Glynn, R. J., & Cook, E. F. (2008) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1555 · Cited by 273 · see citing works
Propensity score weighting with multilevel data
Li, F., Zaslavsky, A. M., & Landrum, M. B. (2013) · Statistics in Medicine · doi:10.1002/sim.5786 · Cited by 257 · see citing works
Stürmer, T., Schneeweiss, S., Avorn, J., & Glynn, R. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi192 · Cited by 254 · see citing works
Leyrat, C., Seaman, S. R., White, I. R., Douglas, I., Smeeth, L. L., Kim, J., Resche‐Rigon, M., Carpenter, J. R., & Williamson, E. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280217713032 · Cited by 254 · see citing works
Self-citationQuasi-experimental study designs series—paper 4: uses and value
Bärnighausen, T., Tugwell, P., Røttingen, J., Shemilt, I., Rockers, P. C., Geldsetzer, P., Lavis, J. N., Grimshaw, J., Daniels, K., Brown, A. N., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.03.012 · Cited by 243 · see citing works
Self-citationAli, M. S., Groenwold, R. H. H., Belitser, S. V., Pestman, W. R., Hoes, A. W., Roes, K. C. B., de Boer, A., & Klungel, O. H. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.011 · Cited by 222 · see citing works
Self-citationThe performance of different propensity-score methods for estimating relative risks
Austin, P. C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.011 · Cited by 214 · see citing works
Invited commentary: understanding bias amplification.
Pearl, J. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr352 · Cited by 197 · see citing works
Schneeweiß, S., Gagne, J. J., Glynn, R. J., Rühl, M., & Rassen, J. A. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.235 · Cited by 193 · see citing works
Missing Data and Multiple Imputation
Cummings, P. (2013) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2013.1329 · Cited by 189 · see citing works
Sensitivity Analysis in Observational Studies
Rosenbaum, P. R. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa606 · Cited by 185 · see citing works
Using balance statistics to determine the optimal number of controls in matching studies
Linden, A., & Samuels, S. J. (2013) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12072 · Cited by 180 · see citing works
Rassen, J. A., Glynn, R. J., Brookhart, M. A., & Schneeweiß, S. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr001 · Cited by 179 · see citing works
The role of the c‐statistic in variable selection for propensity score models
Westreich, D. J., Cole, S. R., Funk, M. J., Brookhart, M. A., & Stürmer, T. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2074 · Cited by 165 · see citing works
Patrick, A. R., Schneeweiß, S., Brookhart, M. A., Glynn, R. J., Rothman, K. J., Avorn, J., & Stürmer, T. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2098 · Cited by 144 · see citing works
Stürmer, T., Rothman, K. J., & Glynn, R. J. (2006) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1231 · Cited by 120 · see citing works
Austin, P. C. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280218756159 · Cited by 118 · see citing works
Stuart, E. A. (2008) · Statistics in Medicine · doi:10.1002/sim.3207 · Cited by 115 · see citing works
Relative Performance of Propensity Score Matching Strategies for Subgroup Analyses
Wang, S. V., Jin, Y., FIREMAN, B. H., Gruber, S., He, M., Wyss, R., Shin, H., Ma, Y., Keeton, S., Karami, S., et al. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwy049 · Cited by 113 · see citing works
Performance of Propensity Score Calibration--A Simulation Study
Stürmer, T., Schneeweiß, S., Rothman, K. J., Avorn, J., & Glynn, R. J. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm074 · Cited by 110 · see citing works
Measuring balance and model selection in propensity score methods
Belitser, S. V., Martens, E. P., Pestman, W. R., Groenwold, R. H. H., de Boer, A., & Klungel, O. H. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2188 · Cited by 107 · see citing works
Qu, Y., & Lipkovich, I. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3549 · Cited by 97 · see citing works
Leacy, F. P., & Stuart, E. A. (2013) · Statistics in Medicine · doi:10.1002/sim.6030 · Cited by 93 · see citing works
Lunt, M., Solomon, D. H., Rothman, K. J., Glynn, R., Hyrich, K. L., Symmons, D. P. M., & Stürmer, T. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwn391 · Cited by 93 · see citing works
Weitzen, S. H., Lapane, K. L., Toledano, A. Y., Hume, A. L., & Mor, V. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.986 · Cited by 93 · see citing works
Methods to control for unmeasured confounding in pharmacoepidemiology: an overview
Uddin, M. J., Groenwold, R. H. H., Ali, M. S., de Boer, A., Roes, K. C. B., Chowdhury, M. A. B., & Klungel, O. H. (2016) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-016-0299-0 · Cited by 93 · see citing works
Self-citationApplying propensity scores estimated in a full cohort to adjust for confounding in subgroup analyses
Rassen, J. A., Glynn, R. J., Rothman, K. J., Setoguchi, S., & Schneeweiß, S. (2011) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2256 · Cited by 91 · see citing works
Propensity Score Methods for Bias Reduction in Observational Studies of Treatment Effect
Johnson, S. R., TOMLINSON, G. A., HAWKER, G. A., Granton, J. T., & Feldman, B. M. (2018) · Rheumatic Disease Clinics of North America · doi:10.1016/j.rdc.2018.01.002 · Cited by 74 · see citing works
Propensity score balance measures in pharmacoepidemiology: a simulation study
Ali, M. S., Groenwold, R. H. H., Pestman, W. R., Belitser, S. V., Roes, K. C. B., Hoes, A. W., de Boer, A., & Klungel, O. H. (2014) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3574 · Cited by 64 · see citing works
Self-citationAddressing unmeasured confounding in comparative observational research
Zhang, X., Faries, D. E., Li, H., Stamey, J. D., & Imbens, G. W. (2018) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4394 · Cited by 64 · see citing works
Best (but oft-forgotten) practices: propensity score methods in clinical nutrition research
Ali, M. S., Groenwold, R. H. H., & Klungel, O. H. (2016) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.125914 · Cited by 60 · see citing works
Self-citationPlatt, R. W., Schisterman, E. F., & Cole, S. R. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp175 · Cited by 57 · see citing works
Adelson, J. L., McCoach, D. B., Rogers, H. J., Adelson, J. A., & Sauer, T. M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01413 · Cited by 51 · see citing works
What type of clinical evidence is needed to assess medical devices?
Tarricone, R., Boscolo, P. R., & Armeni, P. (2016) · European Respiratory Review · doi:10.1183/16000617.0016-2016 · Cited by 43 · see citing works
Yuan, H., Ali, M. S., Brouwer, E., Girman, C. J., Guo, J. J., Lund, J. L., Patorno, E., Slaughter, J. L., Wen, X., & Bennett, D. (2018) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1086 · Cited by 39 · see citing works
Self-citationBlake, K. V., deVries, C. S., Arlett, P. R., Kurz, X., & Fitt, H. (2012) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3281 · Cited by 31 · see citing works
Crowe, B. J., Lipkovich, I. A., & Wang, O. (2009) · Pharmaceutical Statistics · doi:10.1002/pst.389 · Cited by 31 · see citing works
Wang, S. V., He, M., Jin, Y., et al. (2017) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4328 · Cited by 23 · see citing works
Ali, M. S., Groenwold, R. H. H., Pestman, W. R., Belitser, S. V., Hoes, A. W., de Boer, A., & Klungel, O. H. (2013) · European Journal of Epidemiology · doi:10.1007/s10654-013-9766-2 · Cited by 19 · see citing works
Self-citationVijverberg, S. J. H., Hernandez‐Pacheco, N., Farzan, N., et al. (2017) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4275 · Cited by 15 · see citing works
Myers et al. Respond to "Understanding Bias Amplification"
Myers, J. A., Rassen, J. A., Gagne, J. J., Huybrechts, K. F., Schneeweiß, S., Rothman, K. J., & Glynn, R. J. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr353 · Cited by 11 · see citing works
Pharmacoepidemiology and drug safety
(1993) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.2630020212 · Cited by 11 · see citing works
The specification of the propensity score in multilevel observational studies
Arpino, B., & Mealli, F. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.11.008 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Ali M. S. Douglas I. J. Williamson E. Prieto-Alhambra D. Smeeth L. (2018b). “ A joint application of disease risk score and propensity score to control for confounding: A clinical example,” in Pharmacoepidemiology and drug safety vol. 27 (NJ USA: Wiley 111 River St, Hoboken 07030-5774), 27– 27.
- Ali M. S. Khalid S. Collins G. Prieto-Alhambra D. (2017b). The comparative performance of logistic regression and random forest in propensity score methods: A simulation study. Pharmacoepidemiol. Drug Saf. 26:(Suppl.2): 3– 636. 10.1002/pds.4275 28547787 · DOI
- Ali M. S. Khalid S. Groenwold R. Collins G. S. Klungel O. Prieto-Alhambra D. (2017c). Instrumental variables to test for unmeasured confounding: a precautionary note. Pharmacoepidemiol. Drug Saf. 26:(Suppl.2): 3– 636. 10.1002/pds.4275 28547787 · DOI
- Pearl J. (2012). On a class of bias-amplifying variables that endanger effect estimates. arXiv e-prints e1203.3503. https://ui.adsabs.harvard.edu/abs/2012arXiv1203.3503P.
Cited by
Sorted by citations
Nnate, D. A., Anyachukwu, C. C., Igwe, S. E., & Abaraogu, U. O. (2021) · Psycho-Oncology · doi:10.1002/pon.5749 · Cited by 24 · see citing works
“Such approach has also been recommended for a more generalisable randomised trials where certain covariates exist by chance.(52,53)”
BackgroundYamakawa, S., Nagayama, H., Tomori, K., Ikeda, K., & Niimi, A. (2023) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2022.1045231 · Cited by 10 · see citing works
- Authors
- Ali, M. S., Prieto-Alhambra, D., Lopes, L. C., Ramos, D., Bispo, N., Ichihara, M. Y., Pescarini, J. M., Williamson, E., Fiaccone, R. L., Barreto, M. L., & Smeeth, L.
- Affiliations
- University of Oxford (GB)
- Universidade de Sorocaba (BR)
- Fundação Oswaldo Cruz (BR)
- Universidade Federal da Bahia (BR)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Ali, M Sanni
- ORCID
- Venue
- Frontiers in Pharmacology
- Publisher
- Frontiers Media SA
- Published
- 2019-09-18
- Volume
- 10
- Pages
- 973-973
- ISSN
- 1663-9812 (ISSN-L)
- PMC
- PMC6760465
- OpenAlex
- W2965008065
- Cited by
- 200
- References
- 114
- Citations by year
- 2026: 11 · 2025: 23 · 2024: 40 · 2023: 42 · 2022: 41 · 2021: 33 · 2020: 10
- FWCI
- 3.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Pharmacology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (publishedVersion, other-oa)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Dipòsit Digital de Documents de la UAB (Universitat Autònoma de Barcelona) (submittedVersion, cc-by)
- Americanae (AECID Library) (submittedVersion, other-oa)
- Arca - Repositório Institucional da Fiocruz (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by)
- Frontiers A Journal of Women Studies
- Funders
- Wellcome Trust (202912, 202912/B/16/Z)
- Medical Research Council (MR/M013278/1)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- propensity score, health technology assessment, observational studies, confounding, treatment effect estimation, generalizability, efficacy versus effectiveness, covariate balance, causal inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review