Making inferences on treatment effects from real world data: propensity scores, confounding by indication, and other perils for the unwary in observational research
Open accessAbstract
Propensity score based methods are used increasingly to evaluate the effectiveness of treatments when evidence from randomised trials is not available. However, users need to be aware of their strengths and limitations
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The prognosis of those receiving the (drug) treatment may be better or worse than those who are not, but information on prognosis and/or severity of the underlying illness may not be available in the data.
“Hence, the prognosis of those receiving the (drug) treatment may be better or worse than those who are not, but information on prognosis and/or severity of the underlying illness may not be available in the data [72].”
From The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. (2015) · cites this paper as [72]
Confounding by indication is often an issue when examining effectiveness and safety of (drug) treatments using routinely collected data.
“A particular type of unmeasured confounding is confounding by indication; this is often an issue when examining effectiveness and safety of (drug) treatments using routinely collected data.”
From The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. (2015) · cites this paper as [72]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · see citing works
The Effect of Spironolactone on Morbidity and Mortality in Patients with Severe Heart Failure
Pitt, B., Zannad, F., Remme, W. J., Cody, R., Castaigne, A., Perez, A., Palensky, J., & Wittes, J. (1999) · New England Journal of Medicine · doi:10.1056/nejm199909023411001 · Cited by 9,214 · see citing works
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980 · see citing works
Pitt, B., Remme, W., Zannad, F., Neaton, J., Martinez, F., Roniker, B., Bittman, R., Hurley, S., Kleiman, J., & Gatlin, M. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa030207 · Cited by 4,941 · see citing works
A comparison of rate control and rhythm control in patients with atrial fibrillation
(2002) · New England Journal of Medicine · doi:10.1056/nejmoa021328 · Cited by 4,405 · see citing works
The Central Role of the Propensity Score in Observational Studies for Causal Effects
Rosenbaum, P. R., & Rubin, D. B. (1983) · Biometrika · doi:10.2307/2335942 · Cited by 3,495 · see citing works
Eplerenone in patients with systolic heart failure and mild symptoms
Zannad, F., McMurray, J. J. V., Krum, H., van Veldhuisen, D. J., Swedberg, K., Shi, H., Vincent, J., Pocock, S. J., & Pitt, B. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1009492 · Cited by 3,111 · see citing works
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082 · see citing works
The Risk Associated with Aprotinin in Cardiac Surgery
Mangano, D. T., Tudor, I. C., & Dietzel, C. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa051379 · Cited by 1,105 · see citing works
Mortality Associated With Aprotinin During 5 Years Following Coronary Artery Bypass Graft Surgery
Mangano, D. T. (2007) · JAMA · doi:10.1001/jama.297.5.471 · Cited by 394 · see citing works
Propensity scores: From naïve enthusiasm to intuitive understanding
Williamson, E., Morley, R., Lucas, A., & Carpenter, J. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210394483 · Cited by 248 · see citing works
Smeeth, L. L., Douglas, I., Hall, A. J., Hubbard, R., & Evans, S. J. W. (2008) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2008.03308.x · Cited by 234 · see citing works
Rogers, J. K., McMurray, J. J. V., Pocock, S. J., Zannad, F., Krum, H., van Veldhuisen, D. J., Swedberg, K., Shi, H., Vincent, J., & Pitt, B. (2012) · Circulation · doi:10.1161/circulationaha.112.110536 · Cited by 224 · see citing works
Pitt, B., Remme, W. J., & Zannad, F. M. (2003) · ACC Current Journal Review · doi:10.1016/s1062-1458(03)00290-3 · Cited by 192 · see citing works
A comparison of rate control and rhythm control in patients with atrial fibrillation
The Atrial Fibrillation Follow-Up Investigation of Rhythm Management (AFFIRM) Investigators (2003) · ACC Current Journal Review · doi:10.1016/s1062-1458(03)00084-9 · Cited by 169 · see citing works
In Defense of Pharmacoepidemiology — Embracing the Yin and Yang of Drug Research
Avorn, J. (2007) · New England Journal of Medicine · doi:10.1056/nejmp0706892 · Cited by 162 · see citing works
Saksena, S. V., Slee, A. E., Waldo, A. L., Freemantle, N., Reynolds, M. R., Rosenberg, Y., Rathod, S., Grant, S., Thomas, E., & Wyse, D. G. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2011.07.036 · Cited by 134 · see citing works
Self-citationHowell, N., Senanayake, E. L., Freemantle, N., & Pagano, D. (2012) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2012.07.018 · Cited by 64 · see citing works
Self-citationThe Risk Associated with Aprotinin in Cardiac Surgery
Lee, H. T., & Gravlee, G. P. (2007) · Yearbook of Anesthesiology and Pain Management · doi:10.1016/s1073-5437(08)70070-6 · Cited by 11 · see citing works
Flagged first, then by citations
1 of the 20 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- For personal use only: See rights and reprints http://www.bmj.com/permissions Subscribe: http://www.bmj.com/subscribe RESEARCH METHODS & REPORTING on 5 November 2023 by guest. Protected by copyright. http://www.bmj.com/ BMJ: first published as 10.1136/bmj.f6409 on 11 November 2013. Downloaded from 9 Trends in the characteristics, treatment and prognosis of people with symptomatic heart failure and the use of aldosterone antagonists: analysis plan. www.ucl.ac.uk/priment/ documents/Heart-Failure-Analysis-Plan.
- Saksena S, Slee A, Waldo AL, Freemantle N, Reynolds M, Rosenberg Y, et al. Cardiovascular outcomes in the AFFIRM trial: an assessment of individual antiarrhythmic drug therapies compared to rate control using propensity score matched analyses. J Am Clin Cardiol 2011;19:1975-85.
Cited by
Sorted by citations
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749 · see citing works
Self-citationInterpretation and Impact of Real-World Clinical Data for the Practicing Clinician
Blonde, L., Khunti, K. K., Harris, S. B., Meizinger, C., & SKOLNIK, N. (2018) · Advances in Therapy · doi:10.1007/s12325-018-0805-y · Cited by 734 · see citing works
Liddle, A. D., Judge, A., Pandit, H. G., & Murray, D. W. (2014) · The Lancet · doi:10.1016/s0140-6736(14)60419-0 · Cited by 676 · see citing works
Mansournia, M. A., & Altman, D. G. (2016) · BMJ · doi:10.1136/bmj.i189 · Cited by 434 · see citing works
Smith, A., Crouch, S., Lax, S. J., Li, J., Painter, D., Howell, D. A., Patmore, R. D., Jack, A., & Roman, E. (2015) · British Journal of Cancer · doi:10.1038/bjc.2015.94 · Cited by 427 · see citing works
Patient-reported outcomes after total and unicompartmental knee arthroplasty
Liddle, A. D., Pandit, H. G., Judge, A., & Murray, D. W. (2015) · The Bone & Joint Journal · doi:10.1302/0301-620x.97b6.35155 · Cited by 337 · see citing works
<p>Synthetic and External Controls in Clinical Trials – A Primer for Researchers</p>
Thorlund, K., Dron, L., Park, J. J., & Mills, E. J. (2020) · Clinical Epidemiology · doi:10.2147/clep.s242097 · Cited by 257 · see citing works
Corraini, P., Olsen, M., Pedersen, L. H., Dekkers, O. M., & Vandenbroucke, J. P. (2017) · Clinical Epidemiology · doi:10.2147/clep.s129728 · Cited by 233 · see citing works
Nørgaard, M., Ehrenstein, V., & Vandenbroucke, J. P. (2017) · Clinical Epidemiology · doi:10.2147/clep.s129879 · Cited by 211 · see citing works
Raine, R., Fitzpatrick, R. M., Barratt, H., Bevan, G., Black, N. A., Boaden, R., Bower, P., Campbell, M., Denis, J., Devers, K. J., et al. (2016) · Health Services and Delivery Research · doi:10.3310/hsdr04160 · Cited by 187 · see citing works
Self-citationAlbasri, A., Hattle, M., Koshiaris, C., Dunnigan, A. V., Paxton, B., Fox, S. E., Smith, M. C., Archer, L., Levis, B., Payne, R., et al. (2021) · BMJ · doi:10.1136/bmj.n189 · Cited by 165 · see citing works
Reducing Length of Stay Using a Robotic-assisted Approach for Retromuscular Ventral Hernia Repair
Carbonell, A. M., Warren, J. A., Prabhu, A. S., Ballecer, C. D., Janczyk, R. J., Herrera, J., Huang, L., Phillips, S. E., Rosen, M. J., & Poulose, B. K. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000002244 · Cited by 164 · see citing works
Cameron, C. G., FIREMAN, B. H., Hutton, B., Clifford, T., Coyle, D., Wells, G. A., Dormuth, C. R., Platt, R. W., & Toh, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0133-0 · Cited by 143 · see citing works
Prevalence of Missing Data in the National Cancer Database and Association with Overall Survival
Yang, D. X., Khera, R., Miccio, J. A., Jairam, V., Chang, E., Yu, J. B., Park, H. S., Krumholz, H. M., & Aneja, S. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.1793 · Cited by 135 · see citing works
Adjusting for unmeasured confounding in nonrandomized longitudinal studies: a methodological review
Streeter, A., Lin, N. X., Crathorne, L., Haasova, M., Hyde, C., Melzer, D. R., & Henley, W. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.04.022 · Cited by 134 · see citing works
Camm, A. J., & Fox, K. A. A. (2018) · Open Heart · doi:10.1136/openhrt-2018-000788 · Cited by 125 · see citing works
Use of Health Care Databases to Support Supplemental Indications of Approved Medications
Fralick, M., Kesselheim, A. S., Avorn, J., & Schneeweiß, S. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2017.3919 · Cited by 119 · see citing works
Bhanu, C., Nimmons, D., Petersen, I., Orlu, M., Davis, D., Hussain, H., Magammanage, S., & Walters, K. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003821 · Cited by 116 · see citing works
Self-citationSpillover effects in epidemiology: parameters, study designs and methodological considerations
Benjamin‐Chung, J., Arnold, B. F., Berger, D., Luby, S. P., Miguel, E. A., Colford, J. M., & Hubbard, A. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyx201 · Cited by 116 · see citing works
Petersen, I., McCrea, R. L., Sammon, C., Osborn, D., Evans, S. J. W., Cowen, P. J., Freemantle, N., & Nazareth, I. (2016) · Health Technology Assessment · doi:10.3310/hta20230 · Cited by 109 · see citing works
Self-citationDoubeni, C. A., Gabler, N. B., Wheeler, C. M., McCarthy, A. M., Castle, P. E., Halm, E. A., Schnall, M. D., Skinner, C. S., Tosteson, A. N. A., Weaver, D. L., et al. (2018) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21452 · Cited by 101 · see citing works
on behalf of the Canadian Critical Care Trials Group H1N1 Collaborative, Delaney, J. W., Pinto, R. L., Long, J. K., Lamontagne, F., Adhikari, N. K. J., Kumar, A., Marshall, J. C., Cook, D. J., Jouvet, P. A., et al. (2016) · Critical Care · doi:10.1186/s13054-016-1230-8 · Cited by 97 · see citing works
Benchimol, E. I., Smeeth, L. L., Guttmann, A., Harron, K. L., Hemkens, L. G., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E. B., & Langan, S. (2016) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2016.07.010 · Cited by 97 · see citing works
Self-citationResearch and Reporting Considerations for Observational Studies Using Electronic Health Record Data
Callahan, A., Shah, N. H., & Chen, J. H. (2020) · Annals of Internal Medicine · doi:10.7326/m19-0873 · Cited by 92 · see citing works
Collagenase Clostridium Histolyticum versus Limited Fasciectomy for Dupuytren’s Contracture
Zhou, C., Hovius, S. E. R., Slijper, H. P., Feitz, R., van Nieuwenhoven, C. A., Pieters, A. J., & Selles, R. W. (2015) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000001320 · Cited by 84 · see citing works
The Expanding Role of Real-World Evidence Trials in Health Care Decision Making
Klonoff, D. C. (2019) · Journal of Diabetes Science and Technology · doi:10.1177/1932296819832653 · Cited by 80 · see citing works
Weisberg, D. F., Gordon, K. S., Barry, D. T., Becker, W. C., Crystal, S., Edelman, E. J., Gaither, J. R., Gordon, A. J., Goulet, J. L., Kerns, R. D., et al. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000591 · Cited by 79 · see citing works
Quantifying the impact of unmeasured confounding in observational studies with the E value
Gaster, T., Eggertsen, C. M., Støvring, H., Ehrenstein, V., & Petersen, I. (2023) · BMJ Medicine · doi:10.1136/bmjmed-2022-000366 · Cited by 73 · see citing works
Self-citationBiases in Electronic Health Records Data for Generating Real-World Evidence: An Overview
Al‐Sahab, B., Leviton, A., Loddenkemper, T., Paneth, N., & Zhang, B. (2023) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-023-00153-2 · Cited by 71 · see citing works
Krisanapan, P., Vongsanim, S., Pin-on, P., Ruengorn, C., & Noppakun, K. (2020) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2019.11.012 · Cited by 70 · see citing works
New Horizons in the use of routine data for ageing research
Todd, O. M., Burton, J. K., Dodds, R. M., Hollinghurst, J., Lyons, R. A., Quinn, T. J., Schneider, A., Walesby, K. E., Wilkinson, C., Conroy, S., et al. (2020) · Age and Ageing · doi:10.1093/ageing/afaa018 · Cited by 66 · see citing works
Self-citationThe impact of obstetric mode of delivery on childhood behavior
Khalaf, S. Y. A., O’Neill, S. M., O’Keeffe, L. M., Henriksen, T. B., Kenny, L. C., Cryan, J. F., & Khashan, A. S. (2015) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-015-1055-9 · Cited by 62 · see citing works
Smith, A. G., Howell, D. A., Crouch, S., Painter, D., Blasé, J., Wang, H., Hewison, A., Bagguley, T., Appleton, S., Kinsey, S. E., et al. (2018) · International Journal of Epidemiology · doi:10.1093/ije/dyy044 · Cited by 62 · see citing works
Nosyk, B., Slaunwhite, A., Urbanoski, K. A., Hongdilokkul, N., Palis, H., Lock, K., Min, J. E., Zhao, B., Card, K. G., Barker, B., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048353 · Cited by 58 · see citing works
Services for people at high risk improve outcomes in patients with first episode psychosis
Fusar‐Poli, P., Díaz‐Caneja, C. M., Patel, R., Valmaggia, L., Byrne, M., Garety, P. A., Shetty, H., Broadbent, M. T. M., Stewart, R. J., & McGuire, P. K. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12480 · Cited by 57 · see citing works
Evolution of primary care databases in UK: a scientometric analysis of research output
Vezyridis, P., & Timmons, S. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012785 · Cited by 54 · see citing works
Observational studies of treatment effectiveness: worthwhile or worthless?
Sharma, M., Nazareth, I., & Petersen, I. (2018) · Clinical Epidemiology · doi:10.2147/clep.s178723 · Cited by 54 · see citing works
Self-citationGardiner, B. J., Chow, J. K. L., Price, L. L., Nierenberg, N. E., Kent, D. M., & Snydman, D. R. (2017) · Clinical Infectious Diseases · doi:10.1093/cid/cix696 · Cited by 53 · see citing works
Artificial Intelligence in Cardiovascular Clinical Trials
Cunningham, J. W., Abraham, W. T., Bhatt, A. S., Dunn, J., Felker, G. M., Jain, S. S., Lindsell, C. J., Mace, M., Martyn, T., Shah, R. U., et al. (2024) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2024.08.069 · Cited by 52 · see citing works
Rush, C. J., Campbell, R. T., Jhund, P. S., Petrie, M. C., & McMurray, J. J. V. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy407 · Cited by 49 · see citing works
Zhou, C., Selles, R. W., Slijper, H. P., Feitz, R., van Kooij, Y. E., Moojen, T. M., & Hovius, S. E. R. (2016) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000002560 · Cited by 46 · see citing works
Effectiveness of psychotherapeutic consultation in the workplace: a controlled observational trial
Rothermund, E., Gündel, H., Rottler, E., Holzer, M. S., Mayer, D., Rieger, M. A., & Kilian, R. (2016) · BMC Public Health · doi:10.1186/s12889-016-3567-y · Cited by 43 · see citing works
Camm, A. J., Fox, K. A. A., & Peterson, E. D. (2017) · EP Europace · doi:10.1093/europace/eux086 · Cited by 42 · see citing works
Andrade, C. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.17f11446 · Cited by 38 · see citing works
Mortality risk reduction differs according to bisphosphonate class: a 15-year observational study
Bliuc, D., Tran, T. S., van Geel, T. A. C. M., Adachi, J. D., Berger, C., van den Bergh, J. P., Eisman, J. A., Geusens, P., Goltzman, D., Hanley, D. A., et al. (2019) · Osteoporosis International · doi:10.1007/s00198-018-4806-0 · Cited by 38 · see citing works
A critical analysis of recent data on the long-term outcome of antipsychotic treatment
Moncrieff, J., & Steingard, S. (2018) · Psychological Medicine · doi:10.1017/s0033291718003811 · Cited by 36 · see citing works
Wang, X., Zhang, T., Ekheden, I. G., Chang, Z., Hellner, C., Hasselström, J., Jayaram‐Lindström, N., D'Onofrio, B. M., Larsson, H., Mataix‐Cols, D., et al. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104647 · Cited by 36 · see citing works
Skodvin, T. Ø., Evju, Ø., Sorteberg, A. G., & Isaksen, J. G. (2018) · Neurosurgery · doi:10.1093/neuros/nyy010 · Cited by 35 · see citing works
Wouters, R. M., Tsehaie, J., Slijper, H. P., Hovius, S. E. R., Feitz, R., Blomme, A., Sluijter, B. J. R., Schouten, C., van der Avoort, D. J. J. C., Walbeehm, E. T., et al. (2018) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2018.11.010 · Cited by 35 · see citing works
Reeves, D., Springate, D. A., Ashcroft, D. M., Ryan, R. P., Doran, T., Morris, R. W., Olier, I., & Kontopantelis, E. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-004952 · Cited by 35 · see citing works
Skodvin, T. Ø., Evju, Ø., Helland, C. A., & Isaksen, J. G. (2017) · Journal of neurosurgery · doi:10.3171/2017.5.jns17195 · Cited by 34 · see citing works
Treatment of Multiple Sclerosis
Cross, A., & Riley, C. (2022) · CONTINUUM Lifelong Learning in Neurology · doi:10.1212/con.0000000000001170 · Cited by 33 · see citing works
A New Surgical Site Infection Risk Score: Infection Risk Index in Cardiac Surgery
Bustamante‐Munguira, J., Herrera‐Gómez, F., Ruiz-Álvarez, M., Hernández‐Aceituno, A., & Figuerola‐Tejerina, A. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8040480 · Cited by 33 · see citing works
Momosaki, R., Abo, M., Watanabe, S., Kakuda, W., Yamada, N., & Kinoshita, S. (2015) · PLoS ONE · doi:10.1371/journal.pone.0122688 · Cited by 32 · see citing works
Harrison, P. J., & Luciano, S. (2020) · Bipolar Disorders · doi:10.1111/bdi.13022 · Cited by 32 · see citing works
Are Target Trial Emulations the Gold Standard for Observational Studies?
Pearce, N. E., & Vandenbroucke, J. P. (2023) · Epidemiology · doi:10.1097/ede.0000000000001636 · Cited by 32 · see citing works
Mikkelsen, M., Price, A. J., Pedersen, A. B., Gromov, K., & Troelsen, A. (2022) · Acta Orthopaedica · doi:10.2340/17453674.2022.2265 · Cited by 31 · see citing works
Harrison, P. J., Luciano, S., & Colbourne, L. (2020) · Journal of Psychopharmacology · doi:10.1177/0269881120936501 · Cited by 30 · see citing works
Detterbeck, F. C., Mase, V. J., Li, A. X., Kumbasar, U., Bade, B. C., Park, H. S.-M., Decker, R. H., Madoff, D. C., Woodard, G. A., Brandt, W. S., et al. (2022) · Journal of Thoracic Disease · doi:10.21037/jtd-21-1824 · Cited by 30 · see citing works
Jander, N., Sommer, H., Pingpoh, C., Kienzle, R.-P., Martin, G., Zeh, W., Pache, G., Siepe, M., Beyersdorf, F., Schumacher, M., et al. (2015) · International Journal of Cardiology · doi:10.1016/j.ijcard.2015.07.022 · Cited by 29 · see citing works
The Future of Meat: Health Impact Assessment with Randomized Evidence
Ferreira, J. P., Sharma, A., & Zannad, F. M. (2020) · The American Journal of Medicine · doi:10.1016/j.amjmed.2020.11.007 · Cited by 29 · see citing works
Abe, S., Kawano, F., Matsuka, Y., Masuda, T., Okawa, T., & Tanaka, E. I. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11216396 · Cited by 29 · see citing works
Patorno, E., Garry, E. M., Patrick, A. R., Schneeweiß, S., Gillet, V. G., Zorina, O., Bartels, D. B., & Seeger, J. D. (2015) · Drug Safety · doi:10.1007/s40264-015-0280-1 · Cited by 29 · see citing works
Edwards, L., Pickett, J., Ashcroft, D. M., Dambha‐Miller, H., Majeed, A., Mallen, C. D., Petersen, I., Qureshi, N., van Staa, T. P., Abel, G., et al. (2023) · BJGP Open · doi:10.3399/bjgpo.2023.0057 · Cited by 27 · see citing works
Self-citationTölle, T. R., Fitzcharles, M., & Häuser, W. (2021) · European Journal of Pain · doi:10.1002/ejp.1742 · Cited by 27 · see citing works
Hou, J., Kim, N. H., Cai, T. A., Dahal, K. P., Weiner, H. L., Chitnis, T., Cai, T., & Xia, Z. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.34627 · Cited by 27 · see citing works
Nicholls, S. G., Langan, S., Sørensen, H. T., Petersen, I., & Benchimol, E. I. (2016) · Clinical Epidemiology · doi:10.2147/clep.s110528 · Cited by 27 · see citing works
Self-citationPropensity score methods in real‐world epidemiology: A practical guide for first‐time users
Loke, Y. K., & Mattishent, K. (2020) · Diabetes Obesity and Metabolism · doi:10.1111/dom.13926 · Cited by 26 · see citing works
Gomes, M., Latimer, N. R., Soares, M. O., Dias, S., Baio, G., Freemantle, N., Dawoud, D., Wailoo, A., & Grieve, R. (2022) · PharmacoEconomics · doi:10.1007/s40273-022-01141-x · Cited by 26 · see citing works
Self-citationTsutsumi, Y., Fukuma, S., Tsuchiya, A., Ikenoue, T., Yamamoto, Y., Shimizu, S., Kimachi, M., & Fukuhara, S. (2017) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-017-0396-7 · Cited by 26 · see citing works
Orthostatic Hypotension and Antiparkinsonian Drugs: A Systematic Review and Meta-analysis
Nimmons, D., Bhanu, C., Orlu, M., Schrag, A. E., & Walters, K. R. (2021) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/08919887211060017 · Cited by 25 · see citing works
Self-citationDressler, A. M., Gillman, A. G., & Wasan, A. D. (2019) · Journal of Pain Research · doi:10.2147/jpr.s184023 · Cited by 25 · see citing works
A Risk Assessment Tool for Predicting Fragility Fractures and Mortality in the Elderly
Tran, T. S., Bliuc, D., Pham, H. M., van Geel, T. A. C. M., Adachi, J. D., Berger, C., van den Bergh, J. P., Eisman, J. A., Geusens, P., Goltzman, D., et al. (2020) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.4100 · Cited by 25 · see citing works
Zhang, T., Ou, L., Chen, Z., Li, J., Shang, Y., & Hu, G. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.756366 · Cited by 23 · see citing works
Detterbeck, F. C., Blasberg, J. D., Woodard, G. A., Decker, R. H., Kumbasar, U., Park, H. S.-M., Mase, V. J., Bade, B. C., Li, A. X., Brandt, W. S., et al. (2022) · Journal of Thoracic Disease · doi:10.21037/jtd-21-1823 · Cited by 23 · see citing works
Tsiachristas, A., Ellis, G., Buchanan, S., Langhorne, P., Stott, D. J., & Shepperd, S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-023350 · Cited by 22 · see citing works
Oseltamivir: the real world data
Freemantle, N., Shallcross, L. J., Kyte, D. G., Rader, T., & Calvert, M. (2014) · BMJ · doi:10.1136/bmj.g2371 · Cited by 22 · see citing works
Self-citationThe value of a health insurance database to conduct pharmacoepidemiological studies in oncology
Conte, C., Vaysse, C., Bosco‐Lévy, P., Noïze, P., Fourrier‐Réglat, A., Despas, F., & Lapeyre‐Mestre, M. (2019) · Therapies · doi:10.1016/j.therap.2018.09.076 · Cited by 22 · see citing works
Pocock, S., & Collier, T. J. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.04.015 · Cited by 21 · see citing works
Using Large Diabetes Databases for Research
Wild, S. H., Fischbacher, C., & McKnight, J. (2016) · Journal of Diabetes Science and Technology · doi:10.1177/1932296816645120 · Cited by 21 · see citing works
Intravenous Thrombolysis After First-Ever Ischemic Stroke and Reduced Incident Dementia Rate
Cerasuolo, J. O., Mandzia, J., Cipriano, L. E., Kapral, M. K., Fang, J., Hachinski, V., & Sposato, L. A. (2021) · Stroke · doi:10.1161/strokeaha.121.034969 · Cited by 20 · see citing works
Warkentin, L., Hueber, S., Deiters, B., Klohn, F., & Kühlein, T. (2022) · Thrombosis Journal · doi:10.1186/s12959-022-00389-9 · Cited by 20 · see citing works
Broeks, C. W., Molenaar, N. M., Brouwer, M. E., van den Akker, E. L. T., van Rossum, E. F. C., Van, R., van den Berg, S. A. A., Hillegers, M. H. J., Hoogendijk, W. J. G., Burger, H., et al. (2023) · Comprehensive Psychoneuroendocrinology · doi:10.1016/j.cpnec.2023.100167 · Cited by 20 · see citing works
General practitioners providing non-urgent care in emergency department: a natural experiment
Uthman, O. A., Walker, C., Lahiri, S., Jenkinson, D., Adekanmbi, V., Robertson, W., & Clarke, A. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019736 · Cited by 20 · see citing works
Goderis, G., Colman, E., Irusta, L. A., Hecke, A. V., Pétré, B., Devroey, D., Deun, E. V., Faes, K., Charlier, N., Verhaeghe, N., et al. (2020) · International Journal of Integrated Care · doi:10.5334/ijic.5435 · Cited by 20 · see citing works
Cefiderocol and the Need for Higher-Quality Evidence: Methods Matter for Patients
Epling, B. P., & Powers, J. H. (2022) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00766-22 · Cited by 20 · see citing works
Midterm risk of cancer with metal-on-metal hip replacements not increased in a Finnish population
Ekman, E., Laaksonen, I. E., Eskelinen, A. P., Pulkkinen, P. O., Pukkala, ., & Mäkelä, K. T. (2018) · Acta Orthopaedica · doi:10.1080/17453674.2018.1487202 · Cited by 19 · see citing works
Acute cholecystitis – a cohort study in a real-world clinical setting (REWO study, NCT02796443)
Blythe, J., Herrmann, E. M., Faust, D., Falk, S., Edwards-Lehr, T., Stockhausen, F., Hanisch, E. W., & Buia, A. (2018) · Pragmatic and Observational Research · doi:10.2147/por.s169255 · Cited by 19 · see citing works
Treatment of first-time traumatic anterior shoulder dislocation: the UK TASH-D cohort study
Rees, J. L., Shah, A., Edwards, K., Sanchez-Santos, M. T., Robinson, D. E., Delmestri, A., Carr, A. J., Arden, N., Lamb, S. E., Rangan, A., et al. (2019) · Health Technology Assessment · doi:10.3310/hta23180 · Cited by 19 · see citing works
Anchora, L. P., Bizzarri, N., Kucukmetin, A., Turco, L. C., Gallotta, V., Carbone, V., Rundle, S., Ratnavelu, N. D., Cosentino, F., Chiàntera, V., et al. (2020) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2020.09.038 · Cited by 18 · see citing works
Czaja, A. S., Ross, M., Liu, W., Fiks, A. G., Localio, R. A., Wasserman, R. C., Grundmeier, R. W., & Adams, W. G. (2018) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4562 · Cited by 18 · see citing works
Seifu, Y., Gamalo, M., Barthel, F. M.-S., Lin, J., Qiu, J., Cooner, F., Ruan, S., & Walley, R. J. (2020) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-020-00170-y · Cited by 18 · see citing works
Barili, F., Freemantle, N., Folliguet, T. A., Muneretto, C., Bonis, M. D., Czerny, M., Obadia, J. F., Al‐Attar, N., Bonaros, N. E., Kluin, J., et al. (2017) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezx058 · Cited by 17 · see citing works
Self-citationZhou, C., Hovius, S. E. R., Pieters, A. J., Slijper, H. P., Feitz, R., & Selles, R. W. (2017) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000001425 · Cited by 17 · see citing works
Real-world data for efficient health technology assessment
Hall, P. S. (2017) · European Journal of Cancer · doi:10.1016/j.ejca.2017.04.003 · Cited by 17 · see citing works
Jang, H. Y., Kim, I., & Oh, J. M. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2022.928121 · Cited by 16 · see citing works
Urzua, A. M., Pizarro, C., Gajardo, A. I. J., Poniachik, R., Pavez, C., Cattaneo, M., Brahm, J., Carreño, L. E., & Poníachik, J. (2022) · Canadian Journal of Gastroenterology and Hepatology · doi:10.1155/2022/6470847 · Cited by 16 · see citing works
Tsehaie, J., Wouters, R. M., Feitz, R., Slijper, H. P., Hovius, S. E. R., & Selles, R. W. (2019) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2019.02.016 · Cited by 16 · see citing works
Clinical Perspectives on Targeting Therapies for Personalized Medicine
Singer, D. R. J., & Zaïr, Z. M. (2015) · Advances in protein chemistry and structural biology · doi:10.1016/bs.apcsb.2015.11.003 · Cited by 15 · see citing works
Moncusí, M. P., García‐Giralt, N., Díez‐Pérez, A., Tusquets, I., Servitja, S., Albanell, J., Prieto‐Alhambra, D., & Nogués, X. (2020) · Therapeutic Advances in Medical Oncology · doi:10.1177/1758835920909660 · Cited by 15 · see citing works
- Authors
- Freemantle, N., Marston, L., Walters, K., Wood, J., Reynolds, M. R., & Petersen, I.
- Affiliations
- The Royal Free Hospital (GB)
- Lahey Hospital and Medical Center (US)
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2013-11-11
- Volume
- 347
- Issue
- nov11 3
- Pages
- f6409-f6409
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W1989803330
- Cited by
- 211
- References
- 20
- Citations by year
- 2026: 5 · 2025: 10 · 2024: 7 · 2023: 18 · 2022: 23 · 2021: 14 · 2020: 26 · 2019: 15 · 2018: 28 · 2017: 22 · 2016: 23 · 2015: 15 · 2014: 5
- FWCI
- 12.61
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- propensity score, confounding by indication, real-world data, observational studies, treatment effect estimation, causal inference, effectiveness evaluation
- MeSH terms
- Humans, Research, Research Design, Reproducibility of Results, Bias, Confounding Factors, Epidemiologic, Randomized Controlled Trials as Topic, Treatment Outcome, Propensity Score, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review