Methods to convert continuous outcomes into odds ratios of treatment response and numbers needed to treat: meta-epidemiological study
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Clinicians find standardized mean differences (SMDs) calculated from continuous outcomes difficult to interpret. Our objective was to determine the performance of methods in converting SMDs or means to odds ratios of treatment response and numbers needed to treat (NNTs) as more intuitive measures of treatment effect. METHODS: Meta-epidemiological study of large-scale trials (≥ 100 patients per group) comparing active treatment with placebo, sham or non-intervention control. Trials had to use pain or global symptoms as continuous outcomes and report both the percentage of patients with treatment response and mean pain or symptom scores per group. For each trial, we calculated odds ratios of observed treatment response and NNTs and approximated these estimates from SMDs or means using all five currently available conversion methods by Hasselblad and Hedges (HH), Cox and Snell (CS), Furukawa (FU), Suissa (SU) and Kraemer and Kupfer (KK). We compared observed and approximated values within trials by deriving pooled ratios of odds ratios (RORs) and differences in NNTs. ROR <1 and positive differences in NNTs imply that approximations are more conservative than estimates calculated from observed treatment response. As measures of agreement, we calculated intraclass correlation coefficients. RESULTS: A total of 29 trials in 13 654 patients were included. Four out of five methods were suitable (HH, CS, FU, SU), with RORs between 0.92 for SU [95% confidence interval (95% CI), 0.86-0.99] and 0.97 for HH (95% CI, 0.91-1.04) and differences in NNTs between 0.5 (95% CI, -0.1 to -1.6) and 1.3 (95% CI, 0.4-2.1). Intraclass correlation coefficients were ≥ 0.90 for these four methods, but ≤ 0.76 for the fifth method by KK (P for differences ≤ 0.027). CONCLUSIONS: The methods by HH, CS, FU and SU are suitable to convert summary treatment effects calculated from continuous outcomes into odds ratios of treatment response and NNTs, whereas the method by KK is unsuitable.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is also possible to combine relative risks with other metrics like standardised mean differences or correlation coefficients. This requires transformation from an odds ratio in a standardised mean difference (or vice versa) [86] or an odds ratio in a correlation coefficient [87,88].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [88]
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Dworkin, R. H., Turk, D. C., Wyrwich, K. W., Beaton, D., Cleeland, C. S., Farrar, J. T., Haythornthwaite, J. A., Jensen, M. P., Kerns, R. D., Ader, D. N., et al. (2008) · The Journal of Pain · doi:10.1016/j.jpain.2007.09.005 · Cited by 3,471
Better Bootstrap Confidence Intervals
Efron, B. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478410 · Cited by 3,364
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Self-citationU.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-79 · Cited by 2,856
(2008) · The Concise Encyclopedia of Statistics · doi:10.1007/978-0-387-32833-1_5 · Cited by 2,670
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
Size of Treatment Effects and Their Importance to Clinical Research and Practice
Kraemer, H. C., & Kupfer, D. J. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
Metabolomics in Prediabetes and Diabetes: A Systematic Review and Meta-analysis
Guasch-Ferré, M., Hruby, A., Toledo, E., Clish, C. B., Martínez-González, M. A., Salas-Salvadó, J., & Hu, F. B. (2016) · Diabetes Care · doi:10.2337/dc15-2251 · Cited by 905
“For the studies providing means (SD) in case and control subjects (12,13), we used the Hasselblad and Hedges method to convert the measurements to OR and 95% CI (14,15) prior to inclusion in meta-analyses.”
MethodDietary fiber and health outcomes: an umbrella review of systematic reviews and meta-analyses
Veronese, N., Solmi, M., Caruso, M. G., Giannelli, G., Osella, A. R., Evangelou, E., Maggi, S., Fontana, L., Stubbs, B., & Tzoulaki, I. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqx082 · Cited by 536
Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002742 · Cited by 525
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521
“For studies in which the exact numbers of participants who had responded were not reported, but means and standard deviations for continuous depression scales were reported, the number of responders was calculated by using a validated imputation method (20, 21).”
MethodIntra-articular corticosteroid for knee osteoarthritis
Jüni, P., Hari, R., Rutjes, A. W., Fischer, R., Silletta, M. G., Reichenbach, S., & da Costa, B. R. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005328.pub3 · Cited by 518
Self-citationTakeshima, N., Sozu, T., Tajika, A., Ogawa, Y., Hayasaka, Y., & Furukawa, T. A. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-30 · Cited by 387
Oral or transdermal opioids for osteoarthritis of the knee or hip
da Costa, B. R., Nüesch, E., Kasteler, R., Husni, E., Welch, V., Rutjes, A. W., & Jüni, P. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003115.pub4 · Cited by 347
Self-citationMurad, M. H., Wang, Z., Chu, H., & Lin, L. (2019) · BMJ · doi:10.1136/bmj.k4817 · Cited by 329
Kuiper, J. S., Zuidersma, M., Zuidema, S. U., Burgerhof, J. G. M., Stolk, R. P., Oude Voshaar, R. C., & Smidt, N. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw089 · Cited by 301
Evaluation of various estimators for standardized mean difference in meta‐analysis
Lin, L., & Aloe, A. M. (2021) · Statistics in Medicine · doi:10.1002/sim.8781 · Cited by 297
“Book Glass’ Δ in Equation (15) Cohen’s d in Equation (1) Cohen’s d′ in Equation (16) Hedges’ g in Equation (7) Hedges and Olkin15 g′ g δ d Hunter and Schmidt81 dG d NA d Stangl and Berry31 NA z NA NA Egger et al27 Δ d NA g Lipsey and Wilson34 NA ESsm NA ESsm ′”
BackgroundGreenberg, M. T., & Abenavoli, R. (2017) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2016.1246632 · Cited by 255
“…base rate-sensitive vs. insensitive measures of effect size will vary in their meaning as a function of the absolute rate of the phenomena in the population (Costa et al., 2012), which measure of impact most meaningfully describes a given finding may differ for common and less common outcomes.”
BackgroundFactors Associated with Dengue Shock Syndrome: A Systematic Review and Meta-Analysis
Huy, N. T., Van Giang, T., Thuy, D. H. D., Kikuchi, M., Hien, T. T., Zamora, J., & Hirayama, K. (2013) · PLoS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0002412 · Cited by 223
Number needed to treat (NNT) in clinical literature: an appraisal
Mendes, D., Alves, C., & Batel-Marques, F. (2017) · BMC Medicine · doi:10.1186/s12916-017-0875-8 · Cited by 169
Siafis, S., Wu, H., Wang, D., Burschinski, A., Nomura, N., Takeuchi, H., Schneider-Thoma, J., Davis, J. M., & Leucht, S. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02203-y · Cited by 161
“We also transformed SMDs to ORs using the Hasselblad and Hedges ’ method [36 – 38], in order to allow the combination of continuous and dichotomous data for the primary outcome, as well as comparability of the fi ndings in a sensitivity analysis.”
MethodMohamadi, A., Chan, J. J., Claessen, F. M. A. P., Ring, D., & Chen, N. C. (2017) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-016-5002-1 · Cited by 161
“4 assuming a normal distribution for VAS [16].”
InfluentialPiolatto, M., Bianchi, F., Rota, M., Marengoni, A., Akbaritabar, A., & Squazzoni, F. (2022) · BMC Public Health · doi:10.1186/s12889-022-12567-5 · Cited by 160
Richter, J. E., Kumar, A., Lipka, S., Miladinovic, B., & Velanovich, V. (2018) · Gastroenterology · doi:10.1053/j.gastro.2017.12.021 · Cited by 159
Updated Method Guidelines for Cochrane Musculoskeletal Group Systematic Reviews and Metaanalyses
Ghogomu, E. A. T., Maxwell, L. J., Buchbinder, R., Rader, T., Pardo Pardo, J., Johnston, R. V., Christensen, R. D. K., Rutjes, A. W. S., Winzenberg, T. M., Singh, J. A., et al. (2014) · The Journal of Rheumatology · doi:10.3899/jrheum.121306 · Cited by 151
Self-citationda Costa, B. R., Nüesch, E., Rutjes, A. W., Johnston, B. C., Reichenbach, S., Trelle, S., Guyatt, G. H., & Jüni, P. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.03.009 · Cited by 148
Self-citationFurukawa, T. A., Shinohara, K., Sahker, E., Karyotaki, E., Miguel, C., Ciharova, M., Bockting, C. L. H., Breedvelt, J. J. F., Tajika, A., Imai, H., et al. (2021) · World Psychiatry · doi:10.1002/wps.20906 · Cited by 126
Behavioural therapies versus other psychological therapies for depression
Shinohara, K., Honyashiki, M., Imai, H., Hunot, V., Caldwell, D. M., Davies, P., Moore, T. H., Furukawa, T. A., & Churchill, R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008696.pub2 · Cited by 129
'Third wave' cognitive and behavioural therapies versus other psychological therapies for depression
Hunot, V., Moore, T. H., Caldwell, D. M., Furukawa, T. A., Davies, P., Jones, H., Honyashiki, M., Chen, P., Lewis, G., & Churchill, R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008704.pub2 · Cited by 124
Moghaddam Hosseini, V., Nazarzadeh, M., & Jahanfar, S. (2018) · Women and Birth · doi:10.1016/j.wombi.2017.10.007 · Cited by 124
Furukawa, T. A., Levine, S. Z., Tanaka, S., Goldberg, Y., Samara, M. T., Davis, J. M., Cipriani, A., & Leucht, S. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2127 · Cited by 143
“4 (1-40) Inpatients with schizophrenia (residual type excluded; DSM-III-R), BPRS total score ≥42, CGI-S score ≥4 both before and after placebo run-in”
BackgroundLong, J., Yang, Z., Wang, L., Han, Y., Peng, C. Y., Yan, C., & Yan, D. (2020) · BMC Endocrine Disorders · doi:10.1186/s12902-020-00653-x · Cited by 138
Do clinicians understand the size of treatment effects? A randomized survey across 8 countries
Johnston, B. C., Alonso-Coello, P., Friedrich, J. O., Mustafa, R. A., Tikkinen, K. A. O., Neumann, I., Vandvik, P. O., Akl, E. A., da Costa, B. R., Adhikari, N. K., et al. (2016) · Canadian Medical Association Journal · doi:10.1503/cmaj.150430 · Cited by 109
Self-citationPredictors of treatment outcome in depression in later life: A systematic review and meta-analysis
Tunvirachaisakul, C., Gould, R. L., Coulson, M., Ward, E. V., Reynolds, G., Gathercole, R. L., Grocott, H., Supasitthumrong, T., Tunvirachaisakul, A., Kimona, K., et al. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.10.008 · Cited by 128
“This has been shown to be the most robust method for this type of effect size conversion (da Costa et al., 2012) .”
MethodDietary patterns and frailty: a systematic review and meta-analysis
Fard, N. R. P., Amirabdollahian, F., & Haghighatdoost, F. (2019) · Nutrition Reviews · doi:10.1093/nutrit/nuz007 · Cited by 112
Kelley, G. A., & Kelley, K. S. (2013) · Journal of Obesity · doi:10.1155/2013/783103 · Cited by 136
Behavioural activation therapy for depression in adults
Uphoff, E., Ekers, D., Robertson, L., Dawson, S., Sanger, E., South, E., Samaan, Z., Richards, D., Meader, N., & Churchill, R. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013305.pub2 · Cited by 98
Natori, Y., Alghamdi, A., Tazari, M., Miller, V., Husain, S., Komatsu, T. E., Griffiths, P. D., Ljungman, P. T., Orchanian‐Cheff, A., Kumar, D., et al. (2017) · Clinical Infectious Diseases · doi:10.1093/cid/cix793 · Cited by 95
“The log odds ratios were estimated from SMD [11] and then meta-analysis [12] done using SAS version 9.4 (SAS Institute, Cary, NC) using DerSimonian and Laird’s model.”
MethodInfluentialBakaloudi, D. R., Chrysoula, L., Kotzakioulafi, E., Theodoridis, X., & Chourdakis, M. (2021) · Nutrients · doi:10.3390/nu13051514 · Cited by 92
Lack of blinding of outcome assessors in animal model experiments implies risk of observer bias
Bello, S., Krogsbøll, L. T., Gruber, J., Zhao, Z. J., Fischer, D., & Hróbjartsson, A. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.04.008 · Cited by 102
Gao, C., Guo, J., Gong, T.-T., Lv, J.-L., Li, X.-Y., Liu, F.-H., Zhang, M., Shan, Y.-T., Zhao, Y.-H., & Wu, Q.-J. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.813943 · Cited by 88
“Articles were included according to the following criteria: (A) systematic reviews and meta-analyses of prospective studies on the associations between duration and quality of sleep and any health-related outcome, (B) studies that relied on data from human studies with any type of health-related outcome measure, and (…”
MethodInfluentialda Costa, B. R., Saadat, P., Basciani, R., Agarwal, A., Johnston, B. C., & Jüni, P. (2020) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2020.10.004 · Cited by 99
Self-citationElsenburg, L. K., van Wijk, K. J. E., Liefbroer, A. C., & Smidt, N. (2017) · Obesity · doi:10.1002/oby.21797 · Cited by 84
“This was done using information on the exact point estimate, standard error, P value/significance level, t value, standard deviation of the exposure or outcome, and/or sample size of the study (31-35).”
Method'Third wave' cognitive and behavioural therapies versus treatment as usual for depression
Churchill, R., Moore, T. H., Furukawa, T. A., Caldwell, D. M., Davies, P., Jones, H., Shinohara, K., Imai, H., Lewis, G., & Hunot, V. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008705.pub2 · Cited by 82
Doxycycline for osteoarthritis of the knee or hip
da Costa, B. R., Nüesch, E., Reichenbach, S., Jüni, P., & Rutjes, A. W. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007323.pub3 · Cited by 88
Self-citationLöbner, M., Pabst, A., Stein, J., Dorow, M., Matschinger, H., Luppa, M., Maroß, A., Kersting, A., König, H.-H., & Riedel-Heller, S. G. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.06.008 · Cited by 72
Ten simple rules for carrying out and writing meta-analyses
Forero, D. A., López‐León, S., González‐Giraldo, Y., & Bagos, P. G. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006922 · Cited by 94
Johnston, B. C., Patrick, D. L., Thorlund, K., Busse, J. W., da Costa, B. R., Schünemann, H. J., & Guyatt, G. H. (2013) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-11-211 · Cited by 81
“Another approach for readers who are familiar with the measure is to present the NNT (the inverse of the proportion benefiting) [23].”
BackgroundSelf-citationEffect of probiotics on oral candidiasis: a systematic review and meta-analysis
Mundula, T., Ricci, F., Barbetta, B., Baccini, M., & Amedei, A. (2019) · Nutrients · doi:10.3390/nu11102449 · Cited by 68
“(2008) [61] reported the results of separated analyses conducted on three different samples of different age (50–59, 60–69, ≥70 years).”
ResultUnsaturated Fatty Acids in Mental Disorders: An Umbrella Review of Meta‐Analyses
Gao, X., Su, X., Han, X., Wen, H., Chen, C., Zhang, S., Li, W., Cai, J., Zheng, L., Ma, J., et al. (2022) · Advances in Nutrition · doi:10.1093/advances/nmac084 · Cited by 81
Neonatal outcomes with water birth: A systematic review and meta-analysis
Vanderlaan, J., Hall, P. J., & Lewitt, M. (2017) · Midwifery · doi:10.1016/j.midw.2017.12.023 · Cited by 67
Kongpakwattana, K., Sawangjit, R., Tawankanjanachot, I., Bell, J. S., Hilmer, S. N., & Chaiyakunapruk, N. (2018) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13604 · Cited by 69
Yokoi, K., & Konomi, A. (2017) · British Journal Of Nutrition · doi:10.1017/s0007114517001349 · Cited by 62
Mol, A., Reijnierse, E. M., Hoang, P. T. S. B., Wezel, R. J. A. V., Meskers, C. G. M., & Maier, A. B. (2018) · Ageing Research Reviews · doi:10.1016/j.arr.2018.10.007 · Cited by 68
The number needed to treat in pairwise and network meta-analysis and its graphical representation
Veroniki, A. A., Bender, R., Glasziou, P., Straus, S. E., & Tricco, A. C. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.007 · Cited by 56
“[14] da Costa BR, Rutjes AW, Johnston BC, Reichenba ch S, Nuesch E, Tonia T, et al.”
BackgroundRamaswami, R., Villarreal, M. D., Pitta, D. M., Carpenter, J. S., Stebbing, J., & Kalesan, B. (2015) · Breast Cancer Research and Treatment · doi:10.1007/s10549-015-3465-5 · Cited by 49
“This was also observed in the sensitivity analysiswhereweused estimates fromBuijs et al. studywhere the comparator was clonidine (SMD-0.”
MethodInfluentialde Aguiar, G. P. C. G., Saraiva, M. D., Khazaal, E. J. B., de Andrade, D. C., Filho, W. J., & Suemoto, C. K. (2020) · Pain · doi:10.1097/j.pain.0000000000001932 · Cited by 53
Gupta, A., Perdomo, S. J., Billinger, S. A., Beddhu, S., Burns, J. M., & Gronseth, G. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038971 · Cited by 56
Zhang, J., Luo, W., Huang, P., Peng, L., & Huang, Q. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.09.002 · Cited by 49
Phinyo, P., Koompawichit, P., Nochaiwong, S., Tovanabutra, N., Chiewchanvit, S., & Chuamanochan, M. (2020) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2020.08.055 · Cited by 43
Imputation of response rates from means and standard deviations in schizophrenia
Samara, M. T., Spineli, L. M., Furukawa, T. A., Engel, R. R., Davis, J. M., Salanti, G., & Leucht, S. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.10.029 · Cited by 42
“The CCC is equivalent to the ANOVA intraclass correlation coefficient (ICC), a general relative measurement of consistency and agreement (Shrout and Fleiss, 1979), frequently used in medical literature (Furukawa et al., 2005; Furukawa and Leucht, 2011; da Costa et al., 2012).”
Lipka, S., Kumar, A., Miladinović, B., & Richter, J. E. (2016) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13537 · Cited by 40
“For the ease of interpretation, we converted continuous data into odds ratios using the methods recommended by da Costa et al.15 The work has been performed and reported as per the PRISMA guidelines.16 RESULTS Study selection The initial search retrieved 1498 references of which 65 were selected for full-text review.”
MethodPredictive factors of radioiodine therapy failure in Graves’ Disease: A meta-analysis
Shalaby, M., Hadedeya, D., Toraih, E. A., Razavi, M. A., Lee, G. S., Hussein, M. H., Weidenhaft, M. C., Serou, M. J., Ibraheem, K., Abdelgawad, M., et al. (2021) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2021.03.068 · Cited by 41
Wong, A. Y. L., Chan, L. L. Y., Lo, C. W. T., Chan, W. W. Y., Lam, K. C. K., Bao, J. C. H., Ferreira, M. L., & Armijo-Olivo, S. L. (2021) · PM&R · doi:10.1002/pmrj.12560 · Cited by 42
Systematic reviews and meta-analysis in nutrition research
Kelley, G. A., & Kelley, K. S. (2019) · British Journal Of Nutrition · doi:10.1017/s0007114519002241 · Cited by 38
Behavioural activation therapy for depression in adults with non-communicable diseases
Uphoff, E., Pires, M., Barbui, C., Barua, D., Churchill, R., Cristofalo, D., Ekers, D., Fottrell, E., Mazumdar, P., Purgato, M., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013461.pub2 · Cited by 33
“If a vast majority of SDs were available and only a minority of SDs were unavailable or unobtainable, we planned to use the method devised by Furukawa and colleagues to impute SDs and calculate percentage responders (da Costa 2012; Furukawa 2005; Furukawa 2006).”
BackgroundMethodReflux and Voice Disorders: Have We Established Causality?
Schneider, G. T., Vaezi, M. F., & Francis, D. O. (2016) · Current Otorhinolaryngology Reports · doi:10.1007/s40136-016-0121-5 · Cited by 33
Skipka, G., Wieseler, B., Kaiser, T., Thomas, S., Bender, R., Windeler, J., & Lange, S. (2015) · Biometrical Journal · doi:10.1002/bimj.201300274 · Cited by 32
Petrova, D., Okan, Y., Salamanca‐Fernández, E., Domínguez-López, S., Sánchez, M., & Rodríguez‐Barranco, M. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1641425 · Cited by 40
“Sensitivity analyses showed that effects sizes that were originally ORs were not significantly different from those Note: The displayed measure is log odds ratio, where lower negative values indicate a stronger protective relationship of symptom knowledge on the patient interval.”
MethodInfluentialYuan, H., Ahmed, W. L., Liu, M., Tu, S., Zhou, F., & Wang, S. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104409 · Cited by 36
Battini, V., Cirnigliaro, G., Leuzzi, R., Rissotto, E., Mosini, G., Benatti, B., Pozzi, M., Nobile, M., Radice, S., Carnovale, C., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1215807 · Cited by 31
“However, we decided to provide Odds ratios (OR) by converting the results of total Standardized Mean Differences (SMDs) with the Hasselbach & Hedges’ method (63) in order to help the reader in the interpretation of our results:”
MethodWang, Q., Sun, C., Zhang, L., Wang, L., Ji, Q., Min, N., & Yin, Z. (2022) · European Spine Journal · doi:10.1007/s00586-022-07150-w · Cited by 35
“For continuous outcomes, the mean values and standard deviations (SD) were used to compute the odds ratios (ORs) and weighted mean differences (WMDs) and their corresponding 95% confidence intervals (CIs) [24, 25].”
MethodSpecificity of CBT for Depression: A Contribution from Multiple Treatments Meta-analyses
Honyashiki, M., Furukawa, T. A., Noma, H., Tanaka, S., Chen, P., Ichikawa, K., Ono, M., Churchill, R. C., Hunot, V., & Caldwell, D. M. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9599-7 · Cited by 33
“For studies in which the exact numbers of participants who had responded were not reported, but the means and standard deviations for continuous depression scales were reported, the number of responders was calculated using a validated imputation method (da Costa et al. 2012; Furukawa et al. 2005).”
MethodEvans, R. K., Christiansen, P., Finlay, A. H., Jones, A., Maden, M., & Boyland, E. J. (2023) · Obesity Reviews · doi:10.1111/obr.13630 · Cited by 38
Lauder, L., da Costa, B. R., Ewen, S., Scholz, S. S., Wijns, W. C., Lüscher, T. F., Serruys, P. W. J. C., Edelman, E. R., Capodanno, D., Böhm, M., et al. (2020) · European Heart Journal · doi:10.1093/eurheartj/ehaa495 · Cited by 28
“For these analyses, SMDs were converted to OR, as previously described.(11,12) A two-tailed P-value <0.”
MethodSelf-citationYang, X., Shi, N., Liu, C., Zhang, J., Miao, R., & Jin, H. (2023) · Vaccine · doi:10.1016/j.vaccine.2023.11.051 · Cited by 39
Statistical power in clinical trials of interventions for mood, anxiety, and psychotic disorders
de Vries, Y. A., Schoevers, R. A., Higgins, J. P. T., Munafo, M. R., & Bastiaansen, J. A. (2022) · Psychological Medicine · doi:10.1017/s0033291722001362 · Cited by 28
“We estimated the power of each study to detect predetermined small to large effect sizes (SMD = 0.20, 0.40, 0.60 or 0.80, or the roughly equivalent OR = 1.5, 2.0, 3.0, and 4.5, using the formula log(OR) = SMD × π /sqrt(3) (Da Costa et al., 2012) and rounded to the nearest 0.5).”
InfluentialLeucht, S., Siafis, S., Engel, R. R., Schneider‐Thoma, J., Bighelli, I., Cipriani, A., Furukawa, T. A., & Davis, J. M. (2021) · Schizophrenia Bulletin · doi:10.1093/schbul/sbab094 · Cited by 23
Zhao, J., Liu, H., Chen, Y., & Song, F. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03324-w · Cited by 34
“Empirical evidence indicates that these methods are methodologically acceptable and practically useful [21].”
Hussain, N., Costache, I., Kumar, N., Essandoh, M. K., Weaver, T. E., Wong, P., Tierney, S., Rose, P. D., McCartney, C. J. L., & Abdallah, F. W. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004692 · Cited by 25
“AXB (35) 4.”
BackgroundInfluentialJahrami, H., Trabelsi, K., Alhaj, O. A., Saif, Z., Pandi-Perumal, S. R., & BaHammam, A. S. (2022) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2022.09.001 · Cited by 24
Guidelines to understand and compute the number needed to treat
Vancak, V., Goldberg, Y., & Levine, S. Z. (2021) · Evidence-Based Mental Health · doi:10.1136/ebmental-2020-300232 · Cited by 22
Leite, L. D. O., Pitangueira, J. C. D., Damascena, N. F., & Costa, P. R. D. F. (2020) · Nutrition Reviews · doi:10.1093/nutrit/nuaa116 · Cited by 21
Has the time come to stop using the “standardised mean difference”?
Cuijpers, P. J. (2021) · Clinical Psychology in Europe · doi:10.32872/cpe.6835 · Cited by 19
“Sometimes the NNT is also used.”
InfluentialHazlewood, G. S., Bombardier, C., TOMLINSON, G. A., & Marshall, D. A. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.003 · Cited by 22
Markkula, N., Lehti, V., Adhikari, P., Peña, S., Heliste, J., Mikkonen, E., RAUTANEN, M. T., Salama, E. S. S., & Guragain, B. (2019) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2019.15 · Cited by 20
“The standardized mean difference for BDI was calculated by dividing the difference in mean scores by the pooled standard deviation using the formula from da Costa et al. (2012).”
MethodLewis, A. J., Bertino, M. D., Skewes, J., Shand, L. K., Borojevic, N., Knight, T., Lubman, D. I., & Toumbourou, J. W. (2013) · Trials · doi:10.1186/1745-6215-14-384 · Cited by 19
“63 in reduction of mental health symptoms, which is equivalent to 14% increase in the odds of remission [45].”
BackgroundBakaloudi, D. R., Chrysoula, L., Leonida, I., Kotzakioulafi, E., Theodoridis, X., & Chourdakis, M. (2021) · Clinical Nutrition · doi:10.1016/j.clnu.2021.10.002 · Cited by 23
Heimke, F., Furukawa, Y., Siafis, S., Johnston, B. C., Engel, R. R., Furukawa, T. A., & Leucht, S. (2024) · BMJ Mental Health · doi:10.1136/bmjment-2023-300978 · Cited by 19
Self-citation(2024) · doi:10.1016/j.psychres.2024.115926 · Cited by 15
Associations between adipokines and atrial fibrillation: A systematic review and meta-analysis
Agbaedeng, T. A., Zacharia, A. L., Iroga, P. E., Rathnasekara, V. M., Munawar, D. A., Bursill, C. A., & Noubiap, J. J. (2022) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2022.01.019 · Cited by 17
ADHD in narcolepsy: A closer look at prevalence and ties
Ren, J., Zhao, X., Su, C., Li, X., & Zhou, J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105471 · Cited by 16
Adipokines and stroke: A systematic review and meta‐analysis of disease risk and patient outcomes
Agbaedeng, T. A., Iroga, P. E., Rathnasekara, V. M., & Zacharia, A. L. (2024) · Obesity Reviews · doi:10.1111/obr.13684 · Cited by 20
“18,19 Next, calculated RR and 95% CI were pooled in a meta-analysis.”
MethodViscosupplementation for Osteoarthritis of the Knee
Jüni, P., Rutjes, A. W., da Costa, B. R., & Reichenbach, S. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-1-201301010-00020 · Cited by 15
Self-citationZanoli, L., Boutouyrie, P., Lentini, P. L. M., Rastelli, S., & Castellino, P. (2017) · Journal of Hypertension · doi:10.1097/hjh.0000000000001235 · Cited by 15
“Consecutively, we calculated the standardized mean difference of the cf-PWV between controls and IBD enrolled in each study and use it to calculate the natural log odds ratio (ln OR) using the Hasselblad and Hedges’ method [9].”
MethodYuan, Y., Huang, L., Yu, L., Yan, X., Chen, S., Bi, C., He, J., Zhao, Y., Liu, Y., Li, N., et al. (2024) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.3789 · Cited by 18
“16,17 Our primary method is the random effects model, as it includes both intra ‐ study and inter ‐ study components of variance.”
MethodEffect of a Novel Photoelectrochemical Oxidation Air Purifier on Nasal and Ocular Allergy Symptoms
Rao, N. G., Kumar, A., Wong, J. S., Shridhar, R., & Goswami, D. Y. (2018) · Allergy & Rhinology · doi:10.1177/2152656718781609 · Cited by 16
“For the ease of interpretation, summary measures from continuous data were converted into odds ratio along with 95% CI.(15) The statistical significance was set at P< .”
MethodVille, A., McRae, R., Nomchong, J., Reidlinger, D. P., Davidson, A. R., Staudacher, H. M., & Albarqouni, L. (2025) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.70106 · Cited by 16
“SMDs were calculated for continuous outcomes and were converted into OR to homogenise data for meta ‐ analysis, employing the method proposed by Hasselblad and Hedges [34].”
Systematic Reviews and Cancer Research: a Suggested Stepwise Approach
Kelley, G. A., & Kelley, K. S. (2018) · BMC Cancer · doi:10.1186/s12885-018-4163-6 · Cited by 13
Siafis, S., McCutcheon, R. A., Chiocchia, V., Ostinelli, E. G., Wright, S. L., Stansfield, C., Juma, D. O., Mantas, I., Howes, O. D., Rutigliano, G., et al. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.19866.1 · Cited by 11
“When outcomes can be reported with both continuous and dichotomous measures (see “Data extraction”), we will also consider transforming odds ratios to continuous measures (e.g., SMDs) using the Hasselblad and Hedges method in order to allow a more comprehensive synthesis of the evidence 75–77 .”
MethodDevji, T., Johnston, B. C., Patrick, D. L., Bhandari, M., Thabane, L., & Guyatt, G. H. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-017138 · Cited by 11
Self-citationBehavioural activation therapies for depression in adults
Uphoff, E., Ekers, D., Dawson, S., Richards, D. A., & Churchill, R. C. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013305 · Cited by 13
Meister, R., von Wolff, A., & Kriston, L. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.02.006 · Cited by 11
“Beyond statistical theory and simulation studies, however, empirical evaluation in real-world data sets is needed [11].”
BackgroundMethodInfluentialMickenautsch, S., & Yengopal, V. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132246 · Cited by 8
Antares, J. B., Jones, M., Chak, N. T. N., Chi, Y., Li, H., Li, M., Chan, E. Y. W., Chen, T. M. K., Lee, C., & Urquhart, D. M. (2025) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-025-08407-3 · Cited by 7
“[62] Sum-mary SMD from one meta-analysis was interpreted using Cohen’s effect sizes (small, medium, large).”
Metadata
- Authors
- da Costa, B. R., Rutjes, A. W., Johnston, B. C., Reichenbach, S., Nüesch, E., Tonia, T., Gemperli, A., Guyatt, G. H., & Jüni, P.
- Affiliations
- University of Bern (CH)
- Corresponding author
- Jüni, Peter
- ORCID
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-10
- Volume
- 41
- Issue
- 5
- Pages
- 1445-1459
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2113028645
- Cited by
- 145
- References
- 34
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 15 · 2023: 8 · 2022: 14 · 2021: 13 · 2020: 16 · 2019: 12 · 2018: 8 · 2017: 12 · 2016: 6 · 2015: 7 · 2014: 8 · 2013: 11 · 2012: 1
- FWCI
- 9.82
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Journal of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- reroDoc Digital Library (submittedVersion)
- BORIS (University Library Bern) (submittedVersion, other-oa)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- HighWire Press Open Archive (submittedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (submittedVersion)
- Open Access CRIS of the University of Bern
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- number needed to treat, standardized mean difference, conversion method, continuous outcomes, treatment response, pain, meta-epidemiology, measurement agreement
- MeSH terms
- Clinical Trials as Topic, Data Interpretation, Statistical, Humans, Research Design, Odds Ratio, Pain Management, Numbers Needed To Treat
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.