The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Using network meta‐analysis to evaluate the existence of small‐study effects in a network of interventions
Abstract
Suggested methods for exploring the presence of small‐study effects in a meta‐analysis and the possibility of publication bias are associated with important limitations. When a meta‐analysis comprises only a few studies, funnel plots are difficult to interpret, and regression‐based approaches to test and account for small‐study effects have low power. Assuming that the cause of funnel plot asymmetry is likely to affect an entire research field rather than only a particular comparison of interventions, we suggest that network meta‐regression is employed to account for small‐study effects in a set of related meta‐analyses. We present several possible models for the direction and distribution of small‐study effects and we describe the methods by re‐analysing two published networks. Copyright © 2012 John Wiley & Sons, Ltd.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Potential small-study effects, including possible publication bias, were explored using ‘comparison-adjusted’ funnel plots.”
From The Effect of Different Psychological Interventions on Athletes' Competitive Anxiety: A Systematic Review and Bayesian Network Meta-Analysis. (2026) · cites this paper as [43]
In the citing paper
“We evaluated the presence of small-study effect (publication bias) by means of comparison-adjusted funnel plots [13].”
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. J. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,397
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Comparison of two methods to detect publication bias in meta-analysis.
Peters, J. L. (2006) · JAMA · doi:10.1001/jama.295.6.676 · Cited by 2,278
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053
Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
Cipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
Self-citationHealth Outcomes Associated With Various Antihypertensive Therapies Used as First-Line Agents
Psaty, B. M., Lumley, T., Furberg, C. D., Lovasi, G. S., Pahor, M., Alderman, M. H., & Weiss, N. S. (2003) · JAMA · doi:10.1001/jama.289.19.2534 · Cited by 1,096
Cited by
Sorted by citations
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Self-citationLeucht, S., Cipriani, A., Spineli, L., Mavridis, D., Örey, D., Richter, F., Samara, M., Barbui, C., Engel, R. R., Geddes, J. R., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60733-3 · Cited by 2,561
Self-citationGraphical tools for network meta-analysis in STATA
Chaimani, A., Higgins, J. P. T., Mavridis, D., Spyridonos, P., & Salanti, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076654 · Cited by 2,473
Self-citationCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
“• Empirical examination of patterns of results between small and large studies, using comparison-adjusted [35,36], regression [37], or selection [38] models, do not indicate that results from small studies differ from those in published studies.”
ResultSelf-citationEvaluating the quality of evidence from a network meta-analysis
Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099682 · Cited by 1,402
“The comparison-adjusted funnel plot in Figure 7 presents the centered ln (OR) for pairwise comparisons of a ‘reference’ treatment versus an active or newer or ‘experimental’ treatment [30].”
BackgroundMethodSelf-citationConceptual and technical challenges in network meta-analysis
Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-2-201307160-00008 · Cited by 1,072
“We can adjust for sponsoring in all comparisons, including the AC comparisons, as long as we can assume that any such bias is similar wherever it exists across all sponsored interventions (37–39).”
BackgroundSelf-citationPapakonstantinou, T., Nikolakopoulou, A., Higgins, J. P. T., Egger, M., & Salanti, G. (2020) · Campbell Systematic Reviews · doi:10.1002/cl2.1080 · Cited by 596
“” Completeness of the search, considerations related to the particular field (based on existing evidence and empirical studies), and statistical methods undertaken should inform the assessment of reporting bias for each relative treatment effect (Chaimani and Salanti, 2012; Mavridis, Sutton, Cipriani, & Salanti, 2013;…”
Self-citationSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Do, G., Hua, C., Mazaud, C., Droitcourt, C., Hughes, C., Ingram, J. R., Naldi, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub2 · Cited by 527
Self-citationFurukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521
“Given the strong small study effects in the comparison between CBT and WL, we ran two additional meta-regressions incorporating the assumption that there is such a bias favoring CBT over WL (30).”
MethodInfluentialnetmeta : An R Package for Network Meta-Analysis Using Frequentist Methods
Balduzzi, S., Rücker, G., Nikolakopoulou, A., Papakonstantinou, T., Salanti, G., Efthimiou, O., & Schwarzer, G. (2023) · Journal of Statistical Software · doi:10.18637/jss.v106.i02 · Cited by 532
“See Chaimani and Salanti (2012) for more details on specifying the order.”
Self-citationGe, L., Sadeghirad, B., Ball, G. D. C., da Costa, B. R., Hitchcock, C. L., Svendrovski, A., Kiflen, R., Quadri, K., Kwon, H. Y., Karamouzian, M., et al. (2020) · BMJ · doi:10.1136/bmj.m696 · Cited by 426
“29 Three sensitivity analyses were conducted by restricting studies to trials with individuals who were overweight or obese, but who were otherwise healthy; those with a low risk of bias; and investigator initiated randomised trials, thus removing trials that were funded partly or wholly by diet…”
MethodGetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
“…2003): Achana et al., (2013), Ades (2003), Ades et al. (2010), Caldwell et al. (2005, 2010, 2012), Carlin et al. (2013), Chaimani et al. (2013b), Chaimani and Salanti (2012), Cooper et al. (2009, 2011), Cope and Jansen (2013), Dakin et al. (2011), Del Giovane et al. (2013), Dewilde and Hawkins…”
MethodSelf-citationTsapas, A., Avgerinos, I., Karagiannis, T., Malandris, K., Manolopoulos, A., Andreadis, P., Liakos, A., Matthews, D. R., & Bekiari, E. (2020) · Annals of Internal Medicine · doi:10.7326/m20-0864 · Cited by 346
“The presence of small-study effects bias was assessed by means of comparison-adjusted funnel plots (21).”
MethodVisualizing Assumptions and Results in Network Meta-analysis: The Network Graphs Package
Chaimani, A., & Salanti, G. (2015) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1501500402 · Cited by 323
“In the absence of small-study effects, all studies are expected to lie symmetrically around the 0 line of the comparison-adjusted funnel plot (Chaimani et al. 2013a; Chaimani and Salanti 2012).”
Self-citationEfficacy, Acceptability, and Tolerability of Antipsychotics in Treatment-Resistant Schizophrenia
Samara, M. T., Dold, M., Gianatsi, M., Nikolakopoulou, A., Helfer, B., Salanti, G., & Leucht, S. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2955 · Cited by 305
Self-citationBighelli, I., Rodolico, A., García‐Mieres, H., Pitschel‐Walz, G., Hansen, W., Schneider‐Thoma, J., Siafis, S., Wu, H., Wang, D., Salanti, G., et al. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00243-1 · Cited by 344
Self-citationAssessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P. R., D’Alessandro, U., & Smith, C. T. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 275
“…2005; Bucher et al., 1997; Buti et al., 2011; Caldwell et al., 2005; Caldwell et al., 2007; Caldwell et al., 2010; Caldwell et al., 2012; Chaimani & Salanti, 2012; Chootrakool & Qing shi, 2008; Chung & Lumley, 2008; Cipriani et al., 2012; Cipriani et al., 2007; Coleman et al., 2012;…”
BackgroundMethodUndertaking network meta‐analyses
Chaimani, A., Caldwell, D. M., Li, T., Higgins, J. P. T., & Salanti, G. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch11 · Cited by 290
Self-citationHo, E. K.-Y., Chen, L., Simic, M., Ashton-James, C. E., Comachio, J., Wang, D. X. M., Hayden, J. A., Ferreira, M. L., & Ferreira, P. H. (2022) · BMJ · doi:10.1136/bmj-2021-067718 · Cited by 220
“50 We attempted to perform a sensitivity analysis by excluding studies with a sample size of less than 100; however, this process resulted in the exclusion of 53 (55”
MethodFurukawa, T. A., Salanti, G., Atkinson, L. Z., Leucht, S., Ruhe, H. G., Turner, E. H., Chaimani, A., Ogawa, Y., Takeshima, N., Hayasaka, Y., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010919 · Cited by 214
“We will also run network meta-regression models to detect associations between study size and effect size.(53) If an important association is found and publication bias is”
MethodSelf-citationTramacere, I., Giovane, C. D., Salanti, G., D’Amico, R., & Filippini, G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011381.pub2 · Cited by 218
Self-citationTang, H., Dai, Q., Shi, W., Zhai, S., Song, Y., & Han, J. (2017) · Diabetologia · doi:10.1007/s00125-017-4370-8 · Cited by 206
Yunusa, I. U., Alsumali, A., Garba, A. E., Regestein, Q. R., & Eguale, T. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.0828 · Cited by 215
Bighelli, I., Salanti, G., Huhn, M., Schneider‐Thoma, J., Krause, M., Reitmeir, C., Wallis, S., Schwermann, F., Pitschel‐Walz, G., Barbui, C., et al. (2018) · World Psychiatry · doi:10.1002/wps.20577 · Cited by 199
“77 We also applied a comparison adjusted forest plot (8), specifically developed for NMA.”
MethodSelf-citationTsapas, A., Karagiannis, T., Kakotrichi, P., Avgerinos, I., Mantsiou, C., Tousinas, G., Manolopoulos, A., Liakos, A., Malandris, K., Matthews, D. R., et al. (2021) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.14451 · Cited by 179
“Assessment of publication bias was carried out with comparisonadjusted funnel plots.(20)”
MethodImmunomodulators and immunosuppressants for multiple sclerosis: a network meta-analysis
Filippini, G., Giovane, C. D., Vacchi, L., D’Amico, R., Pietrantonj, C. D., Beecher, D., & Salanti, G. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008933.pub2 · Cited by 191
Self-citationNew generation antidepressants for depression in children and adolescents: a network meta-analysis
Hetrick, S. E., McKenzie, J. E., Bailey, A. P., Sharma, V., Moller, C. I., Badcock, P. B., Cox, G., Merry, S., & Meader, N. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013674.pub2 · Cited by 218
Efficacy and Safety of 8 Atropine Concentrations for Myopia Control in Children
Ha, A., Kim, S.-J., Shim, S. R., Kim, Y. K., & Jung, J. H. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2021.10.016 · Cited by 196
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Cleach, L. L. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub3 · Cited by 178
Self-citationSolmi, M., Wade, T. D., Byrne, S. M., Giovane, C. D., Fairburn, C. G., Ostinelli, E. G., Crescenzo, F. D., Johnson, C., Schmidt, U. H., Treasure, J. L., et al. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30566-6 · Cited by 194
“Publication bias was measured for primary outcomes by visual inspection of funnel plot and Egger’s test.(25)”
MethodSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Cleach, L. L. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub4 · Cited by 172
Self-citationPeri, A. M., Chatfield, M. D., Ling, W., Furuya‐Kanamori, L., Harris, P. N. A., & Paterson, D. L. (2024) · Clinical Infectious Diseases · doi:10.1093/cid/ciae234 · Cited by 182
“Publication bias was assessed using comparison-adjusted funnel plots [20].”
MethodTang, H., Li, D., Zhang, J. J., Hsu, Y., Wang, T., Zhai, S., & Song, Y. (2016) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12742 · Cited by 167
“In addition, a comparison-adjusted funnel plot was used to assess smallstudy effects within a network of interventions.(25)”
MethodChaimani, A., Caldwell, D. M., Li, T., Higgins, J. P. T., & Salanti, G. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.015 · Cited by 162
“We will also run network me ta-regression models to detect associations between study size and effect size (80).”
BackgroundMethodSelf-citationRodolico, A., Bighelli, I., Avanzato, C., Concerto, C., Cutrufelli, P., Mineo, L., Schneider-Thoma, J., Siafis, S., Signorelli, M. S., Wu, H., et al. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00437-5 · Cited by 186
Cipriani, A., Williams, T., Nikolakopoulou, A., Salanti, G., Chaimani, A., Ipser, J., Cowen, P. J., Geddes, J. R., & Stein, D. J. (2017) · Psychological Medicine · doi:10.1017/s003329171700349x · Cited by 155
“This finding might be due to publication bias or selective reporting bias, or might be the manifestation of other characteristics such as study quality (Chaimani & Salanti, 2012; Chaimani et al. 2013b).”
BackgroundSelf-citationKhaing, W., Vallibhakara, S. A.-O., Tantrakul, V., Vallibhakara, O., Rattanasiri, S., McEvoy, M., Attia, J., & Thakkinstian, A. (2017) · Nutrients · doi:10.3390/nu9101141 · Cited by 154
“In addition, small study effect for the whole network was assessed by constructing a comparison-adjusted funnel plot taking into account different comparisons [26].”
MethodSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Cleach, L. L. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub5 · Cited by 148
Self-citationΠετροπούλου, Μ., Nikolakopoulou, A., Veroniki, A. A., Rios, P. D. L., Vafaei, A., Zarin, W., Gianatsi, M., Sullivan, S. M., Tricco, A. C., Chaimani, A., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.002 · Cited by 138
Self-citationSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., Guelimi, R., García-Doval, I., Hua, C., Hughes, C., Naldi, L., Kinberger, M., Afach, S., & Cleach, L. L. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub6 · Cited by 139
Self-citationROB-MEN: a tool to assess risk of bias due to missing evidence in network meta-analysis
Chiocchia, V., Nikolakopoulou, A., Higgins, J. P. T., Page, M. J., Papakonstantinou, T., Cipriani, A., Furukawa, T. A., Siontis, G. C. M., Egger, M., & Salanti, G. (2021) · BMC Medicine · doi:10.1186/s12916-021-02166-3 · Cited by 129
Self-citationYildiz, A., Nikodem, M., Vieta, E., Correll, C. U., & Baldessarini, R. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714001305 · Cited by 128
“Finally, we explored presence of publication bias or small study effects with a funnel plot technique expanded to MTM (Moreno et al. 2009; Chaimani & Salanti, 2012).”
Methodde Zoete, R. M. J., Armfield, N. R., McAuley, J. H., Chen, K. S.-M., & Sterling, M. M. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102664 · Cited by 139
Gavriilidis, P., Roberts, K. J., Aldrighetti, L. A., & Sutcliffe, R. P. (2020) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2020.03.227 · Cited by 120
netmeta: Network Meta-Analysis using Frequentist Methods
Rücker, G., Krahn, U., König, J., Efthimiou, O., Davies, A. L., Papakonstantinou, T., & Schwarzer, G. (2013) · doi:10.32614/cran.package.netmeta · Cited by 117
Davies, C., Radua, J., Cipriani, A., Stahl, D., Provenzani, U., McGuire, P., & Fusar-Poli, P. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00187 · Cited by 107
Burschinski, A., Schneider‐Thoma, J., Chiocchia, V., Schestag, K., Wang, D., Siafis, S., Bighelli, I., Wu, H., Hansen, W., Priller, J., et al. (2023) · World Psychiatry · doi:10.1002/wps.21036 · Cited by 118
Self-citationMa, H., Lin, Y., Dai, L.-Z., Lin, C., Huang, Y., & Liu, S.-Y. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-061807 · Cited by 125
Karagiannis, T., Malandris, K., Avgerinos, I., Stamati, A., Kakotrichi, P., Liakos, A., Vasilakou, D., Kakaletsis, N., Tsapas, A., & Bekiari, E. (2024) · Diabetologia · doi:10.1007/s00125-024-06144-1 · Cited by 102
“We evaluated the presence of small-study effect (publication bias) by means of compari-son-adjusted funnel plots [13].”
Association of Umbilical Cord Management Strategies With Outcomes of Preterm Infants
Jasani, B., Torgalkar, R., Ye, X. Y., Syed, S., & Shah, P. S. (2021) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2021.0102 · Cited by 97
Wang, Y., Ye, Z., Ge, L., Siemieniuk, R. A. C., Wang, X., Wang, Y., Hou, L., Ma, Z., Agoritsas, T., Vandvik, P. O., et al. (2020) · BMJ · doi:10.1136/bmj.l6744 · Cited by 98
Management of people with early- or very early-stage hepatocellular carcinoma
Majumdar, A., Roccarina, D., Thorburn, D., Davidson, B. R., Tsochatzis, E. A., & Gurusamy, K. S. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011650.pub2 · Cited by 95
Maneiro, J. R., Souto, A., & Gómez-Reino, J. J. (2017) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2017.02.007 · Cited by 93
Efficacy, Safety, and Acceptability of Pharmacologic Treatments for Pediatric Migraine Prophylaxis
Locher, C., Kossowsky, J., Koechlin, H., Lam, T. L., Barthel, J., Berde, C. B., Gaab, J., Schwarzer, G., Linde, K., & Meißner, K. (2020) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2019.5856 · Cited by 95
Comparison of Amitriptyline and US Food and Drug Administration–Approved Treatments for Fibromyalgia
Farag, H., Yunusa, I. U., Goswami, H. H., Sultan, I., Doucette, J. A., & Eguale, T. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.12939 · Cited by 94
Sehmbi, H., Brull, R., Ceballos, K. R., Shah, U. J., Martin, J. E., Tobı́as, A., Solo, K., & Abdallah, F. W. (2020) · Anaesthesia · doi:10.1111/anae.15288 · Cited by 93
Akshintala, V. S., Weiland, C. J. S., Bhullar, F. A., Kamal, A., Kanthasamy, K. A., Kuo, A., Tomasetti, C., Gürakar, M., Drenth, J. P. H., Yadav, D. K., et al. (2021) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(21)00170-9 · Cited by 86
Chaimani, A., Vasiliadis, H. S., Pandis, N., Schmid, C. H., Welton, N. J., & Salanti, G. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dyt074 · Cited by 82
Self-citationThe efficacy of powered toothbrushes: A systematic review and network meta‐analysis
Thomassen, T. M. J. A., van der Weijden, G. A., & Slot, D. E. (2021) · International Journal of Dental Hygiene · doi:10.1111/idh.12563 · Cited by 90
Tang, H., Li, G., Zhao, Y. J., Wang, F., Gower, E. W., Shi, L., & Wang, T. (2018) · Diabetes Obesity and Metabolism · doi:10.1111/dom.13232 · Cited by 83
“Finally, a comparison-adjusted funnel plot was used to assess small study effects within a network of interventions.(24) We performed a regression analysis to examine the relationship between trial characteristics and effect size using the following factors: duration of diabetes, difference in change in glycaemic cont…”
MethodLinden, A., Best, L., Elise, F., Roberts, D., Branagan, A., Tay, Y. B. E., Crane, L., Cusack, J., Davidson, B., Davidson, I., et al. (2023) · Autism · doi:10.1177/13623613221117931 · Cited by 78
“…the risk of bias in the studies, sample size, or the control group used over time), we judged this reporting bias by the completeness of the search (Chaimani & Salanti, 2012) (i.e. identify completed but unpublished trials from the trial registry for which we are unable to obtain data from the…”
MethodEvaluation of Comparative Efficacy and Safety of Surgical Approaches for Total Hip Arthroplasty
Yan, L., Ge, L., Dong, S., Saluja, K., Li, D., Reddy, K. S., Wang, Q., Yao, L., Li, J. J., da Costa, B. R., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.53942 · Cited by 83
Sekercioglu, N., Thabane, L., Martinez, J. P. D., NESRALLAH, G. E., Longo, C. J., Busse, J. W., Akhtar‐Danesh, N., Agarwal, A., Khalifah, R. A. A., Iorio, A., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0156891 · Cited by 80
“Publication bias was considered undetected unless the effect measure was asymmetrically distributed around the pooled effect [24, 25].”
BackgroundBest, L. M., Freeman, S. C., Sutton, A. J., Cooper, N. J., Tng, E.-L., Csenar, M., Hawkins, N., Pavlov, C. S., Davidson, B. R., Thorburn, D., et al. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013103.pub2 · Cited by 79
“If there is no meaningful way in which to rank these studies (i.e. there was no specific change in the risk of bias in the studies, sample size, or the control group used over time), we will judge the reporting bias by the completeness of the search (Chaimani 2012).”
Wangdi, K., Furuya‐Kanamori, L., Clark, J. M., Barendregt, J. J., Gatton, M. L., Banwell, C. L., Kelly, G. C., Doi, S. A. R., & Clements, A. (2018) · Parasites & Vectors · doi:10.1186/s13071-018-2783-y · Cited by 81
“small-study effects, we expect the studies to form an inverted funnel centred at zero [33].”
BackgroundA selection model for accounting for publication bias in a full network meta‐analysis
Mavridis, D., Welton, N. J., Sutton, A. J., & Salanti, G. (2014) · Statistics in Medicine · doi:10.1002/sim.6321 · Cited by 75
“We re-analyzed the data from a network that has been recently used to illustrate the extension of the Copas model to multi-arm trials [24] and the use of network meta-regression to evaluate the existence of smallstudy effects [37].”
MethodSelf-citationFarhat, L. C., Behling, E., Landeros‐Weisenberger, A., Levine, J. L. S., de Barros, P. M. F., Wang, Z., & Bloch, M. H. (2022) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(22)00316-9 · Cited by 77
Zufferey, P. J., Chaux, R., Lachaud, P.-A., Capdevila, X., Lanoiselée, J., & Ollier, É. (2024) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.12.021 · Cited by 86
Pharmacological interventions for non-alcohol related fatty liver disease (NAFLD)
Lombardi, R., Onali, S., Thorburn, D., Davidson, B. R., Gurusamy, K. S., & Tsochatzis, E. A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011640.pub2 · Cited by 74
Tang, H., Fang, Z., Wang, T., Cui, W., Zhai, S., & Song, Y. (2016) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2016.08.061 · Cited by 73
New generation antidepressants for depression in children and adolescents: a network meta-analysis
Hetrick, S. E., Meader, N., Bailey, A. P., Badcock, P. B., Moller, C. I., Cox, G., Merry, S., & McKenzie, J. E. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013674 · Cited by 73
Yunitri, N., Chu, H., Kang, X. L., Wiratama, B. S., Lee, T., Chang, L., Liu, D., Kustanti, C. Y., Chiang, K., Chen, R., et al. (2023) · Psychological Medicine · doi:10.1017/s0033291722003737 · Cited by 77
“Ninik Yunitri et al. lower scores of DIC suggests a better model fit compared with the other NMA model (Chaimani & Salanti, 2012).”
ResultTang, H., Li, D., Zhang, J., Li, Y., Wang, T., Zhai, S., & Song, Y. (2017) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12917 · Cited by 72
“Finally, a comparison-adjusted funnel plot was used to assess small-study effects within a network of interventions, with symmetry around the summary effect line indicating the absence of small-study effects.(27)”
MethodCuijpers, P. J., Oud, M., Karyotaki, E., Noma, H., Quero, S., Cipriani, A., Arroll, B., & Furukawa, T. A. (2021) · The Annals of Family Medicine · doi:10.1370/afm.2676 · Cited by 77
Maintenance immunosuppression for adults undergoing liver transplantation: a network meta-analysis
Rodríguez‐Perálvarez, M., Misas, M. G., Thorburn, D., Davidson, B. R., Tsochatzis, E. A., & Gurusamy, K. S. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011639.pub2 · Cited by 70
Michopoulos, I., Furukawa, T. A., Noma, H., Kishimoto, S., Onishi, A., Ostinelli, E. G., Ciharova, M., Miguel, C., Karyotaki, E., & Cuijpers, P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.012 · Cited by 69
Wewege, M. A., Bagg, M. K., Jones, M. D., Ferraro, M. C., Cashin, A. G., Rizzo, R. R. N., Leake, H. B., Hagstrom, A. D., Sharma, S., McLachlan, A. J., et al. (2023) · BMJ · doi:10.1136/bmj-2022-072962 · Cited by 69
Hao, J., He, Z., Yu, X., & Remis, A. (2023) · Neurological Sciences · doi:10.1007/s10072-023-06742-8 · Cited by 68
Komolafe, O., Roberts, D. A., Freeman, S. C., Wilson, P., Sutton, A. J., Cooper, N. J., Pavlov, C. S., Milne, E., Hawkins, N., Cowlin, M., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013125.pub2 · Cited by 64
Planer, D., Yanko, S., Matok, I., Paltiel, O., Zmiro, R., Rotshild, V., Amir, O., Elbaz‐Greener, G., & Raccah, B. H. (2023) · Canadian Medical Association Journal · doi:10.1503/cmaj.220960 · Cited by 65
Comparison of First-Line Treatments for Patients With Extensive-Stage Small Cell Lung Cancer
Zhou, T., Zhang, Z., Luo, F., Zhao, Y., Hou, X., Liu, T., Wang, K., Zhao, H., Huang, Y., & Zhang, L. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.15748 · Cited by 60
Dong, S., Schneider-Thoma, J., Bighelli, I., Siafis, S., Wang, D., Burschinski, A., Schestag, K., Samara, M., & Leucht, S. (2024) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-023-01654-2 · Cited by 68
“…effects and publication bias for the primary outcome with funnel plots of pairwise meta-analysis if ten or more studies were included, as well as comparison-adjusted funnel plots [28, 29] ordering the antipsychotics from the newest to the oldest and from the best to the worst in efficacy [30].”
Kim, J. Y., Jang, M., Kim, D., Park, S., & Han, D. H. (2021) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2021.08.018 · Cited by 56
“7 (18-60) 24 96,600 IR SS Wang (2016)(39) China 25 R without A 6-14 12 NR SS, MS Xian (2020)(10) China 27 R with or without A 24.”
BackgroundInfluentialYe, Z., Wang, Y., Ge, L., Guyatt, G. H., Collister, D., Alhazzani, W. A., Bagshaw, S. M., Belley‐Côté, E. P., Fang, F., Hou, L., et al. (2021) · Critical Care Explorations · doi:10.1097/cce.0000000000000399 · Cited by 60
“We assessed small-study effects with a comparison-adjusted funnel plot of treatment estimates for each outcome (17).”
MethodPharmacological interventions for primary biliary cholangitis
Saffioti, F., Gurusamy, K. S., Eusebi, L. H., Tsochatzis, E. A., Davidson, B. R., & Thorburn, D. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011648.pub2 · Cited by 54
Comparative efficacy and safety of lipid-lowering agents in patients with hypercholesterolemia
Zhao, Z., Du, S., Shen, S., Luo, P., Ding, S., Wang, G., & Wang, L. (2019) · Medicine · doi:10.1097/md.0000000000014400 · Cited by 55
“Third, we utilized the design-by-treatment interaction model of Higgins and colleagues to check the consistency of the entire network.([31]) Network meta-regression was used to further evaluate the possible existence of small-study effects in network of interventions.”
MethodTsiami, A. P., Chaimani, A., Mavridis, D., Siskou, M., Assimakopoulos, E., & Sotiriadis, A. (2016) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.15900 · Cited by 53
Self-citationAssessing Confidence in the Results of Network Meta-Analysis (Cinema)Preprint
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Giovane, C. D., Egger, M., & Salanti, G. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/597047 · Cited by 49
“trial registries do not indicate important discrepancies with published reports 209 - Empirical examination of patterns of results between small and large studies, using the 210 comparison-adjusted funnel plot (31,32), regression models (33) or selection models 211 (34) do not indicate that results from small studies…”
ResultSelf-citationKiesswetter, E., Stadelmaier, J., Πετροπούλου, Μ., Morze, J., Grummich, K., Roux, I., Lay, R., Himmelsbach, L., Kussmann, M., Roeger, C., et al. (2023) · Advances in Nutrition · doi:10.1016/j.advnut.2023.03.004 · Cited by 49
“When the number of studies was more than 10, a comparison-adjusted funnel plot was drawn to assess publication bias and small study effects [38,39].”
MethodSalahuddin, N. H., Schütz, A., Pitschel‐Walz, G., Mayer, S. F., Chaimani, A., Siafis, S., Priller, J., Leucht, S., & Bighelli, I. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00136-6 · Cited by 48
Self-citationBonovas, S., Nikolopoulos, G. K., Lytras, T., Fiorino, G., Peyrin‐Biroulet, L., & Danese, S. (2017) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13456 · Cited by 49
Statin therapy on glycemic control in type 2 diabetic patients: A network meta-analysis
Cui, J. Y., Zhou, R., Han, S., Wang, T., Wang, L., & Xie, X. (2018) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/jcpt.12690 · Cited by 48
Medications for adults with type 2 diabetes: a living systematic review and network meta-analysis
Nong, K., Jeppesen, B. T., Shi, Q., Agoritsas, T., Guyatt, G. H., White, H., Gao, Y., Agarwal, A., Macdonald, H., Zou, X., et al. (2025) · BMJ · doi:10.1136/bmj-2024-083039 · Cited by 49
“…we assess publication bias from two sources: global publication bias reflecting network estimates, evaluated using comparison-adjusted funnel plots 29 ; and local publication bias reflecting each pairwise direct comparison, evaluated using Harbord’s score test for binary outcomes and Egger’s…”
Lifestyle modifications for nonalcohol-related fatty liver disease: a network meta-analysis
Buzzetti, E., Linden, A., Best, L. M., Madden, A. M., Roberts, D., Chase, T. J. G., Freeman, S. C., Cooper, N. J., Sutton, A. J., Fritche, D., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013156.pub2 · Cited by 46
Boutron, I., Chaimani, A., Devane, D., Meerpohl, J. J., Rada, G., Hróbjartsson, A., Tovey, D., Grasselli, G., & Ravaud, P. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013769 · Cited by 41
Self-citationBergman, H., Walker, D., Nikolakopoulou, A., Soares‐Weiser, K., & Adams, C. E. (2017) · Health Technology Assessment · doi:10.3310/hta21430 · Cited by 45
Jung, A., Eschke, R.-C., Struss, J., Taucher, W. K., & Luedtke, K. (2022) · Cephalalgia · doi:10.1177/03331024221082073 · Cited by 45
“An examination of publication bias using a comparisonadjusted funnel plot (17) and linear regression test of funnel plot asymmetry (Egger test) were considered if there were more than 10 studies included in NMA for each outcome (18).”
MethodLewis, S. R., Macey, R., Lewis, J., Stokes, J. R., Gill, J. R., Cook, J. A., Eardley, W., Parker, M. J., & Griffin, X. L. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013405.pub2 · Cited by 46
Avgerinos, I., Manolopoulos, A., Michailidis, T., Kitsios, K., Liakos, A., Karagiannis, T., Dimitrakopoulos, K., Matthews, D. R., Τσάπας, Α., & Bekiari, E. (2020) · Diabetes Obesity and Metabolism · doi:10.1111/dom.14291 · Cited by 44
“We investigated the presence of small-study effects for the primary outcome utilizing comparison-adjusted funnel plots.(19)”
MethodAdams, M., Gordt, K., Bongartz, M., Zimmermann, S., Seide, S., Braun, V., & Schwenk, M. (2023) · Sports Medicine - Open · doi:10.1186/s40798-023-00606-3 · Cited by 48
“We investigated the presence of small study effects using funnel plots for the outcomes of overall strength and balance together with Egger’s regression test [43].”
Method
Metadata
- Authors
- Chaimani, A., & Salanti, G.
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Salanti, Georgia
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2012-06
- Volume
- 3
- Issue
- 2
- Pages
- 161-176
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2121796373
- Cited by
- 521
- References
- 35
- Citations by year
- 2026: 59 · 2025: 48 · 2024: 55 · 2023: 59 · 2022: 50 · 2021: 60 · 2020: 58 · 2019: 37 · 2018: 28 · 2017: 29 · 2016: 17 · 2015: 4 · 2014: 8 · 2013: 7 · 2012: 2
- FWCI
- 8.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Research Synthesis Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- uropean Research Council (IMMA 260559)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- small-study effects, publication bias, network meta-regression, network meta-analysis, funnel plot asymmetry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
