Meta-analysis, funnel plots and sensitivity analysis

Copas, J.

doi:10.1093/biostatistics/1.3.247

Cited by 503Meta-analysis and systematic reviewsStatistical Methods in Epidemiologyscientometrics and bibliometrics research

Meta-analysis, funnel plots and sensitivity analysis

Open access

Copas, J.·2000·Biostatistics

DOI 10.1093/biostatistics/1.3.247

Open this paper in CoChat — free account

Abstract

Publication bias is a major problem, perhaps the major problem, in meta-analysis (or systematic reviews). Small studies are more likely to be published if their results are 'significant' than if their results are negative or inconclusive, and so the studies available for review are biased in favour of those with positive outcomes. Correcting for this bias is not possible without making untestable assumptions. In this paper, a sensitivity analysis is suggested which is based on fitting a model to the funnel plot. Some examples are discussed.

Integrity signals

Registry

Crossref · 10.1093/biostatistics/1.3.247

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The possibility of publication bias was evaluated with funnel plots and Egger's tests.
“The possibility of publication bias was evaluated with funnel plots and Egger's tests.31, 32”
From Mindfulness‐based interventions for psychological and physical health outcomes in cancer patients and survivors: A systematic review and meta‐analysis of randomized controlled trials (2019) · cites this paper as [31]

Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · see citing works
A general parametric approach to the meta‐analysis of randomized clinical trials
Whitehead, A., & Whitehead, J. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101105 · Cited by 750 · see citing works
The accumulated evidence on lung cancer and environmental tobacco smoke
Hackshaw, A. K., Law, M. R., & Wald, N. (1997) · BMJ · doi:10.1136/bmj.315.7114.980 · Cited by 739 · see citing works
A note on graphical presentation of estimated odds ratios from several clinical trials
Galbraith, R. F. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070807 · Cited by 663 · see citing works
Passive smoking and the risk of coronary heart disease—a meta-analysis of epidemiologic studies
He, J., Vupputuri, S., Allen, K., Prerost, M. R., Hughes, J., & Whelton, P. K. (1999) · New England Journal of Medicine · doi:10.1056/nejm199903253401204 · Cited by 616 · see citing works
Bayesian approaches to random-effects meta-analysis: a comparative study
Smith, T. C., Spiegelhalter, D. J., & Thomas, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142408 · Cited by 568 · see citing works
Selection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 388 · see citing works
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359 · see citing works
Estimation of effect size under nonrandom sampling: the effects of censoring studies yielding statistically insignificant mean differences
Hedges, L. V. (1984) · Journal of Educational Statistics · doi:10.3102/10769986009001061 · Cited by 241 · see citing works
An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis
Dear, K., & Begg, C. (1992) · Statistical Science · doi:10.1214/ss/1177011363 · Cited by 202 · see citing works
What Works?: Selectivity Models and Meta-Analysis
Copas, J. B. (1999) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/1467-985x.00123 · Cited by 168 · see citing works
Self-citation
Publication bias in meta-analysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate
Givens, G. H., Smith, D. D., & Tweedie, R. L. (1997) · Statistical Science · doi:10.1214/ss/1030037958 · Cited by 127 · see citing works
Reanalysis of epidemiological evidence on lung cancer and passive smoking
Copas, J. B. (2000) · BMJ · doi:10.1136/bmj.320.7232.417 · Cited by 60 · see citing works
Self-citation
Hierarchical Selection Models With Applications in Meta-Analysis
Silliman, N. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474047 · Cited by 47 · see citing works
A Bayesian hierarchical model for multi-level repeated ordinal data: analysis of oral practice examinations in a large anaesthesiology training programme
Tan, M. T., Qu, Y., Mascha, E. J., & Schubert, A. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990815)18:15 · Cited by 26 · see citing works
Nonparametric classes of weight functions to model publication bias
Silliman, N. (1997) · Biometrika · doi:10.1093/biomet/84.4.909 · Cited by 20 · see citing works
Discussion of Copas, J.B. and LI, H.G.: inference for non-random samples
Molenberghs, G. (1997) · Document Server@UHasselt (UHasselt) · Cited by 11 · see citing works

Flagged first, then by citations

Sorted by citations

Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · see citing works
Perceived organizational support: a meta-analytic evaluation of organizational support theory.
Kurtessis, J. N., Eisenberger, R., Ford, M. T., Buffardi, L. C., Stewart, K. A., & Adis, C. S. (2017) · Journal of Management · doi:10.1177/0149206315575554 · Cited by 2,354 · see citing works
Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2007) · Statistics in Medicine · doi:10.1002/sim.2889 · Cited by 716 · see citing works
Efficacy of internet-delivered cognitive-behavioral therapy for insomnia— a systematic review and meta-analysis of randomized controlled trials
Zachariae, R., Lyby, M. S., Ritterband, L. M., & O'Toole, M. S. (2016) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2015.10.004 · Cited by 704 · see citing works
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847196 · Cited by 588 · see citing works
Exercise interventions for the treatment of chronic low back pain: a systematic review and meta-analysis of randomised controlled trials
Searle, A., Spink, M., Ho, A., & Chuter, V. (2015) · Clinical Rehabilitation · doi:10.1177/0269215515570379 · Cited by 555 · see citing works
Using network meta‐analysis to evaluate the existence of small‐study effects in a network of interventions
Chaimani, A., & Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.57 · Cited by 521 · see citing works
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461 · see citing works
Missing-Data Methods for Generalized Linear Models
Ibrahim, J. G., Chen, M., Lipsitz, S. R., & Herring, A. H. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001844 · Cited by 471 · see citing works
Early versus late tracheostomy for critically ill patients
Andriolo, B. N., Andriolo, R. B., Saconato, H., Atallah, Á. N., & Valente, O. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007271.pub3 · Cited by 467 · see citing works
Soil biota contributions to soil aggregation
Lehmann, A., Zheng, W., & Rillig, M. C. (2017) · Nature Ecology & Evolution · doi:10.1038/s41559-017-0344-y · Cited by 464 · see citing works
Arcsine test for publication bias in meta‐analyses with binary outcomes
Rücker, G., Schwarzer, G., & Carpenter, J. R. (2007) · Statistics in Medicine · doi:10.1002/sim.2971 · Cited by 444 · see citing works
Indoor residential chemical emissions as risk factors for respiratory and allergic effects in children: a review
Mendell, M. J. (2007) · Indoor Air · doi:10.1111/j.1600-0668.2007.00478.x · Cited by 438 · see citing works
Effect of Psychological Intervention on Fear of Cancer Recurrence: A Systematic Review and Meta-Analysis.
Tauber, N. M., O’Toole, M. S., Dinkel, A., Galica, J., Humphris, G., Lebel, S., Maheu, C., Ozakinci, G., Prins, J., Sharpe, L., et al. (2019) · Journal of Clinical Oncology · doi:10.1200/jco.19.00572 · Cited by 402 · see citing works
Multiple factors influence the role of arbuscular mycorrhizal fungi in soil aggregation—a meta-analysis
Leifheit, E. F., Veresoglou, S. D., Lehmann, A., Morris, E. K., & Rillig, M. C. (2013) · Plant and Soil · doi:10.1007/s11104-013-1899-2 · Cited by 391 · see citing works
Efficacy of psychosocial interventions for psychological and pregnancy outcomes in infertile women and men: a systematic review and meta-analysis
Frederiksen, Y., Farver-Vestergaard, I., Skovgård, N. G., Ingerslev, H. J., & Zachariae, R. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006592 · Cited by 380 · see citing works
Arbuscular mycorrhizal fungi increase grain yields: a meta‐analysis
Zhang, S., Lehmann, A., Zheng, W., You, Z., & Rillig, M. C. (2018) · New Phytologist · doi:10.1111/nph.15570 · Cited by 357 · see citing works
Mindfulness‐based interventions for psychological and physical health outcomes in cancer patients and survivors: A systematic review and meta‐analysis of randomized controlled trials
Cillessen, L., Johannsen, M., Speckens, A. E. M., & Zachariae, R. (2019) · Psycho-Oncology · doi:10.1002/pon.5214 · Cited by 326 · see citing works
“A previous meta‐analysis of MBSR and MBCT for breast cancer patients did find small but significant effects of these interventions on health‐related QoL in general.12 Possibly, MBIs target general health‐related QoL and not specifically cancer‐related QoL.”
BackgroundInfluential
An overview of meta-analysis for clinicians
Lee, Y. H. (2017) · The Korean Journal of Internal Medicine · doi:10.3904/kjim.2016.195 · Cited by 294 · see citing works
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rücker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. C. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 284 · see citing works
Arbuscular mycorrhizal contribution to copper, manganese and iron nutrient concentrations in crops – A meta-analysis
Lehmann, A., & Rillig, M. C. (2014) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2014.11.013 · Cited by 290 · see citing works
Grading the strength of a body of evidence when assessing health care interventions: an EPC update
Berkman, N. D., Lohr, K. N., Ansari, M. T., Balk, E. M., Kane, R., McDonagh, M., Morton, S. C., Viswanathan, M., Bass, E. B., Butler, M., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.023 · Cited by 279 · see citing works
A sensitivity analysis for publication bias in systematic reviews
Copas, J. B., & Shi, J. Q. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000402 · Cited by 260 · see citing works
Self-citation
Systematic Review and Meta-Analysis of Association of Smokeless Tobacco and of Betel Quid without Tobacco with Incidence of Oral Cancer in South Asia and the Pacific
Gupta, B., & Johnson, N. W. (2014) · PLoS ONE · doi:10.1371/journal.pone.0113385 · Cited by 257 · see citing works
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2014) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 252 · see citing works
Quantifying the risk of error when interpreting funnel plots
Simmonds, M. C. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0004-8 · Cited by 251 · see citing works
Arbuscular mycorrhizal influence on zinc nutrition in crop plants – A meta-analysis
Lehmann, A., Veresoglou, S. D., Leifheit, E. F., & Rillig, M. C. (2013) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2013.11.001 · Cited by 249 · see citing works
Prevalence of depression and burden among informal care-givers of people with dementia: a meta-analysis
Collins, R. N., & Kishita, N. (2020) · Ageing and Society · doi:10.1017/s0144686x19000527 · Cited by 244 · see citing works
Bivariate random-effects meta-analysis and the estimation of between-study correlation
Riley, R. D., Abrams, K. R., Sutton, A. J., Lambert, P. C., & Thompson, J. R. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-3 · Cited by 243 · see citing works
Graphical displays for meta-analysis: An overview with suggestions for practice
Anzures‐Cabrera, J., & Higgins, J. P. T. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.6 · Cited by 233 · see citing works
Limitations of PET-PEESE and Other Meta-Analysis Methods
Stanley, T. D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693062 · Cited by 229 · see citing works
Psychological interventions for grief in adults: a systematic review and meta-analysis of randomized controlled trials
Johannsen, M., Damholdt, M. F., Zachariae, R., Lundorff, M., Farver-Vestergaard, I., & O'Connor, M. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.04.065 · Cited by 214 · see citing works
Publication bias in meta‐analyses from the Cochrane Database of Systematic Reviews
Kiciński, M., Springate, D. A., & Kontopantelis, E. (2015) · Statistics in Medicine · doi:10.1002/sim.6525 · Cited by 214 · see citing works
Understanding Meta-Analysis: A Review of the Methodological Literature
Shelby, L. B., & Vaske, J. J. (2008) · Leisure Sciences · doi:10.1080/01490400701881366 · Cited by 218 · see citing works
A meta-analysis of arbuscular mycorrhizal effects on plants grown under salt stress
Chandrasekaran, M., Boughattas, S., Hu, S., Oh, S.-H., & Sa, T. (2014) · Mycorrhiza · doi:10.1007/s00572-014-0582-7 · Cited by 200 · see citing works
The Perils of Misinterpreting and Misusing “Publication Bias” in Meta-analyses: An Education Review on Funnel Plot-Based Methods
Afonso, J. R., Ramírez‐Campillo, R., Clemente, F. M., Büttner, F., & Andrade, R. (2023) · Sports Medicine · doi:10.1007/s40279-023-01927-9 · Cited by 213 · see citing works
A systematic review and meta-analysis of long COVID symptoms
Natarajan, A., Shetty, A., Delanerolle, G., Zeng, Y., Zhang, Y., Raymont, V., Rathod, S., Halabi, S., Elliot, K., Shi, J. Q., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02250-0 · Cited by 190 · see citing works
Microplastics have shape- and polymer-dependent effects on soil aggregation and organic matter loss – an experimental and meta-analytical approach
Lehmann, A., Leifheit, E. F., Gerdawischke, M., & Rillig, M. C. (2021) · Microplastics and Nanoplastics · doi:10.1186/s43591-021-00007-x · Cited by 213 · see citing works
Is testosterone linked to human aggression? A meta-analytic examination of the relationship between baseline, dynamic, and manipulated testosterone on human aggression
Geniole, S. N., Bird, B. M., McVittie, J. S., Purcell, R. B., Archer, J. E., & Carré, J. M. (2019) · Hormones and Behavior · doi:10.1016/j.yhbeh.2019.104644 · Cited by 185 · see citing works
Confidence intervals for random effects meta-analysis and robustness to publication bias
Henmi, M., & Copas, J. B. (2010) · Statistics in Medicine · doi:10.1002/sim.4029 · Cited by 163 · see citing works
Self-citation
A historical review of publication bias
Marks‐Anglin, A., & Chen, Y. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1452 · Cited by 165 · see citing works
Two Meta-analyses Exploring the Relationship between Teacher Clarity and Student Learning
Titsworth, S., Mazer, J. P., Goodboy, A. K., Bolkan, S., & Myers, S. A. (2015) · Communication Education · doi:10.1080/03634523.2015.1041998 · Cited by 164 · see citing works
Meta-analysis of risk factors for cutaneous melanoma according to anatomical site and clinico-pathological variant
Caini, S., Gandini, S., Sera, F., Raimondi, S., Fargnoli, M. C., Boniol, M., & Armstrong, B. K. (2009) · European Journal of Cancer · doi:10.1016/j.ejca.2009.05.009 · Cited by 163 · see citing works
Platelets and extra-corporeal membrane oxygenation in adult patients: a systematic review and meta-analysis
Jiritano, F., Serraino, G. F., Cate, H. T., Fina, D., Matteucci, M., Mastroroberto, P., & Lorusso, R. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06031-4 · Cited by 159 · see citing works
Meta‐analysis: insulin sensitizers for the treatment of non‐alcoholic steatohepatitis
Rakoski, M. O., Singal, A. G., Rogers, M. A. M., & Conjeevaram, H. S. (2010) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2010.04467.x · Cited by 157 · see citing works
Prevalence, causes, and complications of cesarean delivery in Iran: A systematic review and meta-analysis
Rafiei, M., Naz, M. S. G., Akbari, M., Kiani, F., Sayehmiri, F., Sayehmiri, K., & Vafaee, R. (2018) · International Journal of Reproductive BioMedicine (IJRM) · doi:10.29252/ijrm.16.4.221 · Cited by 155 · see citing works
Probiotics for the Treatment of Atopic Dermatitis in Children: A Systematic Review and Meta-Analysis of Randomized Controlled Trials
Huang, R., Ning, H., Shen, M., Li, J., Zhang, J., & Chen, X. (2017) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2017.00392 · Cited by 154 · see citing works
Suicide before and during the COVID-19 Pandemic: A Systematic Review with Meta-Analysis
Yan, Y., Hou, J., Li, Q., & Yu, N. X. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043346 · Cited by 152 · see citing works
Influence of Psychological Stress on Upper Respiratory Infection—A Meta-Analysis of Prospective Studies
Pedersen, A., Zachariae, R., & Bovbjerg, D. H. (2010) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181f1d003 · Cited by 137 · see citing works
Effect of Early Versus Late Tracheostomy or Prolonged Intubation in Critically Ill Patients with Acute Brain Injury: A Systematic Review and Meta-Analysis
McCREDIE, V. A., Alali, A. S., Scales, D. C., Adhikari, N. K. J., Rubenfeld, G. D., Cuthbertson, B. H., & Nathens, A. B. (2016) · Neurocritical Care · doi:10.1007/s12028-016-0297-z · Cited by 137 · see citing works
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132 · see citing works
Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.05.008 · Cited by 133 · see citing works
Association between statin use and colorectal cancer risk: a meta-analysis of 42 studies
Liu, Y., Tang, W., Wang, J., Xie, L., Li, T., He, Y., Deng, Y., Peng, Q., Li, S., & Qin, X. Y. (2013) · Cancer Causes & Control · doi:10.1007/s10552-013-0326-6 · Cited by 129 · see citing works
Can We Reduce the Duration of Untreated Psychosis? A Systematic Review and Meta-Analysis of Controlled Interventional Studies
Oliver, D., Davies, C., Crossland, G., Lim, S., Gifford, G., McGuire, P., & Fusar-Poli, P. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx166 · Cited by 126 · see citing works
Telemedicine interventions for gestational diabetes mellitus: A systematic review and meta-analysis
Rasekaba, T. M., Furler, J., Blackberry, I., Tacey, M., Gray, K., & Lim, K. (2015) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2015.07.007 · Cited by 115 · see citing works
Adjustment for reporting bias in network meta-analysis of antidepressant trials
Trinquart, L., Chatellier, G., & Ravaud, P. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-150 · Cited by 122 · see citing works
Meta-analysis suggests that smoking is associated with an increased risk of early natural menopause
Sun, L., Tan, L., Yang, F., Luo, Y., Li, X., Deng, H., & Dvornyk, V. (2011) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0b013e318224f9ac · Cited by 122 · see citing works
Heterogeneity in meta-analyses: an unavoidable challenge worth exploring
Choi, G. J., & Kang, H. (2025) · Korean Journal of Anesthesiology · doi:10.4097/kja.25001 · Cited by 118 · see citing works
Grading the Strength of a Body of Evidence When Assessing Health Care Interventions for the Effective Health Care Program of the Agency for Healthcare Research and Quality: An Update
Berkman, N. D., Lohr, K. N., Ansari, M., McDonagh, M. S., Balk, E. M., Whitlock, E. P., Reston, J. T., Bass, E. B., Butler, M. E., Gartlehner, G., et al. (2013) · Europe PMC (PubMed Central) · Cited by 115 · see citing works
The efficacy of psychosocial intervention for pain in breast cancer patients and survivors: a systematic review and meta-analysis
Johannsen, M., Farver, I., Beck, N., & Zachariae, R. (2013) · Breast Cancer Research and Treatment · doi:10.1007/s10549-013-2503-4 · Cited by 113 · see citing works
Effect of aspirin and other non-steroidal anti-inflammatory drugs on prostate cancer incidence and mortality: a systematic review and meta-analysis
Liu, Y., Chen, J., Xie, L., Wang, J., Li, T., He, Y. L., Gao, Y., Qin, X. Y., & Li, S. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-55 · Cited by 108 · see citing works
Small-Study Effects in Meta-Analysis
Schwarzer, G., Carpenter, J., & Rücker, G. (2015) · Use R! · doi:10.1007/978-3-319-21416-0_5 · Cited by 105 · see citing works
Correcting for Publication Bias in a Meta-Analysis with the P-uniform* MethodPreprint
van Aert, R. C. M., & van Assen, M. A. L. M. (2018) · doi:10.31222/osf.io/zqjr9 · Cited by 108 · see citing works
Publication bias as a function of study characteristics.
Coburn, K. M., & Vevea, J. L. (2015) · Psychological Methods · doi:10.1037/met0000046 · Cited by 107 · see citing works
Early versus late tracheostomy for critically ill patients
Silva, B. N. G., Andriolo, R. B., Saconato, H., Atallah, Á. N., & Valente, O. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007271.pub2 · Cited by 104 · see citing works
Psychological stress and antibody response to influenza vaccination: A meta-analysis
Pedersen, A. F., Zachariae, R., & Bovbjerg, D. H. (2009) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2009.01.004 · Cited by 133 · see citing works
Review: Benzodiazepines in generalized anxiety disorder: heterogeneity of outcomes based on a systematic review and meta-analysis of clinical trials
Martín, J. L. R., Sainz-Pardo, M., Furukawa, T. A., Martín-Sánchez, E., Seoane, T. M., & Galan, C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077355 · Cited by 102 · see citing works
Eye tracking evidence of threat-related attentional bias in anxiety- and fear-related disorders: A systematic review and meta-analysis
Clauss, K. E., Gorday, J. Y., & Bardeen, J. R. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102142 · Cited by 102 · see citing works
Drug-metabolising enzyme polymorphisms and predisposition to anti-tuberculosis drug-induced liver injury: a meta-analysis.
Sun, F., Chen, Y., Xiang, Y., & Zhan, S. (2008) · PubMed · Cited by 100 · see citing works
Risk of Cardiovascular and Cerebrovascular Events in Polycystic Ovarian Syndrome Women: A Meta-Analysis of Cohort Studies
Zhang, J., Xu, J., Qu, Q.-Q., & Zhong, G.-Q. (2020) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2020.552421 · Cited by 97 · see citing works
Meta-analysis: implications of interleukin-28B polymorphisms in spontaneous and treatment-related clearance for patients with hepatitis C
Jiménez‐Sousa, M. Á., Fernández‐Rodríguez, A., Guzmán, M. G., García–Álvarez, M., & Resino, S. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-6 · Cited by 92 · see citing works
The role of probiotics in the prevention and treatment of atopic dermatitis in children: An updated systematic review and meta-analysis of randomized controlled trials
Jiang, W., Ni, B., Liu, Z., Liu, X., Xie, W., Wu, I. X. Y., & Li, X. (2020) · Pediatric Drugs · doi:10.1007/s40272-020-00410-6 · Cited by 91 · see citing works
Exploring and accounting for publication bias in mental health: a brief overview of methods
Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2013-101700 · Cited by 90 · see citing works
The effect of expressive writing intervention on psychological and physical health outcomes in cancer patients--a systematic review and meta-analysis
Zachariae, R., & O'Toole, M. S. (2015) · Psycho-Oncology · doi:10.1002/pon.3802 · Cited by 88 · see citing works
Meta-analysis of different test indicators: Helicobacter pylori infection and the risk of colorectal cancer
Zhao, Y., Wang, F., Chang, D. K., Han, B., & You, D. (2008) · International Journal of Colorectal Disease · doi:10.1007/s00384-008-0479-z · Cited by 87 · see citing works
Trade‐offs in carbon‐degrading enzyme activities limit long‐term soil carbon sequestration with biochar addition
Feng, J., Yu, D., Sinsabaugh, R. L., Moorhead, D., Andersen, M. N., Smith, P., Song, Y., Li, X., Huang, Q., Liu, Y., et al. (2023) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12949 · Cited by 89 · see citing works
Kidney Stones and Cardiovascular Risk: A Meta-analysis of Cohort Studies
Liu, Y., Li, S., Zeng, Z., Wang, J., Xie, L., Li, T., He, Y. L., Qin, X. Y., & Zhao, J. (2014) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2014.03.017 · Cited by 87 · see citing works
A fully Bayesian application of the Copas selection model for publication bias extended to network meta‐analysis
Mavridis, D., Sutton, A. J., Cipriani, A., & Salanti, G. (2012) · Statistics in Medicine · doi:10.1002/sim.5494 · Cited by 83 · see citing works
Interplay of soil water repellency, soil aggregation and organic carbon. A meta-analysis
Zheng, W., Morris, E. K., Lehmann, A., & Rillig, M. C. (2016) · Geoderma · doi:10.1016/j.geoderma.2016.07.025 · Cited by 86 · see citing works
Leptin as a Biomarker of Stress: A Systematic Review and Meta-Analysis
Bouillon‐Minois, J., Trousselard, M., Thivel, D., Benson, A. C., Schmidt, J., Moustafa, F., Bouvier, D., & Dutheil, F. (2021) · Nutrients · doi:10.3390/nu13103350 · Cited by 88 · see citing works
Vertebroplasty versus kyphoplasty in osteoporotic vertebral compression fracture: a meta-analysis of prospective comparative studies
Chang, X., Lv, Y., Chen, B., Li, C., Han, X. B., Yang, K., Zhang, W., Zhou, Y., & Li, C. (2014) · International Orthopaedics · doi:10.1007/s00264-014-2525-5 · Cited by 85 · see citing works
Improving the error rates of the Begg and Mazumdar test for publication bias in fixed effects meta-analysis
Gjerdevik, M., & Heuch, I. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-109 · Cited by 82 · see citing works
Increased lipid and lipoprotein concentrations in anorexia nervosa: A systematic review and meta‐analysis
Hussain, A. A., Hübel, C., Hindborg, M., Lindkvist, E. B., Kastrup, A. M., Yılmaz, Z., Støving, R. K., Bulik, C. M., & Sjögren, J. M. (2019) · International Journal of Eating Disorders · doi:10.1002/eat.23051 · Cited by 83 · see citing works
Efficacy of Psychosocial Interventions on Psychological and Physical Health Outcomes in Chronic Obstructive Pulmonary Disease: A Systematic Review and Meta-Analysis
Farver-Vestergaard, I., Jacobsen, D., & Zachariae, R. H. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000367635 · Cited by 81 · see citing works
Charting the landscape of graphical displays for meta-analysis and systematic reviews: a comprehensive review, taxonomy, and feature analysis
Kossmeier, M., Tran, U. S., & Voracek, M. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-0911-9 · Cited by 79 · see citing works
Effects of Plyometric Jump Training on the Reactive Strength Index in Healthy Individuals Across the Lifespan: A Systematic Review with Meta-analysis
Ramírez‐Campillo, R., Thapa, R. K., Afonso, J. R., Pérez‐Castilla, A., Bishop, C. J., Byrne, P. J., & Granacher, U. (2023) · Sports Medicine · doi:10.1007/s40279-023-01825-0 · Cited by 87 · see citing works
Patient Expectancy and Post-chemotherapy Nausea: A Meta-analysis
Colagiuri, B., & Zachariae, R. H. (2010) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9186-4 · Cited by 79 · see citing works
Effectiveness of pharmacist‐participated warfarin therapy management: a systematic review and meta‐analysis
Saokaew, S., Permsuwan, U., Chaiyakunapruk, N., Nathisuwan, S., & Sukonthasarn, A. (2010) · Journal of Thrombosis and Haemostasis · doi:10.1111/j.1538-7836.2010.04051.x · Cited by 78 · see citing works
A selection model for accounting for publication bias in a full network meta‐analysis
Mavridis, D., Welton, N. J., Sutton, A. J., & Salanti, G. (2014) · Statistics in Medicine · doi:10.1002/sim.6321 · Cited by 75 · see citing works
Aquatic Exercises in the Treatment of Low Back Pain
Shi, Z., Zhou, H., Lu, L., Pan, B., Wei, Z., Yao, X. X., Kang, Y., Liu, L., & Feng, S. (2017) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000000801 · Cited by 76 · see citing works
Equol Decreases Hot Flashes in Postmenopausal Women: A Systematic Review and Meta-Analysis of Randomized Clinical Trials
Daily, J. W., Ko, B., Ryuk, J., Liu, M., Zhang, W., & Park, S. (2018) · Journal of Medicinal Food · doi:10.1089/jmf.2018.4265 · Cited by 76 · see citing works
Open defecation-free slippage and its associated factors in Ethiopia: a systematic review
Abebe, T. A., & Tucho, G. T. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01511-6 · Cited by 75 · see citing works
The Prevalence of Mild, Moderate, and Severe Nomophobia Symptoms: A Systematic Review, Meta-Analysis, and Meta-Regression
Jahrami, H. A., Trabelsi, K., Boukhris, O., Hussain, J. H., Alenezi, A. F., Humood, A., Saif, Z., Pandi-Perumal, S., & Seeman, M. (2022) · Behavioral Science · doi:10.3390/bs13010035 · Cited by 68 · see citing works
Meta‐analysis for trend estimation
Shi, J. Q., & Copas, J. B. (2003) · Statistics in Medicine · doi:10.1002/sim.1595 · Cited by 69 · see citing works
Self-citation
Microbial stress priming: a meta‐analysis
Linares, D. R. A., Lehmann, A., & Rillig, M. C. (2016) · Environmental Microbiology · doi:10.1111/1462-2920.13223 · Cited by 68 · see citing works
Effects of Weapons on Aggressive Thoughts, Angry Feelings, Hostile Appraisals, and Aggressive Behavior: A Meta-Analytic Review of the Weapons Effect Literature
Benjamin, A. J., Kepes, S., & Bushman, B. J. (2017) · Personality and Social Psychology Review · doi:10.1177/1088868317725419 · Cited by 67 · see citing works
Pharmacogenetics of ACE Inhibitor-Induced Angioedema and Cough: a Systematic Review and Meta-Analysis
Mahmoudpour, S. H., Leusink, M., van der Putten, L., Terreehorst, I., Asselbergs, F. W., de Boer, A., & der Zee, A. H. M. (2013) · Pharmacogenomics · doi:10.2217/pgs.12.206 · Cited by 67 · see citing works
Effect of statin on risk of gynecologic cancers: A meta-analysis of observational studies and randomized controlled trials
Liu, Y., Qin, A., Li, T., Qin, X. Y., & Li, S. (2014) · Gynecologic Oncology · doi:10.1016/j.ygyno.2014.04.007 · Cited by 66 · see citing works
A Bound for Publication Bias Based on the Fraction of Unpublished Studies
Copas, J., & Jackson, D. (2004) · Biometrics · doi:10.1111/j.0006-341x.2004.00161.x · Cited by 70 · see citing works
Self-citation
Weighted Generalized Estimating Functions for Longitudinal Response and Covariate Data That Are Missing at Random
Chen, B., Yi, G. Y., & Cook, R. J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm08551 · Cited by 64 · see citing works

Authors: Copas, J.
Affiliations: University of Warwick (GB)
Corresponding author: Copas, J.
ORCID: Copas, J.
Venue: Biostatistics
Publisher: Oxford University Press (OUP)
Published: 2000-09-01
Volume: 1
Issue: 3
Pages: 247-262
ISSN: 1465-4644 (ISSN-L)
1468-4357
DOI: 10.1093/biostatistics/1.3.247
OpenAlex: W2111636520
Cited by: 503
References: 19
Citations by year: 2026: 36 · 2025: 42 · 2024: 32 · 2023: 31 · 2022: 42 · 2021: 42 · 2020: 42 · 2019: 21 · 2018: 19 · 2017: 34 · 2016: 24 · 2015: 23 · 2014: 24 · 2013: 16 · 2012: 12
FWCI: 2.54
Type: journal article
Language: en
Open access: green
doi.org
Locations: Biostatistics (publishedVersion)
PubMed (publishedVersion)
HighWire Press Open Archive (submittedVersion)
Newcastle University ePrints (Newcastle Univesity)
Biometrics
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
Keywords: publication bias, funnel plot, sensitivity analysis, meta-analysis, small-study effects, bias correction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Meta-analysis, funnel plots and sensitivity analysis

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks