The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy
Abstract
BACKGROUND: Despite the great possibility of publication bias in studies of diagnostic test research, empirical studies about publication bias have mainly focused on studies of treatment effect. METHODS: A sample of 28 meta-analyses of diagnostic accuracy was selected from the Database of Abstracts of Reviews of Effectiveness (DARE). Methods used to deal with publication and related biases in these meta-analyses were examined. Asymmetry of funnel plot of estimated test accuracy against corresponding precision for each meta-analysis was assessed by three statistical methods: rank correlation method, regression analysis, and Trim and Fill method. RESULTS: In reviews of diagnostic accuracy, there was a general lack of consideration of appropriate literature searching to minimize publication bias, and the impact of possible publication bias has not been systematically assessed. The results of the three different statistical methods consistently showed that in a large proportion of the 28 meta-analyses evaluated, the smaller studies were associated with a greater diagnostic accuracy. Exploratory analyses found that the fewer the literature databases searched, the greater the funnel plot asymmetry in meta-analyses. Funnel plot asymmetry tended to be greater in meta-analyses that included smaller number of primary studies. Our data revealed no consistent relationship between funnel plot asymmetry and language restriction in reviews. CONCLUSIONS: Further research is required to explain why smaller studies tended to report greater test accuracy in a large proportion of meta-analyses of diagnostic tests. In systematic reviews of diagnostic studies, literature search should be sufficiently comprehensive and possible impact of publication bias should be assessed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Summing up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Summing Up: The Science of Reviewing Research
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,427
Empirical assessment of effect of publication bias on meta-analyses
Sutton, A. J. (2000) · BMJ · doi:10.1136/bmj.320.7249.1574 · Cited by 1,398
Self-citation
Cited by
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
“First, a systematic review of diagnostic accuracy studies, like any other review, is threatened by publication bias [43].”
BackgroundSystematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
“We examined publication and small study bias using Begg’s funnel plots of log diagnostic ORs versus the inverse of the variance.(10,20)”
MethodPorter, M., & Haslam, N. (2005) · JAMA · doi:10.1001/jama.294.5.602 · Cited by 1,793
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
Dissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039
Self-citationTang, B. M., Eslick, G. D., Craig, J. C., & McLean, A. S. (2007) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(07)70052-x · Cited by 851
Manea, L., Gilbody, S., & McMillan, D. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.09.009 · Cited by 795
Hunter, J. P., Saratzis, A., Sutton, A. J., Boucher, R. H., Sayers, R. D., & Bown, M. J. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.03.003 · Cited by 786
Self-citationKirchheiner, J., Nickchen, K., Bauer, M., Wong, M.-L., Licinio, J., Roots, I., & Brockmöller, J. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001494 · Cited by 724
Talwalkar, J. A., Kurtz, D. M., Schoenleber, S. J., West, C. P., & Montori, V. M. (2007) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2007.07.020 · Cited by 523
Umer, A., Kelley, G. A., Cottrell, L. E., Giacobbi, P., Innes, K. E., & Lilly, C. L. (2017) · BMC Public Health · doi:10.1186/s12889-017-4691-z · Cited by 515
Duijts, S. F. A., Faber, M. M., Oldenburg, H. S. A., van Beurden, M., & Aaronson, N. K. (2011) · Psycho-Oncology · doi:10.1002/pon.1728 · Cited by 452
Romagnuolo, J., Bardou, M., Rahme, E., Joseph, L., Reinhold, C., & Barkun, A. N. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-139-7-200310070-00006 · Cited by 445
van Enst, W. A., Ochodo, E., Scholten, R. J., Hooft, L., & Leeflang, M. M. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-70 · Cited by 429
Youssef, M. A., Van der Veen, F., Al-Inany, H. G., Mochtar, M. H., Griesinger, G., Nagi Mohesen, M., Aboulfoutouh, I., & van Wely, M. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008046.pub4 · Cited by 426
Pai, M., Flores, L. L., Pai, N., Hubbard, A., Riley, L. W., & Colford, J. M. (2003) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(03)00772-2 · Cited by 384
Systematic Evaluation and Comparison of Statistical Tests for Publication Bias
Hayashino, Y., Noguchi, Y., & Fukui, T. (2005) · Journal of Epidemiology · doi:10.2188/jea.15.235 · Cited by 379
Met, R., Bipat, S., Legemate, D. A., Reekers, J. A., & Koelemay, M. J. W. (2009) · JAMA · doi:10.1001/jama.301.4.415 · Cited by 379
Goodacre, S., Sampson, F., Thomas, S., van Beek, E., & Sutton, A. (2005) · BMC Medical Imaging · doi:10.1186/1471-2342-5-6 · Cited by 376
Self-citationMeta-Analysis: Test Performance of Ultrasonography for Giant-Cell Arteritis
Karassa, F. B., Matsagas, M. I., Schmidt, W. A., & Ioannidis, J. P. A. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-5-200503010-00011 · Cited by 374
Moriarty, A. S., Gilbody, S., McMillan, D., & Manea, L. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.06.012 · Cited by 372
van der Paardt, M. P., Zagers, M. B., Beets-Tan, R. G. H., Stoker, J., & Bipat, S. (2013) · Radiology · doi:10.1148/radiol.13122833 · Cited by 372
Kim, K. W., Lee, J., Choi, S. H., Huh, J., & Park, S. H. (2015) · Korean Journal of Radiology · doi:10.3348/kjr.2015.16.6.1175 · Cited by 329
Pewsner, D., Jüni, P., Egger, M., Battaglia, M., Sundström, J., & Bachmann, L. M. (2007) · BMJ · doi:10.1136/bmj.39276.636354.ae · Cited by 328
D'Antonio, F., Iacovella, C., Palacios-Jaraquemada, J., Bruno, C. H., Manzoli, L., & Bhide, A. (2014) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.13327 · Cited by 324
Lee, A., Fan, L. T. Y., Gin, T., Karmakar, M. K., & Ngan Kee, W. D. (2006) · Anesthesia & Analgesia · doi:10.1213/01.ane.0000217211.12232.55 · Cited by 319
Honest, H., Bachmann, L. M., Gupta, J. K., Kleijnen, J., & Khan, K. S. (2002) · BMJ · doi:10.1136/bmj.325.7359.301 · Cited by 316
Self-citationSystematic Review of Computed Tomographic Angiography for Assessment of Carotid Artery Disease
Koelemay, M. J. W., Nederkoorn, P. J., Reitsma, J. B., & Majoie, C. B. (2004) · Stroke · doi:10.1161/01.str.0000141426.63959.cc · Cited by 316
How Effective are Pedagogical Agents for Learning? A Meta-Analytic Review
Schroeder, N. L., Adesope, O. O., & Gilbert, R. B. (2013) · Journal of Educational Computing Research · doi:10.2190/ec.49.1.a · Cited by 299
Cochrane diagnostic test accuracy reviews
Leeflang, M. M., Deeks, J. J., Takwoingi, Y., & Macaskill, P. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-82 · Cited by 292
Tsang, N. N. Y., So, H. C., Ng, K. Y., Cowling, B. J., Leung, G. M., & Ip, D. K. M. (2021) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(21)00146-8 · Cited by 287
Boland, G. W. L., Dwamena, B. A., Jagtiani Sangwaiya, M., Goehler, A. G., Blake, M. A., Hahn, P. F., Scott, J. A., & Kalra, M. K. (2011) · Radiology · doi:10.1148/radiol.11100569 · Cited by 282
Gupta, J. K., Chien, P. F. W., Voit, D., Clark, T. J., & Khan, K. S. (2002) · Acta Obstetricia et Gynecologica Scandinavica · doi:10.1034/j.1600-0412.2001.810902.x · Cited by 282
Self-citationSelman, T. J., Mann, C., Zamora, J., Appleyard, T.-L., & Khan, K. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.071124 · Cited by 254
Self-citationMoving from cognition to behavior: What the research says.
Johnson, R. E., Chang, C.-H., & Lord, R. G. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.381 · Cited by 193
Egger, M., Ebrahim, S., & Smith, G. D. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.1 · Cited by 160
Structural validity of the Insomnia Severity Index: A systematic review and meta-analysis
Manzar, M. D., Jahrami, H. A., & Bahammam, A. S. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101531 · Cited by 138
Analyzing cause and effect in environmental assessments: using weighted evidence from the literature
Norris, R. H., Webb, J. A., Nichols, S. J., Stewardson, M. J., & Harrison, E. T. (2012) · Freshwater Science · doi:10.1899/11-027.1 · Cited by 113
van Enst, W. A., Scholten, R. J. P. M., Whiting, P., Zwinderman, A. H., & Hooft, L. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.05.008 · Cited by 69
Toddler Screening for Autism Spectrum Disorder: A Meta-Analysis of Diagnostic Accuracy
Sánchez-García, A. B., Galindo-Villardón, P., Nieto-Librero, A. B., Martín-Rodero, H., & Robins, D. L. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-03865-2 · Cited by 66
Low Circulating Adiponectin Levels in Women with Polycystic Ovary Syndrome: An Updated Meta-Analysis
Li, S., Huang, X., Zhong, H., Peng, Q., Chen, S., Xie, Y., Qin, X., & Qin, A. (2014) · Tumor Biology · doi:10.1007/s13277-013-1595-0 · Cited by 58
Picalm rs3851179 variant confers susceptibility to alzheimer’s disease in chinese population
Liu, G., Xu, Y., Jiang, Y., Zhang, L., Feng, R., & Jiang, Q. (2017) · Molecular Neurobiology · doi:10.1007/s12035-016-9886-2 · Cited by 57
Preston, L., Carroll, C., Gardois, P., Paisley, S., & Kaltenthaler, E. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0074-7 · Cited by 32
Generalized synthesis of evidence and the threat of dissemination bias
Sutton, A. J., Abrams, K. R., & Jones, D. R. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00460-2 · Cited by 27
Self-citation
Metadata
- Authors
- Song, F., Khan, K. S., Dinnes, J., & Sutton, A. J.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-02
- Volume
- 31
- Issue
- 1
- Pages
- 88-95
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2099177143
- Cited by
- 484
- References
- 46
- FWCI
- 16.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.