The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy
Abstract
BACKGROUND: Despite the great possibility of publication bias in studies of diagnostic test research, empirical studies about publication bias have mainly focused on studies of treatment effect. METHODS: A sample of 28 meta-analyses of diagnostic accuracy was selected from the Database of Abstracts of Reviews of Effectiveness (DARE). Methods used to deal with publication and related biases in these meta-analyses were examined. Asymmetry of funnel plot of estimated test accuracy against corresponding precision for each meta-analysis was assessed by three statistical methods: rank correlation method, regression analysis, and Trim and Fill method. RESULTS: In reviews of diagnostic accuracy, there was a general lack of consideration of appropriate literature searching to minimize publication bias, and the impact of possible publication bias has not been systematically assessed. The results of the three different statistical methods consistently showed that in a large proportion of the 28 meta-analyses evaluated, the smaller studies were associated with a greater diagnostic accuracy. Exploratory analyses found that the fewer the literature databases searched, the greater the funnel plot asymmetry in meta-analyses. Funnel plot asymmetry tended to be greater in meta-analyses that included smaller number of primary studies. Our data revealed no consistent relationship between funnel plot asymmetry and language restriction in reviews. CONCLUSIONS: Further research is required to explain why smaller studies tended to report greater test accuracy in a large proportion of meta-analyses of diagnostic tests. In systematic reviews of diagnostic studies, literature search should be sufficiently comprehensive and possible impact of publication bias should be assessed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Summing up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Summing Up: The Science of Reviewing Research
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,427
Empirical assessment of effect of publication bias on meta-analyses
Sutton, A. J. (2000) · BMJ · doi:10.1136/bmj.320.7249.1574 · Cited by 1,398
Self-citationmeta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Bias in meta-analysis detected by a simple, graphical
Stuck, A. E., Rubenstein, L. Z., Wieland, D., Vandenbroucke, J. P., Irwig, L., Macaskill, P., Berry, G., Glasziou, P., Seagroatt, V., Stratton, I., et al. (1998) · BMJ · doi:10.1136/bmj.316.7129.469 · Cited by 699
Self-citationNoninvasive Diagnosis of Deep Venous Thrombosis
Kearon, C., Julian, J. A., Math, M., Newman, T. E., & Ginsberg, J. S. (1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-128-8-199804150-00011 · Cited by 690
Meta-analysis of Pap Test Accuracy
Fahey, M. T., Irwig, L., & Macaskill, P. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117485 · Cited by 684
Meta-analysis of screening and diagnostic tests.
Hasselblad, V., & Hedges, L. V. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.1.167 · Cited by 579
Bax, J. J., Wijns, W. C., Cornel, J. H., Visser, F. C., Boersma, E. H., & Fioretti, P. M. (1997) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(97)00352-5 · Cited by 554
Invited commentary: a critical look at some popular meta-analytic methods
Greenland, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117248 · Cited by 511
Meta-analytic methods for diagnostic test accuracy
Irwig, L., Macaskill, P., Glasziou, P., & Fahey, M. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00099-c · Cited by 467
Publication and Related Biases
Song, F., Eastwood, A., Gilbody, S., Duley, L., & Sutton, A. (2001) · The Advanced Handbook of Methods in Evidence Based Healthcare · doi:10.4135/9781848608344.n21 · Cited by 455
Self-citationInvestigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Misleading funnel plot for detection of bias in meta-analysis
Tang, J.-L., & Liu, J. L. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00204-8 · Cited by 420
Colposcopy for the diagnosis of squamous intraepithelial lesions: A meta-analysis
Mitchell, M. (1998) · Obstetrics & Gynecology · doi:10.1016/s0029-7844(98)00006-4 · Cited by 370
Wells, P. S., Lensing, A. W. A., Davidson, B. L., Prins, M. H., & Hirsh, J. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-1-199501010-00008 · Cited by 327
Radiological Evaluation of Lymph Node Metastases in Patients With Cervical Cancer: A Meta-analysis
Scheidler, J. (1997) · JAMA · doi:10.1001/jama.1997.03550130070040 · Cited by 320
Can the Clinical Examination Diagnose Left-Sided Heart Failure in Adults?
Badgett, R. G. (1997) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1997.03540450068038 · Cited by 248
Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased.
Irwig, L., Macaskill, P., Berry, G., & Glasziou, P. (1998) · PubMed Central · Cited by 240
Diagnosis of vascular catheter-related bloodstream infection: a meta-analysis
Siegman-Igra, Y., Anglim, A. M., Shapiro, D. E., Adal, K. A., Strain, B. A., & Farr, B. M. (1997) · Journal of Clinical Microbiology · doi:10.1128/jcm.35.4.928-936.1997 · Cited by 211
McManus, R. J., Wilson, S., Delaney, B. C., Fitzmaurice, D. A., Hyde, C. J., Tobias, R. S., Jowett, S., & Hobbs, F. D. R. (1998) · BMJ · doi:10.1136/bmj.317.7172.1562 · Cited by 185
The accuracy of serum chlamydial antibodies in the diagnosis of tubal pathology: a meta-analysis
Mol, B. W. J., Dijkman, B., Wertheim, P., Lijmer, J., van der Veen, F., & Bossuyt, P. M. M. (1997) · Fertility and Sterility · doi:10.1016/s0015-0282(97)81435-5 · Cited by 174
SILVA, O. D., OHLSSON, A., & KENYON, C. (1995) · The Pediatric Infectious Disease Journal · doi:10.1097/00006454-199505000-00005 · Cited by 170
Vamvakas, E. C. (1998) · PubMed · Cited by 164
Invited Commentary: Re: “A Critical Look at Some Popular Meta-Analytic Methods”
Olkin, I. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117249 · Cited by 115
The accuracy of C-reactive protein in diagnosing acute appendicitis—a meta-analysis
Hallan, S. I., & Åsberg, A. (1997) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.3109/00365519709084584 · Cited by 112
de Vries, S. O., Hunink, M. G. M., & Polak, J. F. (1996) · Academic Radiology · doi:10.1016/s1076-6332(96)80257-1 · Cited by 107
Magnetic resonance imaging of the knee: Diagnostic performance statistics
Mackenzie, R., Palmer, C. R., Lomas, D. J., & Dixon, A. K. (1996) · Clinical Radiology · doi:10.1016/s0009-9260(96)80341-2 · Cited by 107
THE VALIDITY OF THE MICHIGAN ALCOHOLISM SCREENING TEST (MAST)
Storgaard, H., Nielsen, S. D., & Gluud, C. N. (1994) · Alcohol and Alcoholism · doi:10.1093/oxfordjournals.alcalc.a045578 · Cited by 85
Evidence-based evaluation of three imaging methods for the temporomandibular disc.
Liedberg, J., Panmekiate, S., Petersson, A. R., & Rohlin, M. (1996) · Dentomaxillofacial Radiology · doi:10.1259/dmfr.25.5.9161176 · Cited by 80
Fecal screening tests in the approach to acute infectious diarrhea: a scientific overview
Huicho, L., Campos, M. A. L., Rivera, J., & Guerrant, R. L. (1996) · The Pediatric Infectious Disease Journal · doi:10.1097/00006454-199606000-00004 · Cited by 73
Radiological evaluation of lymph node metastases in patients with cervical cancer. A meta-analysis
Scheidler, J. E. (1997) · JAMA · doi:10.1001/jama.278.13.1096 · Cited by 70
Prediction of preterm delivery by fetal fibronectin: A meta-analysis
Faron, G., Boulvain, M., Irion, O., Bernard, P. M., & Fraser, W. D. (1998) · Obstetrics and Gynecology · doi:10.1016/s0029-7844(98)00067-2 · Cited by 59
Bonis, P. A., Ioannidis, J. P. A., Cappelleri, J. C., Kaplan, M. M., & Lau, J. (1997) · Hepatology · doi:10.1002/hep.510260436 · Cited by 58
Petticrew, M. P., Song, F., Wilson, P. M., & Wright, K. E. (1999) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462399015469 · Cited by 40
Self-citationMeta-analysis of screening data: a survey of the literature
Walter, S. D., & Jadad, A. R. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991230)18:24<3409::aid-sim377>3.0.co;2-8 · Cited by 26
Cited by
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
“First, a systematic review of diagnostic accuracy studies, like any other review, is threatened by publication bias [43].”
BackgroundSystematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
“We examined publication and small study bias using Begg’s funnel plots of log diagnostic ORs versus the inverse of the variance.(10,20)”
MethodPorter, M., & Haslam, N. (2005) · JAMA · doi:10.1001/jama.294.5.602 · Cited by 1,793
Metadata
- Authors
- Song, F., Khan, K. S., Dinnes, J., & Sutton, A. J.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-02
- Volume
- 31
- Issue
- 1
- Pages
- 88-95
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2099177143
- Cited by
- 484
- References
- 46
- FWCI
- 16.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.