Problems and Limitations in Conducting Systematic Reviews
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
This chapter contains section titled: Summary points Garbage in—garbage out? The dissemination of research findings Publication bias Other reporting biases The future of unbiased, systematic reviewing Acknowledgements
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Comprehensive geriatric assessment: a meta-analysis of controlled trials
Stuck, A. E., Siu, A. L., Wieland, G. D., Rubenstein, L. Z., & Adams, J. (1993) · The Lancet · doi:10.1016/0140-6736(93)92884-v · Cited by 1,974
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417
Self-citationPeer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
Self-citationMoher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027
Cited by
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationInvestigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225
Self-citationEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Self-citationWagenaar, A. C., Salois, M. J., & Komro, K. A. (2009) · Addiction · doi:10.1111/j.1360-0443.2008.02438.x · Cited by 1,127
Pjetursson, B. E., Brägger, U., Lang, N. P., & Zwahlen, M. (2007) · Clinical Oral Implants Research · doi:10.1111/j.1600-0501.2007.01439.x · Cited by 786
Savović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668
Webster, A. C., Woodroffe, R. C., Taylor, R. S., Chapman, J. R., & Craig, J. C. (2005) · BMJ · doi:10.1136/bmj.38569.471007.ae · Cited by 587
Burr, J., Mowatt, G., Hernández, R., Siddiqui, M., Cook, J., Lourenco, T., Ramsay, C., Vale, L., Fraser, C., Azuara-Blanco, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11410 · Cited by 549
Sterne, J. A. C., Jüni, P., Schulz, K. F., Altman, D. G., Bartlett, C., & Egger, M. (2002) · Statistics in Medicine · doi:10.1002/sim.1184 · Cited by 382
Self-citationWINQUIST, E., KIRCHNER, T. S., SEGAL, R., CHIN, J., LUKKA, H., & on behalf of the GENITOURINARY CANCER DISEASE SITE GROUP OF CANCER CARE ONTARIO PROGRAM IN EVIDENCE-BASED CARE PRACTICE GUIDELINES INITIATIVE (2004) · Journal of Urology · doi:10.1097/01.ju.0000090967.08622.33 · Cited by 358
Van Strydonck, D. A. C., Slot, D. E., Van der Velden, U., & Van der Weijden, F. (2012) · Journal of Clinical Periodontology · doi:10.1111/j.1600-051x.2012.01883.x · Cited by 353
A flipped classroom model in higher education: a review of the evidence across disciplines
Al-Samarraie, H., Shamsuddin, A., & Alzahrani, A. I. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-019-09718-8 · Cited by 301
Tacrolimus versus cyclosporin as primary immunosuppression for kidney transplant recipients
Webster, A. C., Taylor, R. R., Chapman, J. R., & Craig, J. C. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003961.pub2 · Cited by 286
Uses and abuses of meta-analysis
Egger, M., Smith, G. D., & Sterne, J. A. (2001) · Clinical Medicine · doi:10.7861/clinmedicine.1-6-478 · Cited by 255
Self-citationEUS vs MRCP for detection of choledocholithiasis
Verma, D., Kapadia, A., Eisen, G. M., & Adler, D. G. (2006) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2005.12.038 · Cited by 254
The new normal: The status quo of AI adoption in SMEs
Schwaeke, J., Peters, A., Kanbach, D. K., Kraus, S., & Jones, P. (2025) · Journal of Small Business Management · doi:10.1080/00472778.2024.2379999 · Cited by 241
Royle, P., & Waugh, N. (2003) · Health Technology Assessment · doi:10.3310/hta7340 · Cited by 194
Dale, O., & Hagen, K. B. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.04.005 · Cited by 191
Searching one or two databases was insufficient for meta-analysis of observational studies
Lemeshow, A. R., Blum, R. E., Berlin, J. A., Stoto, M. A., & Colditz, G. A. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.03.004 · Cited by 137
Nyssen, O. P., Taylor, S. J., Wong, G., Steed, E., Bourke, L., Lord, J., Ross, C. A., Hayman, S., Field, V., Higgins, A., et al. (2016) · Health Technology Assessment · doi:10.3310/hta20270 · Cited by 115
Bushman, B. J., Rothstein, H. R., & Anderson, C. A. (2010) · Psychological Bulletin · doi:10.1037/a0018718 · Cited by 104
Cunill, R., Castells, X., Tobias, A., & Capellà, D. (2013) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3473 · Cited by 70
Meta-analysis in medical research: Potentials and limitations
Zwahlen, M., Renehan, A., & Egger, M. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2006.12.001 · Cited by 70
“More details and specific references on these biases are available elsehere [73].”
BackgroundSelf-citationAustin, T. M., Richter, R. R., & Sebelski, C. A. (2014) · Physical Therapy · doi:10.2522/ptj.20130627 · Cited by 56
Williams, N. H., Hendry, M., Lewis, R., Russell, I., Westmoreland, A., & Wilkinson, C. (2007) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2007.01.008 · Cited by 54
The predictive validity of risk assessment tools for female offenders: A systematic review
Geraghty, K. A., & Woodhams, J. (2015) · Aggression and Violent Behavior · doi:10.1016/j.avb.2015.01.002 · Cited by 54
Psychological flexibility of parents of children with disabilities: A systematic literature review
Gur, A., & Reich, A. (2023) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2023.104490 · Cited by 44
Castells, X., Cunill, R., & Capellà, D. (2013) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-012-1390-7 · Cited by 41
Methodological issues arising from systematic reviews of the evidence of safety of vaccines
Price, D., Jefferson, T., & Demicheli, V (2004) · Vaccine · doi:10.1016/j.vaccine.2004.01.009 · Cited by 23
Wellard-Cole, L., Watson, W. L., Hughes, C., & Chapman, K. (2019) · Public Health Nutrition · doi:10.1017/s1368980018004081 · Cited by 13
“Similarly, the omission of citations can also result in a biased SLR((34)), as was the case found when reviewing the evidence relating to green tea catechins and caffeine and weight loss.”
BackgroundInfluentialSchucan Bird, K., & Tripney, J. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.48 · Cited by 13
“2011, 2 163–173 1 6 3 1 6 4 intervention), and so it is imperative to find all relevant research to minimize the threat to validity presented by a biased set of studies (Egger et al., 2001).”
BackgroundMeta-analysis and structured literature review in radiology1
Doria, A. S. (2005) · Academic Radiology · doi:10.1016/j.acra.2005.01.007 · Cited by 9
Metadata
- Authors
- Egger, M., Dickersin, K., & Smith, G. D.
- Venue
- Systematic Reviews in Health Care
- Publisher
- Wiley
- Published
- 2001-01
- Pages
- 43-68
- OpenAlex
- W1568115331
- Cited by
- 202
- References
- 24
- FWCI
- 3.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.