Quality of Cochrane reviews: Assessment of sample from 1998.
Open accessAbstract
Abstract Objective: To assess the quality of Cochrane reviews. Design: Ten methodologists affiliated with the Cochrane Collaboration independently examined, in a semistructured way, the quality of reviews first published in 1998. Each review was assessed by two people; if one of them noted any major problems, they agreed on a common assessment. Predominant types of problem were categorised. Setting: Cyberspace collaboration coordinated from the Nordic Cochrane Centre. Studies: All 53 reviews first published in issue 4 of the Cochrane Library in 1998. Main outcome measure: Proportion of reviews with various types of major problem. Results: No problems or only minor ones were found in most reviews. Major problems were identified in 15 reviews (29%). The evidence did not fully support the conclusion in nine reviews (17%), the conduct or reporting was unsatisfactory in 12 reviews (23%), and stylistic problems were identified in 12 reviews (23%). The problematic conclusions all gave too favourable a picture of the experimental intervention. Conclusions: Cochrane reviews have previously been shown to be of higher quality and less biased on average than other systematic reviews, but improvement is always possible. The Cochrane Collaboration has taken steps to improve editorial processes and the quality of its reviews. Meanwhile, the Cochrane Library remains a key source of evidence about the effects of healthcare interventions. Its users should interpret reviews cautiously, particularly those with conclusions favouring experimental interventions and those with many typographical errors. What is already known on this topic Cochrane reviews are, on average, more systematic and less biased than systematic reviews published in paper journals Errors and biases also occur in Cochrane reviews What this study adds Too often, reviewers' conclusions over-rated the benefits of new interventions Readers of Cochrane reviews should remain cautious, especially regarding conclusions that favour new interventions The Cochrane Collaboration has taken steps to improve the quality of reviews
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Systematic reviewers sometimes do not consider harms equally as carefully as benefits.
“Systematic reviewers sometimes draw conclusions that are too optimistic [157] or do not consider the harms equally as carefully as the benefits, although some evidence suggests these problems are decreasing [158].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [157]
Systematic reviewers sometimes draw conclusions that are too optimistic.
“Systematic reviewers sometimes draw conclusions that are too optimistic [157] or do not consider the harms equally as carefully as the benefits, although some evidence suggests these problems are decreasing [158].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [157]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634 · see citing works
Users' guides to the medical literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 2,970 · see citing works
Systematic Reviews: Rationale for systematic reviews
Mulrow, C. D. (1994) · BMJ · doi:10.1136/bmj.309.6954.597 · Cited by 1,677 · see citing works
Antman, E. M. (1992) · JAMA · doi:10.1001/jama.268.2.240 · Cited by 1,535 · see citing works
The Medical Review Article: State of the Science
MULROW, C. D. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-485 · Cited by 856 · see citing works
Publication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818 · see citing works
Users' Guides to the Medical Literature
Oxman, A. D. (1994) · JAMA · doi:10.1001/jama.1994.03520170077040 · Cited by 813 · see citing works
Impact of covert duplicate publication on meta-analysis: a case study
Tramèr, M. R., Reynolds, D. J. M., Moore, R. A., & McQuay, H. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.635 · Cited by 702 · see citing works
Jadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534 · see citing works
Guidelines for reading literature reviews.
Oxman, A. D., & Guyatt, G. H. (1988) · Europe PMC (PubMed Central) · Cited by 492 · see citing works
Oxman, A. D. (1994) · JAMA · doi:10.1001/jama.272.17.1367 · Cited by 486 · see citing works
Systematic Reviews: Checklists for review articles
Oxman, A. D. (1994) · BMJ · doi:10.1136/bmj.309.6955.648 · Cited by 480 · see citing works
Cochrane Collaboration Handbook
Mulrow, C. (1996) · Medical Entomology and Zoology · Cited by 403 · see citing works
Gøtzsche, P. C. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90017-2 · Cited by 339 · see citing works
Self-citationPeer Review in Health Sciences
Godlee, F., & Jefferson, T. (1999) · DigitalGeorgetown (Georgetown University Library) · Cited by 264 · see citing works
Systematic reviews and meta-analyses on treatment of asthma: critical evaluation
Jadad, A. R. (2000) · BMJ · doi:10.1136/bmj.320.7234.537 · Cited by 257 · see citing works
Assessing the quality of reporting in meta-analyses of randomized controlled trials.
Shea, B. (1999) · Library and Archives Canada (Government of Canada) · doi:10.20381/ruor-16003 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- Yusuf S, Simon R, Ellenberg S, eds. Proceedings of "Methodologic issues in overviews of randomized clinical trials." Stat Med 1987;6:217-409.
- Oxman AD. Checklists for review articles. BMJ 1994;309:648-51.
- Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M. Methodology and reports of systematic reviews and meta-analyses. JAMA 1998;280:278-80.
- Shea B, Dubé C, Moher D. Assessing the quality of reports of systematic reviews and meta-analyses: A systematic review of checklists and scales [abstract]. VII Cochrane Colloquium, Rome, 5-9 October 1999:A40.
- Clarke M, Oxman AD, eds. Common errors in reaching conclusions. Cochrane reviewers' handbook 4.1.3, section 9.7. In: Cochrane Library. Issue 3. Oxford: Update Software, 2001.
Cited by
Sorted by citations
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648 · see citing works
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349 · see citing works
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374 · see citing works
Self-citationInterventions for improving upper limb function after stroke
Pollock, A., Farmer, S. E., Brady, M. C., Langhorne, P., Mead, G. E., Mehrholz, J., & van Wijck, F. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010820.pub2 · Cited by 909 · see citing works
Jørgensen, A. W., Hilden, J., & Gøtzsche, P. C. (2006) · BMJ · doi:10.1136/bmj.38973.444699.0b · Cited by 439 · see citing works
Self-citationInterventions for improving upper limb function after stroke
Pollock, A., Farmer, S., Brady, M., Langhorne, P., Mead, G. E., Mehrholz, J., & van Wijck, F. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010820 · Cited by 244 · see citing works
Smith, J. R., Mugford, M., Holland, R., Candy, B., Noble, M., Harrison, B. D., Koutantji, M., Upton, C., & Harvey, I. M. (2005) · Health Technology Assessment · doi:10.3310/hta9230 · Cited by 232 · see citing works
Dealing with substantial heterogeneity in Cochrane reviews. Cross-sectional study
Schroll, J. B., Moustgaard, R., & Gøtzsche, P. C. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-22 · Cited by 218 · see citing works
Self-citationOverviews of reviews often have limited rigor: a systematic review
Pieper, D., Buechter, R., Jerinic, P., & Eikermann, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.06.015 · Cited by 213 · see citing works
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/35 · Cited by 186 · see citing works
Nielsen, N., Friberg, H., Gluud, C. N., Herlitz, J. D., & Wetterslev, J. (2010) · International Journal of Cardiology · doi:10.1016/j.ijcard.2010.06.008 · Cited by 173 · see citing works
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/819 · Cited by 168 · see citing works
Manchikanti, L. (2008) · Pain Physician · doi:10.36076/ppj.2008/11/161 · Cited by 157 · see citing works
Effects of Screening and Systemic Adjuvant Therapy on ER-Specific US Breast Cancer Mortality
Muñoz, D. F., Near, A. M., van Ravesteyn, N. T., Lee, S. J., Schechter, C. B., Alagöz, O., Berry, D. A., Burnside, E. S., Chang, Y.-J., Chisholm, G. B., et al. (2014) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dju289 · Cited by 146 · see citing works
Ballard, M., & Montgomery, P. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1229 · Cited by 136 · see citing works
Growth and decentralization of the medical literature: implications for evidence-based medicine.
Druss, B. G., & Marcus, S. C. (2005) · Europe PMC (PubMed Central) · Cited by 116 · see citing works
Williams, H. C. (2011) · American Journal of Clinical Dermatology · doi:10.2165/11595500-000000000-00000 · Cited by 116 · see citing works
Jones, A. P., Remmington, T., Williamson, P. R., Ashby, D., & Smyth, R. L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.11.024 · Cited by 114 · see citing works
Delaney, A., Bagshaw, S. M., Ferland, A., Laupland, K., Manns, B., & Doig, C. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000253394.15628.fd · Cited by 112 · see citing works
Hospital doctors’ self‐rated skills in and use of evidence‐based medicine – a questionnaire survey
Oliveri, R. S., Gluud, C. N., & Wille‐Jørgensen, P. A. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2003.00477.x · Cited by 110 · see citing works
Shea, B., Moher, D., Graham, I. D., Pham, B., & Tugwell, P. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001008 · Cited by 109 · see citing works
Systematic reviews in medical education: A practical approach: AMEE Guide 94
Sharma, R., Gordon, M. A., Dharamsi, S., & Gibbs, T. J. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.970996 · Cited by 99 · see citing works
Mignini, L. E., & Khan, K. S. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-10 · Cited by 94 · see citing works
Screening mammography—an overview revisited
Horton, R. C. (2001) · The Lancet · doi:10.1016/s0140-6736(01)06452-2 · Cited by 91 · see citing works
Systematic reviews on behavioural and psychological symptoms in the older or demented population
van der Linde, R. M., Stephan, B. C. M., Savva, G. M., Dening, T., & Brayne, C. (2012) · Alzheimer s Research & Therapy · doi:10.1186/alzrt131 · Cited by 88 · see citing works
A tool to assess the quality of a meta‐analysis
Higgins, J. P. T., Lane, P. W., Anagnostelis, B., Anzures‐Cabrera, J., Baker, N. F., Cappelleri, J. C., Haughie, S., Hollis, S., Lewis, S. C., Moneuse, P., et al. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1092 · Cited by 84 · see citing works
Homeopathy: what does the “best” evidence tell us?
Ernst, E. (2010) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03585.x · Cited by 81 · see citing works
Page, M. J., McKenzie, J. E., & Forbes, A. B. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.10.010 · Cited by 75 · see citing works
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis‐Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0507-6 · Cited by 75 · see citing works
Acupuncture: What Does the Most Reliable Evidence Tell Us?
Ernst, E. (2008) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2008.04.009 · Cited by 64 · see citing works
Petticrew, M. P. (2002) · BMJ · doi:10.1136/bmj.324.7336.545/a · Cited by 59 · see citing works
Appraising Systematic Reviews and Meta-analyses
Bigby, M. E., & Williams, H. C. (2003) · Archives of Dermatology · doi:10.1001/archderm.139.6.795 · Cited by 52 · see citing works
Sublingual immunotherapy: from proven prevention to putative rapid relief of allergic symptoms
Bousquet, J. (2004) · Allergy · doi:10.1111/j.1398-9995.2005.00700.x · Cited by 48 · see citing works
Waters, E. B., Doyle, J., Jackson, N., Howes, F., Brunton, G., & Oakley, A. (2006) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.015354 · Cited by 46 · see citing works
Bunn, F., Trivedi, D. P., Alderson, P., Hamilton, L. K., Martin, A. E., Pinkney, E., & Iliffe, S. (2015) · Health Technology Assessment · doi:10.3310/hta19280 · Cited by 42 · see citing works
Bunn, F., Trivedi, D. P., Alderson, P., Hamilton, L. K., Martin, A. E., & Iliffe, S. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-125 · Cited by 40 · see citing works
Bigby, M. E., & Williams, H. C. (2010) · Wiley eBooks · doi:10.1002/9781444317633.ch7 · Cited by 38 · see citing works
Hughes, B. M. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.09.005 · Cited by 34 · see citing works
Comparative effectiveness of medical interventions in adults versus children.
Contopoulos-Ioannidis, D., Baltogianni, M. S., & Ioannidis, J. (2010) · Jornal de Pediatria · doi:10.1016/j.jpeds.2010.02.011 · Cited by 33 · see citing works
Sublingual Immunotherapy: Past, present, paradigm for the future?A review of the literature
Leatherman, B. D., OWEN, S., PARKER, M., CHADWICK, S., Fornadley, J. A., Colson, D. J., & Fass, P. (2007) · Otolaryngology · doi:10.1016/j.otohns.2006.11.057 · Cited by 31 · see citing works
Systematic review of web application security development model
Shuaibu, B. M., Norwawi, N. M., Selamat, M. H., & Al-Alwani, A. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-012-9375-6 · Cited by 30 · see citing works
Medicina Baseada em Evidências: "novo paradigma assistencial e pedagógico"?
Castiel, L. D., & Póvoa, E. C. (2002) · Interface - Comunicação Saúde Educação · doi:10.1590/s1414-32832002000200009 · Cited by 29 · see citing works
Cochrane Systematic Reviews in Acupuncture: Methodological Diversity in Database Searching
Sood, A., Sood, R., Bauer, B. A., & Ebbert, J. O. (2005) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2005.11.719 · Cited by 29 · see citing works
Should systematic reviews include searches for published errata?
Royle, P., & Waugh, N. R. (2004) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2004.00459.x · Cited by 27 · see citing works
Zhang, Y., Suo, Y., Yang, L., Zhang, X., Yu, Q., Zeng, M., Zhang, W., Jiang, X., & Wang, Y. (2022) · Cardiology Research and Practice · doi:10.1155/2022/8729003 · Cited by 26 · see citing works
Glasziou, P., Chalmers, I., Altman, D. G., Bastian, H., Boutron, I., Brice, A., Jamtvedt, G., Farmer, A. A., Ghersi, D., Groves, T., et al. (2010) · Cited by 26 · see citing works
Cochrane systematic reviews in the field of addiction: What's there and what should be
Amato, L., Davoli, M., Vecchi, S., Ali, R. L., Farrell, M., Faggiano, F., FOXCROFT, D. R., Ling, W. W., Minozzi, S., & Zhao, C. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.08.003 · Cited by 25 · see citing works
Haq, I. U., & Khan, T. A. (2021) · IEEE Access · doi:10.1109/access.2021.3088229 · Cited by 24 · see citing works
Yet another problem with systematic reviews: a living review update
Uttley, L., Weng, Y., & Falzon, L. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111608 · Cited by 23 · see citing works
Heterogeneity in meta-analyses of treatment of acute postoperative pain: a review
Espitalier, F., Tavernier, E., Remérand, F., Laffon, M., Fusciardi, J., & Giraudeau, B. (2013) · British Journal of Anaesthesia · doi:10.1093/bja/aet250 · Cited by 23 · see citing works
The Effectiveness of Cognitive Therapy for Schizophrenia: What Can We Learn from the Meta-Analyses?
Sensky, T. (2005) · Psychotherapy and Psychosomatics · doi:10.1159/000083997 · Cited by 22 · see citing works
Can decision making in general surgery be based on evidence? An empirical study of Cochrane Reviews
Diener, M. K., Wolff, R. F., von Elm, E. B., Rahbari, N. N., Mavergames, C., Knaebel, H., Seiler, C. M., & Antes, G. (2009) · Surgery · doi:10.1016/j.surg.2009.02.016 · Cited by 21 · see citing works
Parker, E. R., Schilling, L. M., Diba, V. C., Williams, H. C., & Dellavalle, R. P. (2004) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(03)00883-1 · Cited by 21 · see citing works
A critical appraisal of ‘evidence‐based medicine’ in allergy and asthma
Bousquet, J., & Cauwenberge, P. V. (2004) · Allergy · doi:10.1111/j.1398-9995.2004.00654.x · Cited by 21 · see citing works
Statistical Use in Clinical Studies: Is There Evidence of a Methodological Shift?
Yi, D., Ma, D., Li, G., Zhou, L., Xiao, Q., Zhang, Y., Liu, X., Chen, H., Pettigrew, J. C., Yi, D., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0140159 · Cited by 20 · see citing works
Ahmad, N., Boutron, I., Dechartres, A., Durieux, P., & Ravaud, P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0016878 · Cited by 20 · see citing works
Dombrowski, S. U., Campbell, P., Frost, H., Pollock, A., McLellan, J., MacGillivray, S. A., Gavine, A. J., Maxwell, M., O’Carroll, R. E., Cheyne, H., et al. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0355-9 · Cited by 20 · see citing works
Heidenreich, A., Eisemann, N., Katalinic, A., & Hübner, J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02167-8 · Cited by 19 · see citing works
Poikolainen, K. (2002) · Alcohol and Alcoholism · doi:10.1093/alcalc/37.5.416 · Cited by 18 · see citing works
Knowledge Transfer in Surgery: Skills, Process and Evaluation
Dawes, M. G., & Lens, M. B. (2007) · Annals of The Royal College of Surgeons of England · doi:10.1308/003588407x232206 · Cited by 18 · see citing works
Information management and reading habits of German diabetologists: a questionnaire survey
Trelle, S. (2002) · Diabetologia · doi:10.1007/s00125-002-0807-8 · Cited by 18 · see citing works
Lane, P. W., Higgins, J. P. T., Anagnostelis, B., Anzures‐Cabrera, J., Baker, N. F., Cappelleri, J. C., Haughie, S., Hollis, S., Lewis, S. C., Moneuse, P., et al. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1072 · Cited by 16 · see citing works
Henry, J. A., Carlson, K. F., Theodoroff, S. M., & Folmer, R. L. (2022) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-21-00668 · Cited by 16 · see citing works
Futamura, M., Thomas, K. S., Grindlay, D. J. C., Doney, L., Torley, D., & Williams, H. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0058484 · Cited by 16 · see citing works
Methods of meta-analysis: an analysis
Koretz, R. L. (2002) · Current Opinion in Clinical Nutrition & Metabolic Care · doi:10.1097/00075197-200209000-00003 · Cited by 16 · see citing works
Borić, K., Došenović, S., Kadić, A. J., Borić, M., Jerić, M., & Puljak, L. (2017) · Pain Medicine · doi:10.1093/pm/pnx255 · Cited by 16 · see citing works
Tudor, K. I., Kozina, P. N., & Marušić, A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0069877 · Cited by 13 · see citing works
The Occupational Health Field in the Cochrane Collaboration
Verbeek, J. H. A. M. (2007) · Industrial Health · doi:10.2486/indhealth.45.8 · Cited by 13 · see citing works
Petherick, E., Villanueva, E., Dumville, J. C., Bryan, E. J., & Dharmage, S. C. (2007) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2007.tb01246.x · Cited by 12 · see citing works
Conclusiveness of the Cochrane Reviews in Pediatric-Gastroenterology
Cohen, S., Lubetzky, R., Mimouni, F. B., Marom, R., & Mandel, D. (2012) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0b013e32835a1083 · Cited by 12 · see citing works
Piehl, J. H., Green, S., & McDonald, S. J. (2003) · BMC Health Services Research · doi:10.1186/1472-6963-3-2 · Cited by 12 · see citing works
Published review of closed-system drug-transfer devices: Limitations and implications
McDiarmid, M. A., Polovich, M., Power, L. A., Connor, T. H., & Kienle, P. C. (2018) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp180631 · Cited by 11 · see citing works
Chen, S., Zhao, W., Zhang, B., Jia, Y., Wu, S., Zhong, B., Yu, X., Wang, X., Hao, Y., Wang, H., et al. (2019) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2019/3082437 · Cited by 11 · see citing works
Evidence based evaluation of immuno-coagulatory interventions in critical care.
Afshari, A. (2011) · PubMed · Cited by 11 · see citing works
Bigby, M. E. (2014) · Wiley eBooks · doi:10.1002/9781118357606.ch7 · Cited by 11 · see citing works
Newman, M. (2019) · BMJ · doi:10.1136/bmj.k5302 · Cited by 10 · see citing works
da Silva, A. M., Filho, R. S. D. O., Ferreira, L. M., & Saconato, H. (2003) · Sao Paulo Medical Journal · doi:10.1590/s1516-31802003000100006 · Cited by 10 · see citing works
Cochrane systematic reviews in the field of addiction: past and future
Amato, L., Mitrova, Z., Davoli, M., & Cochrane Drugs and Alcohol Group (2013) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12067 · Cited by 9 · see citing works
Seegers, V., Trinquart, L., Boutron, I., & Ravaud, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063677 · Cited by 9 · see citing works
Striving for Excellence with Evidence-Based Dentistry
Gillette, J. (2009) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2009.06.008 · Cited by 8 · see citing works
Why would physicians undervalue reviews by the Cochrane Collaboration?
Badgett, R. G. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.022 · Cited by 8 · see citing works
de Dios, J. G. (2004) · Anales de Pediatría · doi:10.1016/s1695-4033(04)78300-9 · Cited by 8 · see citing works
Review of the Evidence for Major Population-Level Tobacco Control Interventions
Wilson, N. (2007) · Cited by 8 · see citing works
Improving the dissemination of systematic reviews in emergency medicine
Rowe, B. H., Wyer, P. C., & Cordell, W. H. (2002) · Annals of Emergency Medicine · doi:10.1067/mem.2002.122056 · Cited by 8 · see citing works
Davoli, M., & Amato, L. (2011) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796011000412 · Cited by 7 · see citing works
More systematic reviews needed to improve occupational health
Verbeek, J. H. A. M. (2007) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.1110 · Cited by 7 · see citing works
Conclusiveness of the Cochrane reviews in gynaecological cancer: A systematic analysis
Yin, S.-D., Chuai, Y., Wang, A., & Zhang, L. (2015) · Journal of International Medical Research · doi:10.1177/0300060515574922 · Cited by 6 · see citing works
Critical look at the clinical practice guidelines for allergic rhinitis
Hoecke, H. V., & Cauwenberge, P. V. (2006) · Respiratory Medicine · doi:10.1016/j.rmed.2006.08.007 · Cited by 6 · see citing works
Zed, P. J., Rowe, B. H., Loewen, P. S., & Abu‐Laban, R. B. (2003) · Canadian Journal of Emergency Medicine · doi:10.1017/s1481803500015840 · Cited by 6 · see citing works
An Introduction to Evidence-Based Practice for Hand Surgeons and Therapists
Szabo, R. M., & MacDermid, J. C. (2009) · Hand Clinics · doi:10.1016/j.hcl.2008.12.002 · Cited by 5 · see citing works
Spin, Bias, and Clinical Utility in Systematic Reviews of Diagnostic Studies
Ioannidis, J. P. A. (2020) · Clinical Chemistry · doi:10.1093/clinchem/hvaa114 · Cited by 5 · see citing works
Publication practices of sub-Saharan African Cochrane authors: a bibliometric study
Mbuagbaw, L. C. E., Schoonees, A., Oliver, J., Arikpo, D., Durão, S., Effa, E., Hohlfeld, A., Kredo, T., Wiysonge, C. S., & Young, T. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051839 · Cited by 5 · see citing works
Guo, L., Bu, H., Guo, M., Zhang, Y., Yu, Q., Yu, B., Jiang, X., & Yang, L. (2022) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2022/4044826 · Cited by 5 · see citing works
The Cochrane Collaboration: institutional analysis of a knowledge commons
Heywood, P., Stephani, A.-M., & Garner, P. (2017) · Evidence & Policy · doi:10.1332/174426417x15057479217899 · Cited by 5 · see citing works
Sound Therapy for Tinnitus: Options for Audiologists
Henry, J. A., & Quinn, C. M. (2020) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2020_persp-19-00156 · Cited by 5 · see citing works
Capturing study influence: The concept of 'gravity' in meta-analysis
Gee, T. (2005) · Griffith Research Online · Cited by 5 · see citing works
The Cochrane Collaboration and its contribution towards the management of allergic diseases
Dean, T. (2002) · Clinical & Experimental Allergy · doi:10.1046/j.1365-2222.2002.01462.x · Cited by 5 · see citing works
Appraising Systematic Reviews and Meta‐Analyses
Bigby, M. E., & Williams, H. C. (2014) · Wiley eBooks · doi:10.1002/9781118357606.ch8 · Cited by 4 · see citing works
- Authors
- Olsen, O., Middleton, P., Ezzo, J., Gøtzsche, P. C., Hadhazy, V., Herxheimer, A., Kleijnen, J., & McIntosh, H.
- Affiliations
- Rigshospitalet (DK)
- Flinders Medical Centre (AU)
- University of Maryland, Baltimore (US)
- Cochrane (GB)
- University of York (GB)
- Corresponding author
- Olsen, Ole
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2001-10-13
- Volume
- 323
- Issue
- 7317
- Pages
- 829-832
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC57800
- OpenAlex
- W2154762721
- Cited by
- 159
- References
- 20
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 2 · 2022: 3 · 2021: 4 · 2020: 2 · 2019: 4 · 2018: 1 · 2017: 6 · 2016: 2 · 2015: 6 · 2014: 10 · 2013: 13 · 2012: 6
- FWCI
- 17.73
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
- Locations
- BMJ (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- review quality, systematic review methodology, reporting quality, editorial quality, Cochrane Library, health interventions
- MeSH terms
- Humans, Review Literature as Topic, Meta-Analysis as Topic, Bias, Evidence-Based Medicine, Databases as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
