Following 411 Cochrane Protocols to Completion: A Retrospective Cohort Study
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Cochrane reviews are regarded as being scientifically rigorous and are increasingly used by a variety of stakeholders. However, factors predicting the publication of Cochrane reviews have never been reported. This is important because if a higher proportion of Cochrane protocols with certain characteristics (e.g., funding) are being published, this may lead to inaccurate decisions. We examined the frequency of published and unpublished Cochrane reviews and protocol factors that predict the publication of Cochrane reviews. METHODOLOGY/PRINCIPAL FINDINGS: Retrospective cohort study of Cochrane protocols published in 2000 (Issues 2 to 4) and 2001 (Issue 1). The publication status of these reviews was followed up to Issue 1, 2008 in The Cochrane Library. Survival analysis of the time from protocol publication to the first review publication and protocol factors predicting the time to publication was conducted. There were 411 new Cochrane protocols in the cohort. After excluding 39; 71/372 (19.1%) were unpublished and 301/372 (80.9%) were published as full Cochrane reviews at the time of study analysis (January 2008). The median time to publication was 2.4 years (range: 0.15 to 8.96). Multivariate analyses revealed that shorter time to publication was associated with the review subsequently being updated (hazard ratio, HR: 1.80 [95% confidence interval, CI: 1.39 to 2.33 years]) and longer time to publication was associated with the review having two published protocols, indicating changes to the review plan (HR: 0.33 [95% CI: 0.12 to 0.90 years]). CONCLUSIONS/SIGNIFICANCE: Only about 80% Cochrane protocols were published as full reviews after over 8 years of follow-up. The median time to publication was 2.4 years and some reviews took much longer. Strategies to decrease time to publication should be considered, such as streamlining the review process, increased support for authors when protocol amendments occur, and better infrastructure for updating Cochrane reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417 · cited 1×
“Publication bias occurs when ‘‘investigators, reviewers, and editors submit or accept manuscripts for publication based on the direction or strength of the study findings’’[4].”
BackgroundHow Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838 · cited 3×
“However, our time frame is double that reported elsewhere [15], as this study examined a different time period than this study did [15].”
BackgroundResultInfluentialSelf-citationPublication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715 · cited 1×
“, randomized trials) [4,6–11], but is under-explored for systematic reviews [12–14].”
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632 · cited 1×
“, pharmaceutical companies) [9,11] and a higher likelihood of publication when they are funded [19].”
BackgroundPublication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Time to publication for results of clinical trials
Hopewell, S., Clarke, M. J., Stewart, L., & Tierney, J. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000011.pub2 · Cited by 243 · cited 1×
“, favourable results, funding from organizations with vested interests, such as pharmaceutical companies or the tobacco industry) are published quicker than those without these characteristics [5].”
BackgroundSystematic reviews can be produced and published faster
Sampson, M., Shojania, K. G., Garritty, C., Horsley, T., Ocampo, M., & Moher, D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.02.004 · Cited by 103 · cited 1×
“These may include providing support to reviewers when protocol changes occur and streamlining the publication process to decrease the time to publication of Cochrane reviews [16].”
BackgroundSelf-citation
Cited by
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Living systematic review: 1. Introduction-the why, what, when, and how
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.010 · Cited by 655
“These methods are well developed [2e4], but resource intensive [5], making it difficult to keep up to date as new research becomes available [6].”
MethodLiving Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596
“In contrast, rising methodological expectations have led to an increase in the complexity and cost of SR and production timelines often in excess of 1–2 years [21].”
BackgroundTsou, A. Y., Treadwell, J. R., Erinoff, E., & Schoelles, K. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01324-7 · Cited by 122
Tao, K.-M., Li, X.-Q., Zhou, Q.-H., Moher, D., Ling, C.-Q., & Yu, W.-F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027611 · Cited by 101
“Since the PRISMA Statement was released just two years previously and preparation of a systematic review may be a lengthy process [4], it was conceivable that few reviews may indicate compliance with the PRISMA Statement.”
BackgroundSelf-citation
Metadata
- Authors
- Tricco, A. C., Brehaut, J., Chen, M. H., & Moher, D.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008-11-10
- Volume
- 3
- Issue
- 11
- Pages
- e3684
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2028540474
- Cited by
- 54
- References
- 8
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Following 411 Cochrane Protocols to Completion: A Retrospective Cohort Study. https://app.cochat.ai/papers/10.1371/journal.pone.0003684
- The paper
- Tricco, A. C., Brehaut, J., Chen, M. H., & Moher, D. (2008). Following 411 Cochrane Protocols to Completion: A Retrospective Cohort Study. PLoS ONE. https://doi.org/10.1371/journal.pone.0003684
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.