Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 160

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Best Practice in Systematic Reviews: The Importance of Protocols and Registration

Open access
The PLoS Medicine Editors · 2011 · PLoS Medicine

Abstract

It is now just over six years [1] since many medical journals began requiring that trials be registered before considering the trial report for publication. Such a policy was set up explicitly to reduce what was considered to be widespread bias in favor of publication of ‘‘positive’’ trials and to ensure that all clinical trials be made public prior to participant enrollment. Given the importance of clinical trials for estimating the efficacy and safety of interventions, and their role in approval of new drugs and devices, such a policy seemed uncontroversial. Although it is known that some trials still go unregistered, there are strong incentives (such as journal publication) and, in some countries legally enforceable mandates, for authors to register these studies before enrolling patients. The existence and widespread uptake of trial registration helps researchers, patients, and funders understand how many trials are being undertaken and which interventions are being evaluated. It also allows studies to be traced from inception through to completion and publication [2]. However, well-conducted systematic reviews—overviews of health care interventions that use a predefined, explicit methodology to find and synthesize all the relevant evidence—are generally considered higher-caliber evidence than are individual trials in decision-making for clinical practice and health policy. The superiority given to such reviews derives from key aspects inherent to the process of carrying out a systematic review. This study type, if done properly, allows the review to come closer to estimating the true effect of an intervention than any single study can, for two main reasons. First, such reviews collect and synthesize all relevant studies; second, reviews appraise each included study for risk of bias. However, there is increasing evidence of the existence of publication bias for systematic reviews. A recent survey [3] indicates that nonpublication of completed studies may be as much of a problem for systematic reviews as it is for trials. Other analyses [4,5] point to the existence of discrepancies between systematic review protocols and the published report, with one study [5] showing that the outcomes included in published systematic reviews may be biased toward ‘‘positive’’ findings. It is crucially important, therefore, that if the evidence from these studies is to be incorporated into clinical practice, the review is as rigorous and as fully reported as possible. For example, it should be obvious to readers whether there was a prespecified protocol for the review, that deviations are noted, and whether outcomes from the review are reported according to the original study plan. Increased clarity surrounding systematic review conduct and reporting would be possible if the protocols for systematic reviews, just like those for trials, were registered [6,7]. Systematic reviews conducted under the auspices of the Cochrane Collaboration are registered early, at the protocol development stage. This registration helps minimize bias in the conduct and reporting of the review, reduce duplication of effort between groups, and keep systematic reviews updated. However, until now no overarching registry open to all researchers, worldwide, has existed for recording the existence and development of systematic reviews from inception through to completion. This month, the Centre for Reviews and Dissemination (University of York, UK), supported by the UK National Institutes of Health Research and in collaboration with an international advisory group, announces PROSPERO, its international Prospective Register of Ongoing Systematic Reviews. Following months of public consultation, with many hundreds of respondents from 34 countries providing input on the proposed registration process and minimum dataset, PROSPERO is now open for business [8]. Registration is free, is available to anyone around the world, and generates a unique identifying number for each registered systematic review, which can (and should) be reported in any publications that arise from the study. Investigators should use the registry to record the existence of the protocol for a planned or ongoing systematic review of health care interventions even before screening studies for inclusion in the systematic review. A minimum dataset specifies the key items that are required for a systematic review to be meaningfully registered. Key data items include a statement of the research question, patients and population, study intervention(s) and outcomes; criteria for inclusion and exclusion of studies in the systematic review; outline of search strategy; and methods to assess risk of bias and for analysis of studies included in the systematic review. With a clear system in place for registration of new and ongoing systematic reviews, PLoS Medicine announces its support for this initiative. The journal wishes to promote best practice in the conduct and reporting of systematic reviews. Best practice includes registration during the protocol phase in PROSPERO or other appropriate registry, conduct of the review in accordance with a fully developed protocol, and reporting in line with the PRISMA guidelines [9]. PLoS Medicine and other PLoS journals will now start asking

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pmed.1001009

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 3

  1. C De Angelis, 2004, Clinical trial registration: A statement from the International Committee of Medical Journal Editors., Ann Intern Med, 141, 477, 10.7326/0003-4819-141-6-200409210-00109 · DOI · Paper page
  2. AC Tricco, 2009, An international survey indicated that unpublished systematic reviews exist., J Clin Epidemiol, 62, 617, 10.1016/j.jclinepi.2008.09.014 · DOI
  3. A Liberati, 2009, The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration, PLoS Med, 6, e1000100, 10.1371/journal.pmed.1000100 · DOI · Paper page

Cited by

See all 160

Metadata

Authors
Editors, T. P. M.
Venue
PLoS Medicine
Published
2011-02-22
Volume
8
Issue
2
Pages
e1001009
ISSN
  • 1549-1277 (ISSN-L)
  • 1549-1676
OpenAlex
W4237357387
Cited by
160
References
5
FWCI
1.01
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Best Practice in Systematic Reviews: The Importance of Protocols and Registration. https://app.cochat.ai/papers/10.1371/journal.pmed.1001009
The paper
Editors, T. P. M. (2011). Best Practice in Systematic Reviews: The Importance of Protocols and Registration. PLoS Medicine. https://doi.org/10.1371/journal.pmed.1001009

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.