The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Best Practice in Systematic Reviews: The Importance of Protocols and Registration
Open accessAbstract
It is now just over six years [1] since many medical journals began requiring that trials be registered before considering the trial report for publication. Such a policy was set up explicitly to reduce what was considered to be widespread bias in favor of publication of ‘‘positive’’ trials and to ensure that all clinical trials be made public prior to participant enrollment. Given the importance of clinical trials for estimating the efficacy and safety of interventions, and their role in approval of new drugs and devices, such a policy seemed uncontroversial. Although it is known that some trials still go unregistered, there are strong incentives (such as journal publication) and, in some countries legally enforceable mandates, for authors to register these studies before enrolling patients. The existence and widespread uptake of trial registration helps researchers, patients, and funders understand how many trials are being undertaken and which interventions are being evaluated. It also allows studies to be traced from inception through to completion and publication [2]. However, well-conducted systematic reviews—overviews of health care interventions that use a predefined, explicit methodology to find and synthesize all the relevant evidence—are generally considered higher-caliber evidence than are individual trials in decision-making for clinical practice and health policy. The superiority given to such reviews derives from key aspects inherent to the process of carrying out a systematic review. This study type, if done properly, allows the review to come closer to estimating the true effect of an intervention than any single study can, for two main reasons. First, such reviews collect and synthesize all relevant studies; second, reviews appraise each included study for risk of bias. However, there is increasing evidence of the existence of publication bias for systematic reviews. A recent survey [3] indicates that nonpublication of completed studies may be as much of a problem for systematic reviews as it is for trials. Other analyses [4,5] point to the existence of discrepancies between systematic review protocols and the published report, with one study [5] showing that the outcomes included in published systematic reviews may be biased toward ‘‘positive’’ findings. It is crucially important, therefore, that if the evidence from these studies is to be incorporated into clinical practice, the review is as rigorous and as fully reported as possible. For example, it should be obvious to readers whether there was a prespecified protocol for the review, that deviations are noted, and whether outcomes from the review are reported according to the original study plan. Increased clarity surrounding systematic review conduct and reporting would be possible if the protocols for systematic reviews, just like those for trials, were registered [6,7]. Systematic reviews conducted under the auspices of the Cochrane Collaboration are registered early, at the protocol development stage. This registration helps minimize bias in the conduct and reporting of the review, reduce duplication of effort between groups, and keep systematic reviews updated. However, until now no overarching registry open to all researchers, worldwide, has existed for recording the existence and development of systematic reviews from inception through to completion. This month, the Centre for Reviews and Dissemination (University of York, UK), supported by the UK National Institutes of Health Research and in collaboration with an international advisory group, announces PROSPERO, its international Prospective Register of Ongoing Systematic Reviews. Following months of public consultation, with many hundreds of respondents from 34 countries providing input on the proposed registration process and minimum dataset, PROSPERO is now open for business [8]. Registration is free, is available to anyone around the world, and generates a unique identifying number for each registered systematic review, which can (and should) be reported in any publications that arise from the study. Investigators should use the registry to record the existence of the protocol for a planned or ongoing systematic review of health care interventions even before screening studies for inclusion in the systematic review. A minimum dataset specifies the key items that are required for a systematic review to be meaningfully registered. Key data items include a statement of the research question, patients and population, study intervention(s) and outcomes; criteria for inclusion and exclusion of studies in the systematic review; outline of search strategy; and methods to assess risk of bias and for analysis of studies included in the systematic review. With a clear system in place for registration of new and ongoing systematic reviews, PLoS Medicine announces its support for this initiative. The journal wishes to promote best practice in the conduct and reporting of systematic reviews. Best practice includes registration during the protocol phase in PROSPERO or other appropriate registry, conduct of the review in accordance with a fully developed protocol, and reporting in line with the PRISMA guidelines [9]. PLoS Medicine and other PLoS journals will now start asking
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An international registry of systematic-review protocols
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · The Lancet · doi:10.1016/s0140-6736(10)60903-8 · Cited by 512
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401 · cited 2×
“It also allows studies to be traced from inception through to completion and publication [2].”
BackgroundPublishing Protocols of Systematic Reviews: Comparing What Was Done to What Was Planned
Silagy, C. A., Middleton, P., & Hopewell, S. (2002) · JAMA · doi:10.1001/jama.287.21.2831 · Cited by 188
Bias Due to Changes in Specified Outcomes during the Systematic Review Process
Kirkham, J. J., Altman, D. G., & Williamson, P. R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009810 · Cited by 164
Registering systematic reviews
Straus, S., & Moher, D. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.081849 · Cited by 108
Research works printed but not linked: 3
- C De Angelis, 2004, Clinical trial registration: A statement from the International Committee of Medical Journal Editors., Ann Intern Med, 141, 477, 10.7326/0003-4819-141-6-200409210-00109 · DOI · Paper page
- AC Tricco, 2009, An international survey indicated that unpublished systematic reviews exist., J Clin Epidemiol, 62, 617, 10.1016/j.jclinepi.2008.09.014 · DOI
- A Liberati, 2009, The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration, PLoS Med, 6, e1000100, 10.1371/journal.pmed.1000100 · DOI · Paper page
Cited by
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Clarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063
The Benefits and Challenges of Using Systematic Reviews in International Development Research
Mallett, R., Hagen-Zanker, J., Slater, R., & Duvendack, M. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711342 · Cited by 565
Soil-Transmitted Helminth Reinfection after Drug Treatment: A Systematic Review and Meta-Analysis
Jia, T.-W., Melville, S., Utzinger, J., King, C. H., & Zhou, X.-N. (2012) · PLoS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0001621 · Cited by 422
Page, M. J., McKenzie, J. E., Kirkham, J., Dwan, K., Kramer, S., Green, S., & Forbes, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000035.pub2 · Cited by 281
Metadata
- Authors
- Editors, T. P. M.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-02-22
- Volume
- 8
- Issue
- 2
- Pages
- e1001009
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W4237357387
- Cited by
- 160
- References
- 5
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.