Comparison of protocols and registry entries to published reports for systematic reviews
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
This is a protocol for a Cochrane Review (Methodology). The objectives are as follows: To assess the reporting of systematic reviews by reviewing research that used cohorts of reviews to compare the content of the published reports of these reviews with the information stated in: their protocols, or their entries in a registry. To assess whether these differences are related to the characteristics of the systematic reviews, such as source of funding, Cochrane or non‐Cochrane Review, or the statistical significance of results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, it is difficult to anticipate all scenarios that will arise, necessitating some clarifications, modifications, and changes to the protocol (such as data available may not be amenable to the planned meta-analysis).155 156”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [156]
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Systematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318
Self-citationEvidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
Research works printed but not linked: 2
- Green S Higgins JP (editors) Chapter 2: Preparing a Cochrane Review. In: Higgins JP, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011 Available from www.cochrane-handbook.org
- Morton, 2011, Finding What Works in Health Care: Standards for sSystematic Reviews
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
RESERVE - REporting of SystEmatic ReViews in Ethics: development, explanations and examples
Kahrass, H., Borry, P., Gastmans, C., Ives, J., van der Graaf, R., Strech, D., & Mertz, M. (2023) · Bioethics Open Research · doi:10.12688/bioethopenres.17486.1 · Cited by 57
Extent and prevalence of spin in randomized controlled trials in dentistry
Eleftheriadi, I., Ioannou, T., & Pandis, N. (2020) · Journal of Dentistry · doi:10.1016/j.jdent.2020.103433 · Cited by 32
Yaw, Q. P., Loh, Y. L., Lee, R., Ang, W. W., Lau, Y., & Wong, S. H. (2025) · Virtual Reality · doi:10.1007/s10055-025-01134-z · Cited by 11
“This can be due to outcome-reporting bias, which is connected to a distortion of provided data from trials without procedure because authors can add, remove, or upgrade outcomes to favour a statistically positive result (Pieper et al. 2020).”
Metadata
- Authors
- Pieper, D., Allers, K., Mathes, T., Hoffmann, F., Klerings, I., Rombey, T., & Nussbaumer-Streit, B.
- Affiliations
- Witten/Herdecke University (DE)
- Carl von Ossietzky Universität Oldenburg (DE)
- Universität für Weiterbildung Krems (AT)
- ORCID
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- Wiley
- Published
- 2020-02-25
- ISSN
- 1361-6137 (ISSN-L)
- 1465-1858
- PMC
- PMC7040460
- OpenAlex
- W3008054290
- Semantic Scholar
- 6a6828dac90bf46b79ac1874c57844a5588dcf69
- Cited by
- 8
- References
- 29
- Citations by year
- 2026: 1 · 2025: 1 · 2023: 2 · 2021: 2 · 2020: 2
- FWCI
- 0.31
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Cochrane Database of Systematic Reviews (publishedVersion)
- PubMed Central (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- systematic review reporting, funding sources
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparison of protocols and registry entries to published reports for systematic reviews. https://app.cochat.ai/papers/10.1002/14651858.mr000053
- The paper
- Pieper, D., Allers, K., Mathes, T., Hoffmann, F., Klerings, I., Rombey, T., & Nussbaumer-Streit, B. (2020). Comparison of protocols and registry entries to published reports for systematic reviews. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.mr000053
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.