Registration of systematic reviews in PROSPERO: 30,000 records and counting
Open accessThe DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The International Prospective Register of Systematic Reviews (PROSPERO) was launched in February 2011 to increase transparency of systematic reviews (SRs). There have been few investigations of the content and use of the database. We aimed to investigate the number of PROSPERO registrations from inception to 2017, and website usage in the last year. We also aimed to explore the epidemiological characteristics of and completeness of primary outcome pre-specification in a sample of PROSPERO records from 2017. METHODS: The PROSPERO database managers provided us with data on the annual and cumulative number of SR registrations up to October 10, 2017, and the number of visits to the PROSPERO website over the year preceding October 10, 2017. One author collected data on the focus of the SR (e.g. therapeutic, diagnostic), health area addressed, funding source and completeness of outcome pre-specification in a random sample of 150 records of SRs registered in PROSPERO between April 1, 2017 and September 30, 2017. RESULTS: As of October 10, 2017, there were 26,535 SRs registered in PROSPERO; guided by current monthly submission rates, we anticipate this figure will reach over 30,000 by the end of 2017. There has been a 10-fold increase in registrations, from 63 SRs per month in 2012 to 800 per month in 2017. In the year preceding October 10, 2017, the PROSPERO website received more than 1.75 million page views. In the random sample of 150 registered SRs, the majority were focused on a therapeutic question (78/150 [52%]), while only a few focused on a diagnostic/prognostic question (11/150 [7%]). The 150 registered SRs addressed 18 different health areas. Any information about the primary outcome other than the domain (e.g. timing, effect measures) was not pre-specified in 44/150 records (29%). CONCLUSIONS: Registration of SRs in PROSPERO increased rapidly between 2011 and 2017, thus benefiting users of health evidence who want to know about ongoing SRs. Further work is needed to explore how closely published SRs adhere to the planned methods, whether greater pre-specification of outcomes prevents selective inclusion and reporting of study results, and whether registered SRs address necessary questions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Registration aims to reduce bias, increase transparency, facilitate scrutiny and improve trustworthiness of systematic reviews.151 152”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [152]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The protocol of this systematic review and meta-analysis is registered in PROSPERO (registration no. CRD42022382594) [9].”
From Subcutaneously administered tirzepatide vs semaglutide for adults with type 2 diabetes: a systematic review and network meta-analysis of randomised controlled trials (2024) · cites this paper as [9]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Self-citationWang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., Abraham, J., Adair, T., Aggarwal, R., Ahn, S. Y., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61728-0 · Cited by 14,070
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120 · cited 1×
“In addition, awareness of the benefits of SR registration likely increased following the dissemination of the PRISMA for Protocols Statement in January 2015 [27, 28], which mentions PROSPERO specifically in item 2.”
MethodSelf-citationRoth, G. A., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., Abbastabar, H., Abd-Allah, F., Abdela, J., Abdelalim, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32203-7 · Cited by 8,600
Naghavi, M., Abajobir, A. A., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abera, S. F., Aboyans, V., Adetokunboh, O., Afshin, A., Agrawal, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32152-9 · Cited by 4,821
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
A scoping review on the conduct and reporting of scoping reviews
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K., Colquhoun, H., Kastner, M., Levac, D., Ng, C., Sharpe, J. P., Wilson, K., et al. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0116-4 · Cited by 2,250 · cited 1×
“The field of knowledge synthesis is evolving to include other types of reviews, such as scoping reviews [37], living SRs [38] and rapid reviews [39].”
BackgroundSelf-citationThe Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483 · cited 1×
“SRs are underway suggest that the mass production of SRs previously discussed [40, 41] shows no sign of waning.”
BackgroundThe nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433 · cited 1×
“The world’s first international prospective register of systematic reviews (PROSPERO) was launched in February 2011 to mitigate these problems with SR transparency [10, 11].”
BackgroundClinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891 · cited 1×
“Yet these organisations produce a minority of all published SRs [1, 2], so most would only become known at the time the SR was completed and published.”
BackgroundSelf-citationHow Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798
Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002028 · Cited by 768 · cited 4×
“Yet these organisations produce a minority of all published SRs [1, 2], so most would only become known at the time the SR was completed and published.”
BackgroundMethodResultInfluentialSelf-citationBorah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012545 · Cited by 737 · cited 1×
“used the start dates recorded in PROSPERO to estimate the time required to complete 195 registered SRs that were published before July 2014 [15].”
MethodKidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700
Living systematic review: 1. Introduction-the why, what, when, and how
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.010 · Cited by 655 · cited 1×
“The field of knowledge synthesis is evolving to include other types of reviews, such as scoping reviews [37], living SRs [38] and rapid reviews [39].”
BackgroundSelf-citationAn international registry of systematic-review protocols
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · The Lancet · doi:10.1016/s0140-6736(10)60903-8 · Cited by 512
Why prospective registration of systematic reviews makes sense
Stewart, L., Moher, D., & Shekelle, P. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-7 · Cited by 375 · cited 1×
“For example, prospective SR registration stimulates authors to anticipate methodological challenges that may arise, helps minimise potential for reporting bias by encouraging registrants to publish their SR and report all pre-specified outcomes and serves to reduce waste from unintended duplication of SRs by different…”
BackgroundPage, M. J., McKenzie, J. E., Kirkham, J., Dwan, K., Kramer, S., Green, S., & Forbes, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000035.pub2 · Cited by 281
Self-citationPROSPERO at one year: an evaluation of its utility
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-4 · Cited by 188
Bias Due to Changes in Specified Outcomes during the Systematic Review Process
Kirkham, J. J., Altman, D. G., & Williamson, P. R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009810 · Cited by 164 · cited 1×
“some outcomes were omitted, others were downgraded from primary to secondary) [9].”
BackgroundMayo-Wilson, E., Fusco, N., Li, T., Hong, H., Canner, J. K., & Dickersin, K. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.05.007 · Cited by 131 · cited 1×
“pain is measured using three scales, each at two time points), and that failure to completely pre-specify SR outcomes can lead to challenges with selecting and interpreting results from the included trials [17, 35, 36].”
MethodTricco, A. C., Zarin, W., Ghassemi, M., Nincic, V., Lillie, E., Page, M. J., Shamseer, L., Antony, J., Rios, P., Hwee, J., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.014 · Cited by 122 · cited 1×
“fact that methods for therapeutic SRs are more established than methods for other types of SRs [29, 30].”
MethodSelf-citationSaldanha, I. J., Dickersin, K., Wang, X., & Li, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109400 · Cited by 119
Reproducible research practices are underused in systematic reviews of biomedical interventions
Page, M. J., Altman, D. G., Shamseer, L., McKenzie, J. E., Ahmadzai, N., Wolfe, D., Yazdi, F., Catalá-López, F., Tricco, A. C., & Moher, D. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.017 · Cited by 115 · cited 1×
“Prospective SR registration is one of several processes that can facilitate optimal transparency, reproducibility and usability of SRs [5].”
BackgroundSelf-citationHow to reduce unnecessary duplication: use PROSPERO
Moher, D., Booth, A., & Stewart, L. (2014) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12657 · Cited by 113 · cited 1×
“For example, prospective SR registration stimulates authors to anticipate methodological challenges that may arise, helps minimise potential for reporting bias by encouraging registrants to publish their SR and report all pre-specified outcomes and serves to reduce waste from unintended duplication of SRs by different…”
BackgroundCherry-picking by trialists and meta-analysts can drive conclusions about intervention efficacy
Mayo-Wilson, E., Li, T., Fusco, N., Bertizzolo, L., Canner, J. K., Cowley, T., Doshi, P., Ehmsen, J., Gresham, G., Guo, N., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.07.014 · Cited by 108
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027319 · Cited by 96 · cited 1×
“The register requires systematic reviewers to provide information on 22 mandatory and 18 optional items, which were selected following an international consultation exercise [12].”
BackgroundMass Production of Systematic Reviews and Meta‐analyses: An Exercise in Mega‐silliness?
Page, M. J., & Moher, D. (2016) · Milbank Quarterly · doi:10.1111/1468-0009.12211 · Cited by 86
Self-citationMethods for Developing Evidence Reviews in Short Periods of Time: A Scoping Review
Abou-Setta, A. M., Jeyaraman, M., Attia, A., Al-Inany, H. G., Ferri, M., Ansari, M. T., Garritty, C. M., Bond, K., & Norris, S. L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0165903 · Cited by 83
Tricco, A. C., Cogo, E., Page, M. J., Polisena, J., Booth, A., Dwan, K. M., MacDonald, H. R., Clifford, T., Stewart, L. A., Straus, S. E., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.025 · Cited by 75
Self-citationAn international survey indicated that unpublished systematic reviews exist
Tricco, A. C., Pham, B., Brehaut, J., Tetroe, J., Cappelli, M., Hopewell, S., Lavis, J. N., Berlin, J. A., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.014 · Cited by 64
Self-citationNetwork meta-analyses performed by contracting companies and commissioned by industry
Schuit, E., & Ioannidis, J. P. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0377-3 · Cited by 24
Yoong, S. L., Hall, A. E., Williams, C. M., Skelton, E., Oldmeadow, C. J., Wiggers, J., Karimkhani, C., Boyers, L. N., Dellavalle, R. P., Hilton, J., et al. (2015) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2014-205389 · Cited by 23
Page, M. J., Forbes, A., Chau, M., Green, S. E., & McKenzie, J. E. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011863 · Cited by 23 · cited 1×
“However, we expect the number of errors to be low given the extensive experience that the data collector (MJP) has from recording this type of information in previous studies [1, 14, 17, 22].”
BackgroundSelf-citationPage, M. J., McKenzie, J. E., Chau, M., Green, S., & Forbes, A. B. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.02.009 · Cited by 22
Self-citationAre orthodontic systematic reviews registered a priori in PROSPERO?
Sideri, S., Papageorgiou, S. N., & Eliades, T. (2017) · Journal of Orthodontics · doi:10.1080/14653125.2017.1370773 · Cited by 22
Liu, Z., Saldanha, I. J., Margolis, D. J., Dumville, J. C., & Cullum, N. A. (2017) · Wound Repair and Regeneration · doi:10.1111/wrr.12519 · Cited by 21
Research works printed but not linked: 1
- StataCorp Stata statistical software: release 14 2015 College Station StataCorp LP
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Self-citationPage, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
Self-citationPROSPERO: An International Register of Systematic Review Protocols
Schiavo, J. H. (2019) · Medical Reference Services Quarterly · doi:10.1080/02763869.2019.1588072 · Cited by 643
Harrison, H., Griffin, S. J., Kuhn, I., & Usher-Smith, J. A. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-0897-3 · Cited by 449
Parums, D. V. (2021) · Medical Science Monitor · doi:10.12659/msm.934475 · Cited by 399
Metadata
- Authors
- Page, M. J., Shamseer, L., & Tricco, A. C.
- Affiliations
- Monash University (AU)
- University of Ottawa (CA)
- St. Michael's Hospital (CA)
- Corresponding author
- Page, Matthew J.
- Venue
- Systematic Reviews
- Published
- 2018-02-20
- Volume
- 7
- Issue
- 1
- Pages
- 32-32
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5819709
- OpenAlex
- W2788728681
- Semantic Scholar
- c1868bd7ebb04f09f9901d426c689e42927086db
- Cited by
- 509
- References
- 44
- Citations by year
- 2026: 65 · 2025: 81 · 2024: 94 · 2023: 83 · 2022: 68 · 2021: 47 · 2020: 43 · 2019: 23 · 2018: 5
- FWCI
- 5.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Monash University Research Portal (Monash University) (submittedVersion, other-oa)
- TSpace (University of Toronto) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Medical Research Council
- National Health and Medical Research Council (1088535)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- website usage, research funding sources, research ethics committees, research funding agencies, research governance
- MeSH terms
- Systematic Reviews as Topic, Humans, Publications, Bibliometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
