Epidemiology and reporting characteristics of overviews of reviews of healthcare interventions published 2012–2016: protocol for a systematic review
Open accessThe DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Overviews of systematic reviews (overviews) attempt to systematically retrieve and summarize the results of multiple systematic reviews (SRs) for a given condition or public health problem. Two prior descriptive analyses of overviews found substantial variation in the methodological approaches used in overviews, and deficiencies in reporting of key methodological steps. Since then, new methods have been developed so it is timely to update the prior descriptive analyses. The objectives are to: (1) investigate the epidemiological, descriptive, and reporting characteristics of a random sample of 100 overviews published from 2012 to 2016 and (2) compare these recently published overviews (2012-2016) to those published prior to 2012 (based on the prior descriptive analyses). METHODS: Medline, EMBASE, and CDSR will be searched for overviews published 2012-2016, using a validated search filter for overviews. Only overviews written in English will be included. All titles and abstracts will be screened by one review author; those deemed not relevant will be verified by a second person for exclusion. Full-texts will be assessed for inclusion by two reviewers independently. Of those deemed relevant, a random sample of 100 overviews will be selected for inclusion. Data extraction will be either performed by one reviewer with verification by a second reviewer or by one reviewer only depending on the complexity of the item. Discrepancies at any stage will be resolved by consensus or consulting a third person. Data will be extracted on the epidemiological, descriptive, and reporting characteristics of each overview. Data will be analyzed descriptively. When data are available for both time points (up to 2011 vs. 2012-2016), we will compare characteristics by calculating risk ratios or applying the Mann-Whitney test. DISCUSSION: Overviews are becoming increasingly valuable evidence syntheses, and the number of published overviews is increasing. However, former analyses found limitations in the conduct and reporting of overviews. This update of a recent sample of overviews will inform whether this has changed, while also identifying areas for further improvement. SYSTEMATIC REVIEW REGISTRATION: The review will not be registered in PROSPERO as it does not meet the eligibility criterion of dealing with health-related outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We conducted two evidence reviews to inform the initial list of items to include in PRIOR.”
From Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement. (2022) · cites this paper as [30]
In the citing paper
“The guideline is based on currently available evidence regarding the reporting of published overviews,30 a scoping review of currently available methodological guidance,14 and other recent evidence maps regarding the methods used in overviews of reviews.15 16”
From Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement. (2022) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 3×
“This protocol adheres to the Preferred Reporting Items for Systematic Review and Meta-Analysis-Protocols (PRISMA-P) [17].”
MethodInfluentialSystematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318 · cited 1×
“Since these two descriptive analyses were published, new methods for conducting overviews have been developed or tested, such as methods for dealing with multiple SRs published on the same topic area [4] and methods for displaying outcome data in overviews [5].”
MethodSelf-citationStatistics Notes: The odds ratio
Bland, J. M. (2000) · BMJ · doi:10.1136/bmj.320.7247.1468 · Cited by 1,294
Mann-Whitney test is not just a test of medians: differences in spread can be important
Hart, A. (2001) · BMJ · doi:10.1136/bmj.323.7309.391 · Cited by 433
Interpreting Results and Drawing Conclusions
Schünemann, H. J., Oxman, A. D., Vist, G. E., Higgins, J. P., Deeks, J. J., Glasziou, P., & Guyatt, G. H. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch12 · Cited by 366
A descriptive analysis of overviews of reviews published between 2000 and 2011.
Hartling, L., Chisholm, A., Thomson, D., & Dryden, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049667 · Cited by 241
Self-citationBecker, L. A., & Oxman, A. D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch22 · Cited by 218
Cited by
Gates, M., Gates, A., Pieper, D., Fernandes, R. M., Tricco, A. C., Moher, D., Brennan, S. E., Li, T., Pollock, M., Lunny, C., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070849 · Cited by 856
Self-citationKrnic Martinic, M., Pieper, D., Glatt, A., & Puljak, L. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0855-0 · Cited by 240
Self-citationPollock, M., Fernandes, R. M., Pieper, D., Tricco, A. C., Gates, M., Gates, A., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1252-9 · Cited by 228
Self-citationOverviews of systematic reviews: great promise, greater challenge
McKenzie, J. E., & Brennan, S. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0582-8 · Cited by 134
Gates, M., Gates, A., Guitard, S., Pollock, M., & Hartling, L. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01509-0 · Cited by 115
Self-citation
Metadata
- Authors
- Pieper, D., Pollock, M., Fernandes, R. M., Büchter, R. B., & Hartling, L.
- Affiliations
- Witten/Herdecke University (DE)
- University of Alberta (CA)
- University of Lisbon (PT)
- Institute for Quality and Efficiency in Health Care (DE)
- Corresponding author
- Pieper, Dawid
- Venue
- Systematic Reviews
- Published
- 2017-04-07
- Volume
- 6
- Issue
- 1
- Pages
- 73-73
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5383951
- OpenAlex
- W2604404026
- Cited by
- 25
- References
- 19
- Citations by year
- 2024: 3 · 2023: 1 · 2022: 6 · 2021: 7 · 2020: 2 · 2019: 4 · 2018: 1 · 2017: 1
- FWCI
- 0.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- overviews of systematic reviews, reporting characteristics, methodological quality, evidence synthesis, health interventions
- MeSH terms
- Systematic Reviews as Topic, Data Interpretation, Statistical, Humans, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Epidemiology and reporting characteristics of overviews of reviews of healthcare interventions published 2012–2016: protocol for a systematic review. https://app.cochat.ai/papers/10.1186/s13643-017-0468-9
- The paper
- Pieper, D., Pollock, M., Fernandes, R. M., Büchter, R. B., & Hartling, L. (2017). Epidemiology and reporting characteristics of overviews of reviews of healthcare interventions published 2012–2016: protocol for a systematic review. Systematic Reviews. https://doi.org/10.1186/s13643-017-0468-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.