CoChat

Selecting and implementing overview methods: implications from five exemplar overviews

Open access

The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Overviews of systematic reviews are an increasingly popular method of evidence synthesis; there is a lack of clear guidance for completing overviews and a number of methodological challenges. At the UK Cochrane Symposium 2016, methodological challenges of five overviews were explored. Using data from these five overviews, practical implications to support methodological decision making of authors writing protocols for future overviews are proposed. METHODS: Methods, and their justification, from the five exemplar overviews were tabulated and compared with areas of debate identified within current literature. Key methodological challenges and implications for development of overview protocols were generated and synthesised into a list, discussed and refined until there was consensus. RESULTS: Methodological features of three Cochrane overviews, one overview of diagnostic test accuracy and one mixed methods overview have been summarised. Methods of selection of reviews and data extraction were similar. Either the AMSTAR or ROBIS tool was used to assess quality of included reviews. The GRADE approach was most commonly used to assess quality of evidence within the reviews. Eight key methodological challenges were identified from the exemplar overviews. There was good agreement between our findings and emerging areas of debate within a recent published synthesis. Implications for development of protocols for future overviews were identified. CONCLUSIONS: Overviews are a relatively new methodological innovation, and there are currently substantial variations in the methodological approaches used within different overviews. There are considerable methodological challenges for which optimal solutions are not necessarily yet known. Lessons learnt from five exemplar overviews highlight a number of methodological decisions which may be beneficial to consider during the development of an overview protocol.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13643-017-0534-3

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 56 references

Research works printed but not linked: 10

  1. Pollock A, Hunt H, Campbell P, Estcourt L, Brunton G. Cochrane overviews of reviews: exploring the methods and challenges. Birmingham: UK and Ireland Cochrane Symposium; 2016.
  2. Hunt H, Kuzma E, C H: A review of existing systematic reviews summarising the accuracy of brief cognitive assessments for identifying dementia, particularly for use in primary care. Protocol..In PROSPERO PROSPERO online; 2016.
  3. Brunton G, Dickson K, Khatwa M, Caird J, Oliver S, Hinds K, Thomas J. Developing evidence-informed, employer-led workplace health. London: EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London; 2016.
  4. INVOLVE. Public involvement in systematic reviews: Supplement to the briefing notes for researchers. Eastleigh: INVOLVE; 2012.
  5. MECIR. The Methodological Expectations of Cochrane Intervention Reviews (MECIR).Standards for Cochrane new reviews of interventions and their updates. 2017.
  6. Becker L, Oxman A: Chapter 22: Overviews of reviews. In Cochrane Handbook for Systematic Reviews of Interventions Version 510 (JPT H, S G eds.): The Cochrane Collaboration; 2011. Available from www.handbook.cochrane.org .
  7. PSTF. U.S. Preventive Services Task Force. Procedure Manual. In: AHRQ publication no 08-05118-EF. Rockville: U.S. Preventive Services Task Force; 2008.
  8. NICE. National Institute for Health and Clinical Excellence. The Guidelines Manual. London: National Institute for Health and Clinical Excellence; 2006.
  9. CCN: What is a systematic review? http://consumers.cochrane.org/what-systematic-review : Cochrane consumers network (CCN); 2017.
  10. EPOC. Effective Practice and Organisation of Care (EPOC): reporting the effects of an intervention in EPOC reviews. Section 24. How to report the effects of an intervention. In: EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2016.

Cited by

See all 134

Metadata

Authors
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L.
Affiliations
  • Glasgow Caledonian University (GB)
  • University College London (GB)
  • University of Exeter (GB)
  • John Radcliffe Hospital (GB)
Corresponding author
Pollock, Alex
Venue
Systematic Reviews
Published
2017-07-18
Volume
6
Issue
1
Pages
145-145
ISSN
2046-4053 (ISSN-L)
OpenAlex
W2738509363
Cited by
134
References
56
Citations by year
2026: 5 · 2025: 9 · 2024: 20 · 2023: 28 · 2022: 15 · 2021: 11 · 2020: 19 · 2019: 16 · 2018: 9 · 2017: 1
FWCI
10.90
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Systematic Reviews (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Open Research Exeter (University of Exeter) (publishedVersion, cc-by)
  • ResearchOnline (Glasgow Caledonian University) (acceptedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • Scottish Government
  • National Institute for Health and Care Research (13/89/09)
  • Physiotherapy Research Foundation
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
overviews of systematic reviews, methodological issues, evidence synthesis, AMSTAR, ROBIS, GRADE, review quality assessment
MeSH terms
Data Accuracy, Decision Making, Humans, Publications, Research Design, Review Literature as Topic, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Selecting and implementing overview methods: implications from five exemplar overviews. https://app.cochat.ai/papers/10.1186/s13643-017-0534-3
The paper
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L. (2017). Selecting and implementing overview methods: implications from five exemplar overviews. Systematic Reviews. https://doi.org/10.1186/s13643-017-0534-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.