CoChat

Clarifying differences between reviews within evidence ecosystems

Open access
Gough, David, Thomas, James, Oliver, Sandy · 2019 · Systematic Reviews

The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.

Abstract

This paper builds on a 2012 paper by the same authors which argued that the types and brands of systematic review do not sufficiently differentiate between the many dimensions of different review questions and review methods (Gough et al., Syst Rev 1:28, 2012). The current paper extends this argument by considering the dynamic contexts, or 'evidence ecosystems', within which reviews are undertaken; the fact that these ecosystems are constantly changing; and the relevance of this broader context for understanding 'dimensions of difference' in the unfolding development and refinement of review methods.The concept of an evidence ecosystem is used to consider particular issues within the three key dimensions of difference outlined in the 2012 paper of (1) review aims and approach, (2) structure and components of reviews, and (3) breadth, depth, and 'work done' by reviews.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13643-019-1089-2

Cites

45 of 46 references verified1 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Evidence use ecosystem analytical framework [5]
Fig. 1 Evidence use ecosystem analytical framework [5]CC BY · PubMed Central
Fig. 2 ‘Dimensions of difference’ in approaches to synthesis [2]
Fig. 2 ‘Dimensions of difference’ in approaches to synthesis [2]CC BY · PubMed Central
Fig. 3 Map of personal development planning research: research method by country [47]
Fig. 3 Map of personal development planning research: research method by country [47]CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 46 references

Research works printed but not linked: 3

  1. Langer L, Tripney J, Gough D. The science of using science: researching the use of sesearch evidence in decision-making. London: EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London; 2016. p. 2016.
  2. Gough D, Kenny C, Vigurs C, Stansfield C, Rosen R, Taylor T. Social values related to the development of health and care guidance: literature review for NICE by its Research Support Unit. Report of the Research Support Unit for the National Institute for Health and Care Excellence. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2014.
  3. Peersman G. (1996) A descriptive mapping of health promotion studies in young people, EPPI Research Report. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 1996.

Cited by

See all 115

Metadata

Authors
Gough, D., Thomas, J., & Oliver, S.
Affiliations
  • University College London (GB)
  • University of Johannesburg (ZA)
Corresponding author
Gough, David
Venue
Systematic Reviews
Published
2019-07-15
Volume
8
Issue
1
Pages
170-170
ISSN
2046-4053 (ISSN-L)
OpenAlex
W2961682569
Cited by
115
References
46
Citations by year
2026: 13 · 2025: 14 · 2024: 14 · 2023: 10 · 2022: 28 · 2021: 24 · 2020: 11 · 2019: 1
FWCI
10.69
Type
journal article
Language
en
Open access
Licence
Locations
  • Systematic Reviews (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UCL Discovery (University College London) (submittedVersion)
Funders
  • World Health Organization
  • Department of Health and Social Care
  • Department for International Development
  • Alliance for Health Policy and Systems Research
  • Economic and Social Research Council
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords
evidence ecosystem, review methodology
MeSH terms
Systematic Reviews as Topic, Humans, Research Design, Ecosystem

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Clarifying differences between reviews within evidence ecosystems. https://app.cochat.ai/papers/10.1186/s13643-019-1089-2
The paper
Gough, D., Thomas, J., & Oliver, S. (2019). Clarifying differences between reviews within evidence ecosystems. Systematic Reviews. https://doi.org/10.1186/s13643-019-1089-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.