CoChat

The benefits and challenges of conducting an overview of systematic reviews in public health: a focus on physical activity

Open access
Baker, P. R. A., Costello, J. T., Dobbins, M., B. Waters, E. · 2014 · Journal of Public Health
Cited by 53

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

The ultimate aim of Cochrane systematic reviews is to inform policy and practice decisions for better health outcomes. However, due to the increasing numbers of scientific publications, wading through the available evidence of both individual studies and systematic reviews can be challenging and overwhelming even for avid authors and readers. This paper briefly describes the first overview (a systematic review of reviews) of the Cochrane Public Health Group (CPHG) in development and proposes a way forward for the methodologies under consideration. Vast is the number of single studies being published every year relevant to public health. Collectively this presents an overwhelming challenge for those engaged in public health decision making both at a practice and policy level. Over the past 21 years, The Cochrane Collaboration1 has continuously improved the methodology for conducting rigorous systematic reviews, as well as compiling and publishing nearly 6000 systematic reviews that span the health care continuum in The Cochrane Database of Systematic Reviews. Systematic reviews are now a standard and well-recognized research tool, employing robust scientific methods in answering a focused question through comprehensively searching and identifying relevant studies, assessing risk of bias, summarizing and then interpreting all the available research.2 It is now well recognized that systematic reviews play an important role in identifying the interventions that are potentially effective, those potentially ineffective, those that are harmful, and those where current evidence is insufficient. Whilst the recognition and role of systematic reviews within clinical disciplines such as pregnancy and childbirth3 is widespread and integrated in clinical care, systematic reviews addressing preventative, upstream and population-level interventions are increasing in number, and influence,4 but arguably have not yet reached a state of integration in public health policy and practice. The numbers and span of relevant reviews is increasing: 800 systematic reviews relevant to public health decision making are on The Cochrane Database of Systematic Reviews. Public health professionals, however, have reported challenges in identifying public health relevant Cochrane reviews both when searching The Cochrane Library or other electronic databases, such as PubMed.5 In addressing this challenge, Health Evidence™ was developed (http://www.healthevidence.org). Health Evidence™ is a freely accessible, online registry of published systematic reviews published since 1995, which evaluate the effectiveness of public health interventions.6 All reviews included in Health Evidence™ have been assessed for methodological quality by two independent raters and this rating is provided in the site for each review. It includes all Cochrane reviews relevant to public health as well as systematic reviews which are published outside The Cochrane Library. While a resource such as Health Evidence™ assists public health decision makers to quickly find evidence related to the effectiveness of public health interventions, new challenges with respect to the evidence are emerging. For example, in the past 15 years, the magnitude of research and systematic reviews being published related to public health has increased dramatically. Some public health topics, chronic disease prevention for example, now have hundreds of systematic reviews with more being published every month. Recent searches of Health Evidence™ for high-quality reviews published since 2008 on interventions targeted at physical activity and nutrition, yielded 272 and 268 reviews, respectively. The challenge now for public health decision makers is to determine which of these reviews is best to answer their question. The issue becomes even more challenging if the results of reviews conflict, as is often the case when inclusion criteria and methods vary despite common overall topics and titles, leading to quality heterogeneity, with 582 of the 3761 reviews rated in Health Evidence™ as being of weak methodological quality. Health Evidence™ does facilitate search refinement with features such as topic focus, and the filtering of results for quality and year of publication. However, should multiple reviews for the same intervention be identified, users are then presented with the challenge of deciding which to use, or developing strategies for summarizing results across reviews. The Cochrane Collaboration, through regular updating and the use of rigorous methods in systematic reviews, aims to continue to strive for leadership and rigorous methodological inquiry.7 High-quality, efficient approaches to summarize results across reviews to support evidence informed public health decision making is now urgently called for, with a particular lens for public health that accounts for the complexity and contextual challenges presented, as a result of the amalgam of content that falls under the public health um

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/pubmed/fdu050

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 53

Metadata

Authors
Baker, P. R. A., Costello, J. T., Dobbins, M., & B. Waters, E.
Venue
Journal of Public Health
Published
2014-08-01
Volume
36
Issue
3
Pages
517-521
ISSN
  • 0943-1853 (ISSN-L)
  • 1741-3842
  • 1741-3850
OpenAlex
W2165271154
Cited by
53
References
4
FWCI
2.44
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.