The benefits and challenges of conducting an overview of systematic reviews in public health: a focus on physical activity
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The ultimate aim of Cochrane systematic reviews is to inform policy and practice decisions for better health outcomes. However, due to the increasing numbers of scientific publications, wading through the available evidence of both individual studies and systematic reviews can be challenging and overwhelming even for avid authors and readers. This paper briefly describes the first overview (a systematic review of reviews) of the Cochrane Public Health Group (CPHG) in development and proposes a way forward for the methodologies under consideration. Vast is the number of single studies being published every year relevant to public health. Collectively this presents an overwhelming challenge for those engaged in public health decision making both at a practice and policy level. Over the past 21 years, The Cochrane Collaboration1 has continuously improved the methodology for conducting rigorous systematic reviews, as well as compiling and publishing nearly 6000 systematic reviews that span the health care continuum in The Cochrane Database of Systematic Reviews. Systematic reviews are now a standard and well-recognized research tool, employing robust scientific methods in answering a focused question through comprehensively searching and identifying relevant studies, assessing risk of bias, summarizing and then interpreting all the available research.2 It is now well recognized that systematic reviews play an important role in identifying the interventions that are potentially effective, those potentially ineffective, those that are harmful, and those where current evidence is insufficient. Whilst the recognition and role of systematic reviews within clinical disciplines such as pregnancy and childbirth3 is widespread and integrated in clinical care, systematic reviews addressing preventative, upstream and population-level interventions are increasing in number, and influence,4 but arguably have not yet reached a state of integration in public health policy and practice. The numbers and span of relevant reviews is increasing: 800 systematic reviews relevant to public health decision making are on The Cochrane Database of Systematic Reviews. Public health professionals, however, have reported challenges in identifying public health relevant Cochrane reviews both when searching The Cochrane Library or other electronic databases, such as PubMed.5 In addressing this challenge, Health Evidence™ was developed (http://www.healthevidence.org). Health Evidence™ is a freely accessible, online registry of published systematic reviews published since 1995, which evaluate the effectiveness of public health interventions.6 All reviews included in Health Evidence™ have been assessed for methodological quality by two independent raters and this rating is provided in the site for each review. It includes all Cochrane reviews relevant to public health as well as systematic reviews which are published outside The Cochrane Library. While a resource such as Health Evidence™ assists public health decision makers to quickly find evidence related to the effectiveness of public health interventions, new challenges with respect to the evidence are emerging. For example, in the past 15 years, the magnitude of research and systematic reviews being published related to public health has increased dramatically. Some public health topics, chronic disease prevention for example, now have hundreds of systematic reviews with more being published every month. Recent searches of Health Evidence™ for high-quality reviews published since 2008 on interventions targeted at physical activity and nutrition, yielded 272 and 268 reviews, respectively. The challenge now for public health decision makers is to determine which of these reviews is best to answer their question. The issue becomes even more challenging if the results of reviews conflict, as is often the case when inclusion criteria and methods vary despite common overall topics and titles, leading to quality heterogeneity, with 582 of the 3761 reviews rated in Health Evidence™ as being of weak methodological quality. Health Evidence™ does facilitate search refinement with features such as topic focus, and the filtering of results for quality and year of publication. However, should multiple reviews for the same intervention be identified, users are then presented with the challenge of deciding which to use, or developing strategies for summarizing results across reviews. The Cochrane Collaboration, through regular updating and the use of rigorous methods in systematic reviews, aims to continue to strive for leadership and rigorous methodological inquiry.7 High-quality, efficient approaches to summarize results across reviews to support evidence informed public health decision making is now urgently called for, with a particular lens for public health that accounts for the complexity and contextual challenges presented, as a result of the amalgam of content that falls under the public health um
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Physical Activity, All-Cause Mortality, and Longevity of College Alumni
Paffenbarger, R. S., Hyde, R., Wing, A. L., & Hsieh, C.-C. (1986) · New England Journal of Medicine · doi:10.1056/nejm198603063141003 · Cited by 2,742
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227
A descriptive analysis of overviews of reviews published between 2000 and 2011.
Hartling, L., Chisholm, A., Thomson, D., & Dryden, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049667 · Cited by 241
Cited by
Zubala, A., MacGillivray, S., Frost, H., Kroll, T., Skelton, D. A., Gavine, A., Gray, N. M., Toma, M., & Morris, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180902 · Cited by 411
Choi, J., Lee, M., Lee, J.-K., Kang, D., & Choi, J.-Y. (2017) · BMC Public Health · doi:10.1186/s12889-017-4255-2 · Cited by 326
Hunt, H., Pollock, A., Campbell, P., Estcourt, L., & Brunton, G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0695-8 · Cited by 314
Community wide interventions for increasing physical activity
Baker, P. R., Francis, D. P., Soares, J., Weightman, A. L., & Foster, C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008366.pub3 · Cited by 299
Self-citationLunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0617-1 · Cited by 184
Metadata
- Authors
- Baker, P. R. A., Costello, J. T., Dobbins, M., & B. Waters, E.
- Venue
- Journal of Public Health
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-08-01
- Volume
- 36
- Issue
- 3
- Pages
- 517-521
- ISSN
- 0943-1853 (ISSN-L)
- 1741-3842
- 1741-3850
- OpenAlex
- W2165271154
- Cited by
- 53
- References
- 4
- FWCI
- 2.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The benefits and challenges of conducting an overview of systematic reviews in public health: a focus on physical activity. https://app.cochat.ai/papers/10.1093/pubmed/fdu050
- The paper
- Baker, P. R. A., Costello, J. T., Dobbins, M., & B. Waters, E. (2014). The benefits and challenges of conducting an overview of systematic reviews in public health: a focus on physical activity. Journal of Public Health. https://doi.org/10.1093/pubmed/fdu050
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.