CoChat

Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study

Open access

The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Systematic reviews (SRs) can help decision makers interpret the deluge of published biomedical literature. However, a SR may be of limited use if the methods used to conduct the SR are flawed, and reporting of the SR is incomplete. To our knowledge, since 2004 there has been no cross-sectional study of the prevalence, focus, and completeness of reporting of SRs across different specialties. Therefore, the aim of our study was to investigate the epidemiological and reporting characteristics of a more recent cross-section of SRs. METHODS AND FINDINGS: We searched MEDLINE to identify potentially eligible SRs indexed during the month of February 2014. Citations were screened using prespecified eligibility criteria. Epidemiological and reporting characteristics of a random sample of 300 SRs were extracted by one reviewer, with a 10% sample extracted in duplicate. We compared characteristics of Cochrane versus non-Cochrane reviews, and the 2014 sample of SRs versus a 2004 sample of SRs. We identified 682 SRs, suggesting that more than 8,000 SRs are being indexed in MEDLINE annually, corresponding to a 3-fold increase over the last decade. The majority of SRs addressed a therapeutic question and were conducted by authors based in China, the UK, or the US; they included a median of 15 studies involving 2,072 participants. Meta-analysis was performed in 63% of SRs, mostly using standard pairwise methods. Study risk of bias/quality assessment was performed in 70% of SRs but was rarely incorporated into the analysis (16%). Few SRs (7%) searched sources of unpublished data, and the risk of publication bias was considered in less than half of SRs. Reporting quality was highly variable; at least a third of SRs did not report use of a SR protocol, eligibility criteria relating to publication status, years of coverage of the search, a full Boolean search logic for at least one database, methods for data extraction, methods for study risk of bias assessment, a primary outcome, an abstract conclusion that incorporated study limitations, or the funding source of the SR. Cochrane SRs, which accounted for 15% of the sample, had more complete reporting than all other types of SRs. Reporting has generally improved since 2004, but remains suboptimal for many characteristics. CONCLUSIONS: An increasing number of SRs are being published, and many are poorly conducted and reported. Strategies are needed to help reduce this avoidable waste in research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pmed.1002028

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Flow diagram of identification, screening, and inclusion of SRs.
Fig 1 Flow diagram of identification, screening, and inclusion of SRs.CC BY · PubMed Central
Fig 2 Unadjusted risk ratio associations between reporting characteristics and type of SR: Cochrane versus non-Cochrane therapeutic SRs.
Fig 2 Unadjusted risk ratio associations between reporting characteristics and type of SR: Cochrane versus non-Cochrane therapeutic SRs.CC BY · PubMed Central
Fig 3 Unadjusted risk ratio associations between reporting characteristics and self-reported use of PRISMA in non-Cochrane therapeutic SRs.
Fig 3 Unadjusted risk ratio associations between reporting characteristics and self-reported use of PRISMA in non-Cochrane therapeutic SRs.CC BY · PubMed Central
Fig 4 Unadjusted risk ratio associations between reporting characteristics and year: 2004 versus 2014.
Fig 4 Unadjusted risk ratio associations between reporting characteristics and year: 2004 versus 2014.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

23 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 41 references

Research works printed but not linked: 1

  1. 2011, Review Manager (RevMan), version 5.1

Cited by

See all 793

Metadata

Authors
Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., & Moher, D.
Affiliations
  • University of Bristol (GB)
  • University of Ottawa (CA)
  • University of Oxford (GB)
  • Ottawa Hospital Research Institute (CA)
  • Children's Hospital of Eastern Ontario (CA)
  • St. Michael's Hospital (CA)
  • Universitat de València (ES)
  • Lanzhou University (CN)
  • Vancouver General Hospital (CA)
Corresponding author
Moher, David
Venue
PLOS Medicine
Published
2016-05-24
Volume
13
Issue
5
Pages
e1002028
ISSN
  • 1549-1277 (ISSN-L)
  • 1549-1676
OpenAlex
W2396846174
Cited by
768
References
41
Citations by year
2026: 25 · 2025: 43 · 2024: 85 · 2023: 73 · 2022: 85 · 2021: 146 · 2020: 95 · 2019: 83 · 2018: 58 · 2017: 60 · 2016: 15
FWCI
24.71
Type
journal article
Language
en
Open access
Locations
  • PLoS Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Explore Bristol Research (publishedVersion, other-oa)
  • Monash University Research Portal (Monash University) (acceptedVersion, other-oa)
  • Lanzhou University Institutional Repository (submittedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
  • Bristol Research (University of Bristol) (submittedVersion, other-oa)
Funders
  • National Institute for Health and Care Research
  • Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
  • Governo Brasil
  • Generalitat Valenciana (PROMETEOII/2015/021)
  • Canadian Institutes of Health Research (1088535)
  • Medical Research Council (MR/J00488X/1)
  • National Health and Medical Research Council (1088535)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
  • Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
Keywords
systematic reviews, reporting quality, meta-analysis, risk of bias assessment, publication bias, research funding disclosure, biomedical literature, research quality improvement, research integrity, research transparency, research accountability, research reproducibility, research credibility, research trustworthiness
MeSH terms
Cross-Sectional Studies, Epidemiologic Methods, Humans, Research Design, Review Literature as Topic, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. https://app.cochat.ai/papers/10.1371/journal.pmed.1002028
The paper
Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., & Moher, D. (2016). Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLOS Medicine. https://doi.org/10.1371/journal.pmed.1002028

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.