CoChat

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Do reporting guidelines have an impact? Empirical assessment of changes in reporting before and after the PRISMA extension statement for network meta-analysis

Open access

Abstract

Background: The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) extension statement for network meta-analysis (NMA) published in 2015 promotes comprehensive reporting in published systematic reviews with NMA. PRISMA-NMA includes 32 items: 27 core items as indicated in the 2009 PRISMA Statement and five items specific to the reporting of NMAs. Although NMA reporting is improving, it is unclear whether PRISMA-NMA has accelerated this improvement. We aimed to investigate the impact of PRISMA-NMA and highlight key items that require attention and improvement. Methods: We updated our previous collection of NMAs with articles published between April 2015 and July 2018. We assessed the completeness of reporting for each NMA, including main manuscript and online supplements, using the PRISMA-NMA checklist. The PRISMA-NMA checklist originally includes 32 total items (i.e. a 32-point scale original PRISMA-NMA score). We also prepared a modified version of the PRISMA-NMA checklist with 49 items to evaluate separately at a more granular level all multiple-content items (i.e. a 49-point scale modified PRISMA-NMA score). We compared average reporting scores of articles published until and after 2015. Results: In the 1144 included NMAs the mean modified PRISMA-NMA score was 32.1 (95% CI 31.8–32.4) of a possible 49-excellence-score. For 1-year increase, the mean modified score increased by 0.96 (95% CI 0.32 to 1.59) for 389 NMAs published until 2015 and by 0.53 (95% CI 0.02 to 1.04) for 755 NMAs published after 2015. The mean modified PRISMA-NMA score for NMAs published after 2015 was higher by 0.81 (95% CI 0.23 to 1.39) compared to before 2015 when adjusting for journal impact factor, type of review, funding, and treatment category. Description of summary effect sizes to be used, presentation of individual study data, sources of funding for the systematic review, and role of funders dropped in frequency after 2015 by 6–16%. Conclusions: NMAs published after 2015 more frequently reported the five items associated with NMA compared to those published until 2015. However, improvement in reporting after 2015 is compatible with that observed on a yearly basis until 2015, and hence, it could not be attributed solely to the publication of the PRISMA-NMA.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13643-021-01780-9

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Flow diagram of the selection process for the included systematic reviews and network meta-analyses
Fig. 1 Flow diagram of the selection process for the included systematic reviews and network meta-analysesCC BY · PubMed Central
Fig. 2 Number of systematic reviews and network meta-analyses, and per-paper average modified PRISMA-NMA score published between 2013 and 2018 ‘*’ denotes that the search was performed up to July 2018, and thus only 7 months of that year are reflected in this graph. Error bars parallel to the y-axis represent the uncertainty of the modified PRISMA-NMA score
Fig. 2 Number of systematic reviews and network meta-analyses, and per-paper average modified PRISMA-NMA score published between 2013 and 2018 ‘*’ denotes that the search was performed up to July 2018, and thus only 7 months of that year are reflected in this graph. Error bars parallel to the y-axis represent the uncertainty of the modified PRISMA-NMA scoreCC BY · PubMed Central
Fig. 3 Plot of the percentage of adequately reporting the 49 modified PRISMA-NMA items overall and according to publication interval 2013–2015 and 2016–2018. PRISMA items are ordered from least to most well reported irrespective publication year. Statistically significant differences are indicated with a bold font. Each cell is coloured according to the reporting using the transformation of three colours: red (0%), yellow (50%), and green (100%)
Fig. 3 Plot of the percentage of adequately reporting the 49 modified PRISMA-NMA items overall and according to publication interval 2013–2015 and 2016–2018. PRISMA items are ordered from least to most well reported irrespective publication year. Statistically significant differences are indicated with a bold font. Each cell is coloured according to the reporting using the transformation of three colours: red (0%), yellow (50%), and green (100%)CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 19 references

Cited by

See all 53

Metadata

Authors
Veroniki, A. A., Tsokani, S., Zevgiti, S., Pagkalidou, I., Kontouli, K.-M., Ambarcioglu, P., Pandis, N., Lunny, C., Nikolakopoulou, A., Papakonstantinou, T., Chaimani, A., Straus, S. E., Hutton, B., Tricco, A. C., Mavridis, D., & Salanti, G.
Affiliations
  • St. Michael's Hospital (CA)
  • University of Ioannina (GR)
  • Aristotle University of Thessaloniki (GR)
  • University of Bern (CH)
  • University of British Columbia (CA)
  • Inserm (FR)
  • University of Ottawa (CA)
Corresponding author
Veroniki, Areti Angeliki
Venue
Systematic Reviews
Published
2021-09-10
Volume
10
Issue
1
Pages
246-246
ISSN
2046-4053 (ISSN-L)
OpenAlex
W3175039239
Cited by
53
References
19
Citations by year
2026: 7 · 2025: 12 · 2024: 13 · 2023: 9 · 2022: 11 · 2021: 1
FWCI
4.91
Type
journal article
Language
en
Open access
Licence
Locations
  • Systematic Reviews (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • uO Research (University of Ottawa) (submittedVersion, public-domain)
  • TSpace (University of Toronto) (submittedVersion, other-oa)
  • BORIS (University Library Bern) (submittedVersion, cc-by)
  • cIRcle (University of British Columbia) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Science Foundation
  • European Commission (754936, HORIZON2020)
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (179158, 320030)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
network meta-analysis, reporting guidelines, reporting quality, guideline adherence, reporting completeness, funding disclosure, journal impact factor, reproducibility
MeSH terms
Network Meta-Analysis as Topic, Guidelines as Topic, Checklist

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Do reporting guidelines have an impact? Empirical assessment of changes in reporting before and after the PRISMA extension statement for network meta-analysis. https://app.cochat.ai/papers/10.1186/s13643-021-01780-9
The paper
Veroniki, A. A., Tsokani, S., Zevgiti, S., Pagkalidou, I., Kontouli, K.-M., Ambarcioglu, P., Pandis, N., Lunny, C., Nikolakopoulou, A., Papakonstantinou, T., Chaimani, A., Straus, S. E., Hutton, B., Tricco, A. C., Mavridis, D., & Salanti, G. (2021). Do reporting guidelines have an impact? Empirical assessment of changes in reporting before and after the PRISMA extension statement for network meta-analysis. Systematic Reviews. https://doi.org/10.1186/s13643-021-01780-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.