CoChat

Completeness of Reporting of Systematic Reviews of Diagnostic Test Accuracy Based on the PRISMA-DTA Reporting Guideline

Open access
Salameh, Jean-Paul, McInnes, Matthew D F, Moher, David, Thombs, Brett D, McGrath, Trevor A, Frank, Robert, Dehmoobad Sharifabadi, Anahita, Kraaijpoel, Noémie, Levis, Brooke, Bossuyt, Patrick M · 2019 · Clinical Chemistry
Cited by 37

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

BACKGROUND: We evaluated the completeness of reporting of diagnostic test accuracy (DTA) systematic reviews using the recently developed Preferred Reporting Items for Systematic Reviews and MetaAnalyses (PRISMA)-DTA guidelines. METHODS: MEDLINE® was searched for DTA systematic reviews published October 2017 to January 2018. The search time span was modulated to reach the desired sample size of 100 systematic reviews. Reporting on a per-item basis using PRISMA-DTA was evaluated. RESULTS: One hundred reviews were included. Mean reported items were 18.6 of 26 (71%; SD = 1.9) for PRISMA-DTA and 5.5 of 11 (50%; SD = 1.2) for PRISMA-DTA for abstracts. Items in the results were frequently reported. Items related to protocol registration, characteristics of included studies, results synthesis, and definitions used in data extraction were infrequently reported. Infrequently reported items from PRISMA-DTA for abstracts included funding information, strengths and limitations, characteristics of included studies, and assessment of applicability. Reporting completeness was higher in higher impact factor journals (18.9 vs 18.1 items; P = 0.04), studies that cited PRISMA (18.9 vs 17.7 items; P = 0.003), or used supplementary material (19.1 vs 18.0 items; P = 0.004). Variability in reporting was associated with author country (P = 0.04) but not journal (P = 0.6), abstract word count limitations (P = 0.9), PRISMA adoption (P = 0.2), structured abstracts (P = 0.2), study design (P = 0.8), subspecialty area (P = 0.09), or index test (P = 0.5). Abstracts with a higher word count were more informative (R = 0.4; P < 0.001). No association with word counts was observed for full-text reports (R = −0.03; P = 0.06). CONCLUSIONS: Recently published reports of DTA systematic reviews are not fully informative when evaluated against the PRISMA-DTA guidelines. These results should guide knowledge translation strategies, including journal level (e.g., PRISMA-DTA adoption, increased abstract word count, and use of supplementary material) and author level (PRISMA-DTA citation awareness) strategies.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1373/clinchem.2018.292987

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 37

Metadata

Authors
Salameh, J.-P., McInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Frank, R., Dehmoobad Sharifabadi, A., Kraaijpoel, N., Levis, B., & Bossuyt, P. M.
Venue
Clinical Chemistry
Published
2019-02-01
Volume
65
Issue
2
Pages
291-301
ISSN
  • 0009-9147 (ISSN-L)
  • 1530-8561
OpenAlex
W2890889586
Cited by
37
References
6
FWCI
1.27
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.