Reporting of measures of accuracy in systematic reviews of diagnostic literature
Open accessThe DOI matches its Crossref record.
Abstract
BACKGROUND: There are a variety of ways in which accuracy of clinical tests can be summarised in systematic reviews. Variation in reporting of summary measures has only been assessed in a small survey restricted to meta-analyses of screening studies found in a single database. Therefore, we performed this study to assess the measures of accuracy used for reporting results of primary studies as well as their meta-analysis in systematic reviews of test accuracy studies. METHODS: Relevant reviews on test accuracy were selected from the Database of Abstracts of Reviews of Effectiveness (1994-2000), which electronically searches seven bibliographic databases and manually searches key resources. The structured abstracts of these reviews were screened and information on accuracy measures was extracted from the full texts of 90 relevant reviews, 60 of which used meta-analysis. RESULTS: Sensitivity or specificity was used for reporting the results of primary studies in 65/90 (72%) reviews, predictive values in 26/90 (28%), and likelihood ratios in 20/90 (22%). For meta-analysis, pooled sensitivity or specificity was used in 35/60 (58%) reviews, pooled predictive values in 11/60 (18%), pooled likelihood ratios in 13/60 (22%), and pooled diagnostic odds ratio in 5/60 (8%). Summary ROC was used in 44/60 (73%) of the meta-analyses. There were no significant differences in measures of test accuracy among reviews published earlier (1994-97) and those published later (1998-2000). CONCLUSIONS: There is considerable variation in ways of reporting and summarising results of test accuracy studies in systematic reviews. There is a need for consensus about the best ways of reporting results of test accuracy studies in reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
Meta-DiSc: a software for meta-analysis of test accuracy data
Zamora, J., Abraira, V., Muriel, A., Khan, K., & Coomarasamy, A. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-31 · Cited by 1,883
Self-citationA systematic review of tests predicting ovarian reserve and IVF outcome
Broekmans, F. J., Kwee, J., Hendriks, D. J., Mol, B. W., & Lambalk, C. B. (2006) · Human Reproduction Update · doi:10.1093/humupd/dml034 · Cited by 1,258
Singh, J. P., Grann, M., & Fazel, S. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.11.009 · Cited by 661
Evidence of bias and variation in diagnostic accuracy studies
Rutjes, A. W. S., Reitsma, J. B., Di Nisio, M., Smidt, N., van Rijn, J. C., & Bossuyt, P. M. M. (2006) · Canadian Medical Association Journal · doi:10.1503/cmaj.050090 · Cited by 611
Metadata
- Authors
- Honest, H., & Khan, K. S.
- Venue
- BMC Health Services Research
- Published
- 2002-03-07
- Volume
- 2
- Issue
- 1
- Pages
- 4-4
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W2140158567
- Cited by
- 112
- References
- 0
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reporting of measures of accuracy in systematic reviews of diagnostic literature. https://app.cochat.ai/papers/10.1186/1472-6963-2-4
- The paper
- Honest, H., & Khan, K. S. (2002). Reporting of measures of accuracy in systematic reviews of diagnostic literature. BMC Health Services Research. https://doi.org/10.1186/1472-6963-2-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.