The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy
Open accessAbstract
OBJECTIVES: To review how heterogeneity has been examined in systematic reviews of diagnostic test accuracy studies. DATA SOURCES: Centre for Reviews and Dissemination's Database of Abstracts of Reviews of Effects (DARE). REVIEW METHODS: Systematic reviews that evaluated a diagnostic or screening test by including studies that compared a test with a reference test were identified from DARE. Reviews for which structured abstracts had been written up to December 2002 were screened for inclusion. Data extraction was undertaken using standardised data extraction forms. RESULTS: A total of 189 systematic reviews met the inclusion criteria. The median number of studies included was 18. Meta-analyses have a higher number with a median of 22 studies compared with 11 for narrative reviews. Graphical plots to demonstrate the spread in study results were provided in 56% of meta-analyses; in 79% these were plots of sensitivity and specificity in the receiver operating characteristic (ROC) space. Statistical tests to identify heterogeneity were used in 32% of reviews: 41% of meta-analyses and 9% of reviews using narrative syntheses. The chi-squared test and Fisher's exact test to assess heterogeneity in individual aspects of test performance were the most common. In contrast, only 16% of meta-analyses used correlation coefficients to test for a threshold effect. A narrative synthesis was used in 30% of reviews. Of the meta-analyses, 52% carried out statistical pooling alone, 18% conducted only summary receiver operator characteristic (SROC) analyses and 30% used both methods of statistical synthesis. For those undertaking SROC analyses, the main differences between the models used were the weights chosen for the regression models, although in 42% of cases the use of, or choice of, weight was not provided. The proportion of reviews using statistical pooling alone has declined from 67% in 1995 to 42% in 2001, with a corresponding increase in the use of SROC methods, from 33% to 58%. However, two-thirds of those using SROC methods also carried out statistical pooling rather than presenting only SROC models. Reviews using SROC analyses also tended to present their results as some combination of sensitivity and specificity rather than using alternative, perhaps less clinically meaningful, means of data presentation such as diagnostic odds ratios. Three-quarters of meta-analyses attempted to investigate statistically possible sources of variation, using subgroup analysis or regression analysis. The impact of clinical or socio-demographic variables was investigated in 74% of these reviews and test- or threshold-related variables in 79%. At least one quality-related variable was investigated in 63% of reviews. Within this subset, the most commonly considered variables were the use of blinding, sample size, the reference test used and the avoidance of verification bias. CONCLUSIONS: The emphasis on pooling individual aspects of diagnostic test performance and the under-use of statistical tests and graphical approaches to identify heterogeneity perhaps reflect the uncertainty in the most appropriate methods to use and also greater familiarity with more traditional indices of test accuracy. This indicates the difficulty and complexity of carrying out such reviews. In these cases it is strongly suggested that meta-analyses are carried out with the involvement of a statistician familiar with the field. Further methodological work on the statistical methods available for combining diagnostic test accuracy studies is needed, as are sufficiently large, prospectively designed primary studies of diagnostic test accuracy comparing two or more tests for the same target disorder. Use of individual patient data meta-analysis in diagnostic test accuracy reviews should be explored to allow heterogeneity to be considered in more detail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163
Self-citationEmpirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124
Likelihood ratios with confidence: Sample size estimation for diagnostic test studies
Simel, D. L., Samsa, G. P., & Matchar, D. B. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90128-v · Cited by 932
A bivariate approach to meta-analysis
Van Houwelingen, H. C., Zwinderman, K. H., & Stijnen, T. (1993) · Statistics in Medicine · doi:10.1002/sim.4780122405 · Cited by 327
How Useful Is Paracetamol Absorption as a Marker of Gastric Emptying? A Systematic Literature Study
Willems, M., Quartero, A. O., & Numans, M. E. (2001) · Digestive Diseases and Sciences · doi:10.1023/a:1011935603893 · Cited by 211
Cited by
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Kahn (2012) · doi:10.1378/chest.11-2296 · Cited by 2,693
Hegedus, E. J., Goode, A. P., Cook, C. E., Michener, L., Myer, C. A., Myer, D. M., & Wright, A. A. (2012) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091066 · Cited by 538
Antithrombotic and Thrombolytic Therapy for Ischemic Stroke
Lansberg, M. G., O'Donnell, M. J., Khatri, P., Lang, E. S., Nguyen-Huynh, M. N., Schwartz, N. E., Sonnenberg, F. A., Schulman, S., Vandvik, P. O., Spencer, F. A., et al. (2012) · Chest · doi:10.1378/chest.11-2302 · Cited by 455
Janda, S., Shahidi, N., Gin, K., & Swiston, J. (2011) · Heart · doi:10.1136/hrt.2010.212084 · Cited by 375
Metadata
- Authors
- Dinnes, J., Deeks, J., Kirby, J., & Roderick, P.
- Venue
- Health Technology Assessment
- Published
- 2005-03
- Volume
- 9
- Issue
- 12
- Pages
- 1-113, iii
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2005942667
- Cited by
- 438
- References
- 7
- FWCI
- 2.67
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. https://app.cochat.ai/papers/10.3310/hta9120
- The paper
- Dinnes, J., Deeks, J., Kirby, J., & Roderick, P. (2005). A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technology Assessment. https://doi.org/10.3310/hta9120
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.