Meta-analysis of diagnostic accuracy studies in mental health
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Objectives: To explain methods for data synthesis of evidence from diagnostic test accuracy (DTA) studies, and to illustrate different types of analyses that may be performed in a DTA systematic review. Methods: We described properties of meta-analytic methods for quantitative synthesis of evidence. We used a DTA review comparing the accuracy of three screening questionnaires for bipolar disorder to illustrate application of the methods for each type of analysis. Results: The discriminatory ability of a test is commonly expressed in terms of sensitivity (proportion of those with the condition who test positive) and specificity (proportion of those without the condition who test negative). There is a trade-off between sensitivity and specificity, as an increasing threshold for defining test positivity will decrease sensitivity and increase specificity. Methods recommended for meta-analysis of DTA studies --such as the bivariate or hierarchical summary receiver operating characteristic (HSROC) model --jointly summarise sensitivity and specificity while taking into account this threshold effect, as well as allowing for between study differences in test performance beyond what would be expected by chance. The bivariate model focuses on estimation of a summary sensitivity and specificity at a common threshold while the HSROC model focuses on the estimation of a summary curve from studies that have used different thresholds. Conclusions: Meta-analyses of diagnostic accuracy studies can provide answers to important clinical questions. We hope this article will provide clinicians with sufficient understanding of the terminology and methods to aid interpretation of systematic reviews and facilitate better patient care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
Hirschfeld, R. M. A., Williams, J. B. W., Spitzer, R. L., Calabrese, J. R., Flynn, L., Keck, P. E., Lewis, L., McElroy, S. L., Post, R. M., Rapport, D. J., et al. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.11.1873 · Cited by 1,525
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
Self-citationXpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults
Steingart, K. R., Sohn, H., Schiller, I., Kloda, L. A., Boehme, C. C., Pai, M., & Dendukuri, N. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009593.pub2 · Cited by 253
Empirical evidence of the importance of comparative studies of diagnostic test accuracy
Takwoingi, Y., Leeflang, M. M. G., & Deeks, J. J. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-7-201304020-00006 · Cited by 187
Self-citationSample sizes of studies on diagnostic accuracy: literature survey.
Bachmann, L. M., Puhan, M. A., Riet, G. T., & Bossuyt, P. M. (2006) · BMJ · doi:10.1136/bmj.38793.637789.2f · Cited by 184
Value of composite reference standards in diagnostic research
Naaktgeboren, C. A., Bertens, L. C. M., Smeden, M. V., Groot, J. A. H. D., Moons, K. G. M., & Reitsma, J. B. (2013) · BMJ · doi:10.1136/bmj.f5605 · Cited by 105 · cited 1×
“The reference standard is used to verify the presence or absence of the target condition, and may be a single test or a combination of tests.(1) The ideal index test should have no misclassification errors (false negatives or false positives), but in clinical practice such a test is unlikely to exist.”
Method
Cited by
Salameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationBreton, A., Casey, D., & Arnaoutoglou, N. A. (2019) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.5016 · Cited by 297
Wagner, S., Engel, A., Engelmann, J., Herzog, D., Dreimüller, N., Müller, M. B., Tadić, A., & Lieb, K. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.07.003 · Cited by 73
Orme, M. E., Voreck, A., Aksouh, R., Ramsey-Goldman, R., & Schreurs, M. W. J. (2021) · Autoimmunity Reviews · doi:10.1016/j.autrev.2021.102943 · Cited by 34
Singh, M., Tuteja, A., Wong, D. T., Goel, A., Trivedi, A., Tomlinson, G., & Chan, V. (2019) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004350 · Cited by 33
Anti-dsDNA Testing Specificity for Systemic Lupus Erythematosus: A Systematic Review.
Orme, M. E., Voreck, A., Aksouh, R., & Schreurs, M. W. J. (2022) · The Journal of Applied Laboratory Medicine · doi:10.1093/jalm/jfab146 · Cited by 30
“The plots show the individual study data and a summary (pooled) estimate taking into account all studies as well as the HSROC curve, a 95% confidence region around the summary estimate (based on the study observations), and a 95% prediction region [to allow for potential unobserved heterogeneity: if a new study was co…”
Method
Metadata
- Authors
- Takwoingi, Y., Riley, R. D., & Deeks, J. J.
- Venue
- Evidence Based Mental Health
- Publisher
- BMJ
- Published
- 2015-10-07
- Volume
- 18
- Issue
- 4
- Pages
- 103-109
- ISSN
- 1362-0347 (ISSN-L)
- 1468-960X
- OpenAlex
- W2195943384
- Cited by
- 102
- References
- 7
- FWCI
- 0.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.