The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Performance of methods for meta-analysis of diagnostic test accuracy with few studies or sparse data
Open accessAbstract
Hierarchical models such as the bivariate and hierarchical summary receiver operating characteristic (HSROC) models are recommended for meta-analysis of test accuracy studies. These models are challenging to fit when there are few studies and/or sparse data (for example zero cells in contingency tables due to studies reporting 100% sensitivity or specificity); the models may not converge, or give unreliable parameter estimates. Using simulation, we investigated the performance of seven hierarchical models incorporating increasing simplifications in scenarios designed to replicate realistic situations for meta-analysis of test accuracy studies. Performance of the models was assessed in terms of estimability (percentage of meta-analyses that successfully converged and percentage where the between study correlation was estimable), bias, mean square error and coverage of the 95% confidence intervals. Our results indicate that simpler hierarchical models are valid in situations with few studies or sparse data. For synthesis of sensitivity and specificity, univariate random effects logistic regression models are appropriate when a bivariate model cannot be fitted. Alternatively, an HSROC model that assumes a symmetric SROC curve (by excluding the shape parameter) can be used if the HSROC model is the chosen meta-analytic approach. In the absence of heterogeneity, fixed effect equivalent of the models can be applied.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Self-citationA hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations
Rutter, C. M., & Gatsonis, C. A. (2001) · Statistics in Medicine · doi:10.1002/sim.942 · Cited by 1,505
Moses, L. E., Shapiro, D., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
Self-citationThe design of simulation studies in medical statistics
Burton, A., Altman, D. G., Royston, P., & Holder, R. L. (2006) · Statistics in Medicine · doi:10.1002/sim.2673 · Cited by 752
A unification of models for meta-analysis of diagnostic accuracy studies
Harbord, R. M., Deeks, J. J., Egger, M., Whiting, P., & Sterne, J. A. C. (2007) · Biostatistics · doi:10.1093/biostatistics/kxl004 · Cited by 751
Self-citationChu, H., & Cole, S. R. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.06.011 · Cited by 708
The binomial distribution of meta-analysis was preferred to model within-study variability
Hamza, T. H., van Houwelingen, H. C., & Stijnen, T. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.016 · Cited by 385
A bivariate approach to meta-analysis
Van Houwelingen, H. C., Zwinderman, K. H., & Stijnen, T. (1993) · Statistics in Medicine · doi:10.1002/sim.4780122405 · Cited by 327
Bivariate Random Effects Meta-Analysis of ROC Curves
Arends, L. R., Hamza, T. H., van Houwelingen, J. C., Heijenbrok-Kal, M. H., Hunink, M. G. M., & Stijnen, T. (2008) · Medical Decision Making · doi:10.1177/0272989x08319957 · Cited by 325
Bivariate random-effects meta-analysis and the estimation of between-study correlation
Riley, R. D., Abrams, K. R., Sutton, A. J., Lambert, P. C., & Thompson, J. R. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-3 · Cited by 244
Self-citationHarbord, R. M., Whiting, P., Sterne, J. A. C., Egger, M., Deeks, J. J., Shang, A., & Bachmann, L. M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.09.013 · Cited by 217
Self-citationMacaskill, P. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.019 · Cited by 210
Sample sizes of studies on diagnostic accuracy: literature survey.
Bachmann, L. M., Puhan, M. A., Riet, G. T., & Bossuyt, P. M. (2006) · BMJ · doi:10.1136/bmj.38793.637789.2f · Cited by 184
Diagnosing Suspected Scaphoid Fractures: A Systematic Review and Meta-analysis
Yin, Z., Zhang, J.-B., Kan, S., & Wang, X.-G. (2009) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-009-1081-6 · Cited by 154
Hlibczuk, V., Dattaro, J. A., Jin, Z., Falzon, L., & Brown, M. D. (2009) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2009.06.509 · Cited by 112
Paul, M., Riebler, A., Bachmann, L. M., Rue, H., & Held, L. (2010) · Statistics in Medicine · doi:10.1002/sim.3858 · Cited by 98
Bivariate Random Effects Meta-Analysis of Diagnostic Studies Using Generalized Linear Mixed Models
Chu, H., Guo, H., & Zhou, Y. (2009) · Medical Decision Making · doi:10.1177/0272989x09353452 · Cited by 93
When are summary ROC curves appropriate for diagnostic meta‐analyses?
Chappell, F. M., RAAB, G. M., & Wardlaw, J. M. (2009) · Statistics in Medicine · doi:10.1002/sim.3631 · Cited by 91
Simel, D. L., & Bossuyt, P. M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.02.007 · Cited by 85
Statistical methods for multivariate meta-analysis of diagnostic tests: An overview and tutorial
Ma, X., Nie, L., Cole, S. R., & Chu, H. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280213492588 · Cited by 70
Meta‐analysis of diagnostic test data: A bivariate Bayesian modeling approach
Verde, P. E. (2010) · Statistics in Medicine · doi:10.1002/sim.4055 · Cited by 55
Hamza, T. H., Reitsma, J. B., & Stijnen, T. (2008) · Medical Decision Making · doi:10.1177/0272989x08323917 · Cited by 54
A composite likelihood method for bivariate meta-analysis in diagnostic systematic reviews
Chen, Y., Liu, Y., Ning, J., Nie, L., Zhu, H., & Chu, H. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280214562146 · Cited by 30
Performance measures of the bivariate random effects model for meta-analyses of diagnostic accuracy
Díaz, M. (2014) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2014.09.021 · Cited by 21
Ochodo, E., Reitsma, J. B., Bossuyt, P. M., & Leeflang, M. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.05.015 · Cited by 19
Meta-analysis methods for diagnostic accuracy
Begg, C. B. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.05.011 · Cited by 12
Research works printed but not linked: 1
- Macaskill P, Gatsonis C, Deeks JJ, et al. Chapter 10: analysing and presenting results. In: Deeks JJ, Bossuyt PM and Gatsonis C (eds) Cochrane handbook for systematic reviews of diagnostic test accuracy . Version 1.0. The Cochrane Collaboration, 2010. http://srdta.cochrane.org/.
Cited by
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Self-citationRapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection
Dinnes, J., Deeks, J. J., Adriano, A., Berhane, S., Davenport, C., Dittrich, S., Emperador, D., Takwoingi, Y., Cunningham, J., Beese, S., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013705 · Cited by 1,156
Self-citationSalameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationAntibody tests for identification of current and past infection with SARS-CoV-2
Deeks, J. J., Dinnes, J., Takwoingi, Y., Davenport, C., Spijker, R., Taylor-Phillips, S., Adriano, A., Beese, S., Dretzke, J., Ferrante di Ruffano, L., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013652 · Cited by 655
Self-citationRapid, point-of-care antigen tests for diagnosis of SARS-CoV-2 infection
Dinnes, J., Deeks, J. J., Berhane, S., Taylor, M., Adriano, A., Davenport, C., Dittrich, S., Emperador, D., Takwoingi, Y., Cunningham, J., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013705.pub2 · Cited by 591
Self-citation
Metadata
- Authors
- Takwoingi, Y., Guo, B., Riley, R. D., & Deeks, J. J.
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2015-06-26
- Volume
- 26
- Issue
- 4
- Pages
- 1896-1911
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2123300483
- Cited by
- 257
- References
- 28
- FWCI
- 3.68
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.