The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations
Abstract
An important quality of meta‐analytic models for research synthesis is their ability to account for both within‐ and between‐study variability. Currently available meta‐analytic approaches for studies of diagnostic test accuracy work primarily within a fixed‐effects framework. In this paper we describe a hierarchical regression model for meta‐analysis of studies reporting estimates of test sensitivity and specificity. The model allows more between‐ and within‐study variability than fixed‐effect approaches, by allowing both test stringency and test accuracy to vary across studies. It is also possible to examine the effects of study specific covariates. Estimates are computed using Markov Chain Monte Carlo simulation with publicly available software (BUGS). This estimation method allows flexibility in the choice of summary statistics. We demonstrate the advantages of this modelling approach using a recently published meta‐analysis comparing three tests used to detect nodal metastasis of cervical cancer. Copyright © 2001 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
Hambleton, R. K., & Swaminathan, H. (1985) · doi:10.1007/978-94-017-1988-9 · Cited by 1,777
Cited by
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
“The statistical shortcomings of the sROC approach have been described before [11,13,36] Rutter et al.”
BackgroundMethodInfluentialMcInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Bossuyt, P. M., and the PRISMA-DTA Group, Clifford, T., Cohen, J. F., Deeks, J. J., Gatsonis, C., et al. (2018) · JAMA · doi:10.1001/jama.2017.19163 · Cited by 3,210
Self-citationDeeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Predicting adult obesity from childhood obesity: a systematic review and meta‐analysis
Simmonds, M., Llewellyn, A., Owen, C. G., & Woolacott, N. (2016) · Obesity Reviews · doi:10.1111/obr.12334 · Cited by 2,103
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models
Zou, K. H., O’Malley, A. J., & Mauri, L. (2007) · Circulation · doi:10.1161/circulationaha.105.594929 · Cited by 1,473
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
Self-citationCochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy
(2023) · doi:10.1002/9781119756194 · Cited by 757
Barker, T. H., Migliavaca, C. B., Stein, C., Colpani, V., Falavigna, M., Aromataris, E., & Munn, Z. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01381-z · Cited by 738
Salameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationDiagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
Lehman, C. D., Wellman, R. D., Buist, D. S. M., Kerlikowske, K., Tosteson, A. N. A., & Miglioretti, D. L. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.5231 · Cited by 678
Hegedus, E. J., Goode, A. P., Cook, C. E., Michener, L., Myer, C. A., Myer, D. M., & Wright, A. A. (2012) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091066 · Cited by 538
Multivariate meta‐analysis: Potential and promise
Jackson, D., Riley, R., & White, I. R. (2011) · Statistics in Medicine · doi:10.1002/sim.4172 · Cited by 530
Predicting suicide following self-harm: systematic review of risk factors and risk scales
Chan, M. K. Y., Bhatti, H., Meader, N., Stockton, S., Evans, J., O'Connor, R. C., Kapur, N., & Kendall, T. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.170050 · Cited by 501
Cytology versus HPV testing for cervical cancer screening in the general population
Koliopoulos, G., Nyaga, V. N., Santesso, N., Bryant, A., Martin-Hirsch, P. P., Mustafa, R. A., Schünemann, H., Paraskevaidis, E., & Arbyn, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008587.pub2 · Cited by 494
metandi: Meta-analysis of diagnostic accuracy using hierarchical logistic regression
Harbord, R. M., & Whiting, P. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900203 · Cited by 453
Kwok, R., Tse, Y. ‐., Wong, G. L. ‐., Ha, Y., Lee, A. U., Ngu, M. C., Chan, H. L. ‐., & Wong, V. W. ‐. (2014) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.12569 · Cited by 405
Marinovich, M. L., Houssami, N., Macaskill, P., Sardanelli, F., Irwig, L., Mamounas, E. P., von Minckwitz, G., Brennan, M. E., & Ciatto, S. (2013) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djs528 · Cited by 382
Rico‐Martín, S., Calderón‐García, J. F., Sánchez‐Rey, P., Franco‐Antonio, C., Martínez Alvarez, M., & Sánchez Muñoz‐Torrero, J. F. (2020) · Obesity Reviews · doi:10.1111/obr.13023 · Cited by 355
Physical examination for lumbar radiculopathy due to disc herniation in patients with low-back pain
van der Windt, D. A., Simons, E., Riphagen, I. I., Ammendolia, C., Verhagen, A. P., Laslett, M., Devillé, W., Deyo, R. A., Bouter, L. M., de Vet, H. C., et al. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007431.pub2 · Cited by 334
D'Antonio, F., Iacovella, C., Palacios-Jaraquemada, J., Bruno, C. H., Manzoli, L., & Bhide, A. (2014) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.13327 · Cited by 324
Consortium for the Early Identification of Alzheimer’s disease-Quebec, Belleville, S., Fouquet, C., Hudon, C., Zomahoun, H. T. V., & Croteau, J. (2017) · Neuropsychology Review · doi:10.1007/s11065-017-9361-5 · Cited by 308
Fernando, S. M., Tran, A., Taljaard, M., Cheng, W., Rochwerg, B., Seely, A. J. E., & Perry, J. J. (2018) · Annals of Internal Medicine · doi:10.7326/m17-2820 · Cited by 281
Dave, M., Elmunzer, B. J., Dwamena, B. A., & Higgins, P. D. R. (2010) · Radiology · doi:10.1148/radiol.10091953 · Cited by 265
Cherpanath, T. G. V., Hirsch, A., Geerts, B. F., Lagrand, W. K., Leeflang, M. M., Schultz, M. J., & Groeneveld, A. B. J. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001556 · Cited by 253
Vollgraff Heidweiller‐Schreurs, C. A., De Boer, M. A., Heymans, M. W., Schoonmade, L. J., Bossuyt, P. M. M., Mol, B. W. J., De Groot, C. J. M., & Bax, C. J. (2018) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.18809 · Cited by 255
Lombardi, G., Crescioli, G., Cavedo, E., Lucenteforte, E., Casazza, G., Bellatorre, A.-G., Lista, C., Costantino, G., Frisoni, G., Virgili, G., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009628.pub2 · Cited by 214
Empirical evidence of the importance of comparative studies of diagnostic test accuracy
Takwoingi, Y., Leeflang, M. M. G., & Deeks, J. J. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-7-201304020-00006 · Cited by 187
Which instruments to support diagnosis of depression have sufficient accuracy? A systematic review
Pettersson, A., Boström, K. B., Gustavsson, P., & Ekselius, L. (2015) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2015.1008568 · Cited by 187
(2022) · doi:10.1186/s13690-021-00747-5 · Cited by 150
Caradeux, J., Martinez-Portilla, R. J., Peguero, A., Sotiriadis, A., & Figueras, F. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2018.09.043 · Cited by 122
Dendukuri, N., Schiller, I., Joseph, L., & Pai, M. (2012) · Biometrics · doi:10.1111/j.1541-0420.2012.01773.x · Cited by 117
D'Antonio, F., Timor‐Tritsch, I. E., Palacios‐Jaraquemada, J., Monteagudo, A., Buca, D., Forlani, F., Minneci, G., Foti, F., Manzoli, L., Liberati, M., et al. (2018) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.18840 · Cited by 116
Lebersfeld, J. B., Swanson, M., Clesi, C. D., & O’Kelley, S. E. (2021) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04839-z · Cited by 111
Accuracy of laboratory tests for the diagnosis of Cushing syndrome
Galm, B. P., Qiao, N., Klibanski, A., Biller, B. M. K., & Tritos, N. A. (2020) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa105 · Cited by 100
Schwarzer, G., & Rücker, G. (2022) · Methods in Molecular Biology · doi:10.1007/978-1-0716-1566-9_10 · Cited by 90
Dodd, S. R., Lancaster, G. A., Craig, J. V., Smyth, R. L., & Williamson, P. R. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.10.004 · Cited by 90
Dopamine transporter imaging for the diagnosis of dementia with Lewy bodies
McCleery, J., Morgan, S., Bradley, K. M., Noel-Storr, A. H., Ansorge, O., & Hyde, C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010633.pub2 · Cited by 89
Leung, A. A., Symonds, C. J., Hundemer, G. L., Ronksley, P. E., Lorenzetti, D. L., Pasieka, J. L., Harvey, A., & Kline, G. A. (2022) · Hypertension · doi:10.1161/hypertensionaha.122.19377 · Cited by 89
Tinari, S., Buca, D., Cali, G., Timor‐Tritsch, I., Palacios‐Jaraquemada, J., Rizzo, G., Lucidi, A., Di Mascio, D., Liberati, M., & D'Antonio, F. (2021) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.22183 · Cited by 89
Kim, S.-J., Lee, S.-W., Pak, K., Kim, I.-J., & Kim, K. (2018) · The British Journal of Radiology · doi:10.1259/bjr.20170520 · Cited by 76
Toddler Screening for Autism Spectrum Disorder: A Meta-Analysis of Diagnostic Accuracy
Sánchez-García, A. B., Galindo-Villardón, P., Nieto-Librero, A. B., Martín-Rodero, H., & Robins, D. L. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-03865-2 · Cited by 66
JOSEPH, S., SELVARAJ, J., MANI, I., KUMARAGURUPARI, T., SHANG, X., MUDGIL, P., RAVILLA, T., & HE, M. (2024) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2024.02.012 · Cited by 69
THONG, L. T., CHOU, H. S., CHEW, H. S. J., & LAU, Y. (2023) · Lung Cancer · doi:10.1016/j.lungcan.2022.12.002 · Cited by 67
Zhang, S., Smailagic, N., Hyde, C., Noel-Storr, A. H., Takwoingi, Y., McShane, R., & Feng, J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010386.pub2 · Cited by 66
Chow, R., Midroni, J., Kaur, J., Boldt, G., Liu, G., Eng, L., Liu, F.-F., Haibe-Kains, B., Lock, M., & Raman, S. (2023) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djad013 · Cited by 65
Renz, P. B., Chume, F. C., Timm, J. R. T., Pimentel, A. L., & Camargo, J. L. (2019) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2018-1191 · Cited by 54
Bytyçi, I., & Henein, M. Y. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10122670 · Cited by 52
Mansukhani, M. P., Kolla, B. P., Wang, Z., & Morgenthaler, T. I. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7750 · Cited by 51
Irving, G., Holden, J., Stevens, R., & McManus, R. J. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012429 · Cited by 51
Lefebvre, C., Glanville, J., Beale, S., Boachie, C., Duffy, S., Fraser, C., Harbour, J., McCool, R., & Smith, L. (2017) · Health Technology Assessment · doi:10.3310/hta21690 · Cited by 49
Chan, J. Y. C., Bat, B. K. K., Wong, A., Chan, T. K., Huo, Z., Yip, B. H. K., Kowk, T. C. Y., & Tsoi, K. K. F. (2022) · Neuropsychology Review · doi:10.1007/s11065-021-09523-2 · Cited by 43
Abdallah, A., Hewson, J., Francoz, D., Selim, H., & Buczinski, S. (2016) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.13975 · Cited by 39
Pillai, R. N., Konje, J. C., Richardson, M., Tincello, D. G., & Potdar, N. (2018) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2017.10.024 · Cited by 41
Miller, P., Newby, D., Walkom, E., Schneider, J., Li, S. C., & Evans, T.-J. (2021) · The European Journal of Psychiatry · doi:10.1016/j.ejpsy.2020.10.002 · Cited by 39
Orme, M. E., Voreck, A., Aksouh, R., Ramsey-Goldman, R., & Schreurs, M. W. J. (2021) · Autoimmunity Reviews · doi:10.1016/j.autrev.2021.102943 · Cited by 34
Tanaka, M., Heckler, M., Liu, B., Heger, U., Hackert, T., & Michalski, C. W. (2019) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.12.034 · Cited by 36
Anti-dsDNA Testing Specificity for Systemic Lupus Erythematosus: A Systematic Review.
Orme, M. E., Voreck, A., Aksouh, R., & Schreurs, M. W. J. (2022) · The Journal of Applied Laboratory Medicine · doi:10.1093/jalm/jfab146 · Cited by 30
“In addition, hierarchical summary ROC (HSROC) curve plots of sensitivity vs specificity (expressed as 1 specificity) were generated after fitting the test count data (36, 37).”
MethodXpert MTB/RIF test for detection of pulmonary tuberculosis and rifampicin resistance
Sohn, H., Pai, M., Dendukuri, N., Kloda, L. A., Boehme, C. C., & Steingart, K. R. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009593 · Cited by 20
Donohue, R., Mashoto, K., Mubyazi, G., Madon, S., Malecela, M., & Michael, E. (2017) · Tropical Medicine and Infectious Disease · doi:10.3390/tropicalmed2040061 · Cited by 17
“Harbord et al. demonstrated that the bivariate approach and the HSROC are equivalent in most situations [35].”
Method
Metadata
- Authors
- Rutter, C. M., & Gatsonis, C. A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2001-09-05
- Volume
- 20
- Issue
- 19
- Pages
- 2865-2884
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2151047141
- Cited by
- 1,505
- References
- 2
- FWCI
- 6.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.