Value of composite reference standards in diagnostic research
Open accessAbstract
Combining several tests is a common way to improve the final classification of disease status in diagnostic accuracy studies but is often used ambiguously. This article gives advice on proper use and reporting of composite reference standards
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A reference standard that uses additional tests and clinical characteristics (in culture-negative people) may incorrectly classify people without tuberculosis as having tuberculosis.
“However, because of the uncertainties that surround a clinical diagnosis of tuberculosis and, in some instances, the conditional dependence of the index tests and other tests in the composite reference standard (for example, for most of these tests, detection of tuberculosis depends on bacillary load), a reference standard that uses additional tests and clinical characteristics (in culture‐”
From Xpert MTB/RIF Ultra and Xpert MTB/RIF assays for extrapulmonary tuberculosis and rifampicin resistance in adults (2021) · cites this paper as Naaktgeboren 2013
In diagnostic accuracy studies, an imperfect reference standard may lead to misclassification of samples.
“In diagnostic accuracy studies, an imperfect reference standard may lead to a misclassification of samples [33,34].”
From Xpert MTB/RIF assay for the diagnosis of extrapulmonary tuberculosis: a systematic review and meta-analysis (2014) · cites this paper as [34]
The reference standard could introduce bias due to misclassification of participants.
“We also considered the possibility that the reference standard could introduce bias due to misclassification of participants (fig.2) [34,35].”
From Xpert MTB/RIF assay for the diagnosis of extrapulmonary tuberculosis: a systematic review and meta-analysis (2014) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199 · see citing works
Self-citationTowards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Self-citationTowards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Clinical Biochemistry · doi:10.1016/s0009-9120(02)00443-5 · Cited by 3,182 · see citing works
Self-citationEvaluation of diagnostic tests when there is no gold standard. A review of methods
Rutjes, A., Reitsma, J., Coomarasamy, A., Khan, K., & Bossuyt, P. (2007) · Health Technology Assessment · doi:10.3310/hta11500 · Cited by 524 · see citing works
Self-citationExploring sources of heterogeneity in systematic reviews of diagnostic tests
Lijmer, J. G., Bossuyt, P. M., & Heisterkamp, S. H. (2002) · Statistics in Medicine · doi:10.1002/sim.1185 · Cited by 446 · see citing works
Xpert MTB/RIF: a New Pillar in Diagnosis of Extrapulmonary Tuberculosis?
Vadwai, V., Boehme, C., Nabeta, P., Shetty, A., Alland, D., & Rodrigues, C. (2011) · Journal of Clinical Microbiology · doi:10.1128/jcm.02319-10 · Cited by 357 · see citing works
Conditional dependence between tests affects the diagnosis and surveillance of animal diseases
Gardner, I. A., Stryhn, H., Lind, P., & Collins, M. T. (2000) · Preventive Veterinary Medicine · doi:10.1016/s0167-5877(00)00119-7 · Cited by 340 · see citing works
A review and critique of modelling in prioritising and designing screening programmes
Karnon, J. D., Goyder, E., Tappenden, P., McPhie, S., Towers, I., Brazier, J. E., & Madan, J. J. (2007) · Health Technology Assessment · doi:10.3310/hta11520 · Cited by 184 · see citing works
Insights into latent class analysis of diagnostic test performance
Pepe, M. S., & Janes, H. E. (2006) · Biostatistics · doi:10.1093/biostatistics/kxl038 · Cited by 184 · see citing works
Geersing, G., Erkens, P. M. G., Lucassen, W. A. M., Buller, H. R., Cate, H. T., Hoes, A. W., Moons, K. G. M., Prins, M. H., Oudega, R., van Weert, H. C. P. M., et al. (2012) · BMJ · doi:10.1136/bmj.e6564 · Cited by 155 · see citing works
Self-citationEwer, A. K., Furmston, A., Middleton, L., Deeks, J. J., DANIELS, J. P., Pattison, H. M., Powell, R., Roberts, T. E., Barton, P. M., Auguste, P., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16020 · Cited by 151 · see citing works
The discrepancy in discrepant analysis
Hadgu, A. (1996) · The Lancet · doi:10.1016/s0140-6736(96)05122-7 · Cited by 146 · see citing works
Encyclopedia of Medical Decision Making
Kattan, M. W. (2009) · Sage eBooks · doi:10.4135/9781412971980 · Cited by 133 · see citing works
Verification problems in diagnostic accuracy studies: consequences and solutions
de Groot, J. A. H., Bossuyt, P. M., Reitsma, J. B., Rutjes, A. W., Dendukuri, N., Janssen, K. J. M., & Moons, K. G. M. (2011) · BMJ · doi:10.1136/bmj.d4770 · Cited by 103 · see citing works
Self-citationAssessing the gain in diagnostic performance when combining two diagnostic tests
Macaskill, P., Walter, S. D., Irwig, L., & Franco, E. L. (2002) · Statistics in Medicine · doi:10.1002/sim.1227 · Cited by 98 · see citing works
Siba, V., Horwood, P. F., Vanuga, K., Wapling, J., Sehuko, R., Siba, P. M., & Greenhill, A. R. (2012) · Clinical and Vaccine Immunology · doi:10.1128/cvi.00380-12 · Cited by 57 · see citing works
Correcting for Partial Verification Bias: A Comparison of Methods
de Groot, J. A. H., Janssen, K. J. M., Zwinderman, A. H., Bossuyt, P. M., Reitsma, J. B., & Moons, K. G. M. (2010) · Annals of Epidemiology · doi:10.1016/j.annepidem.2010.10.004 · Cited by 54 · see citing works
Self-citationLord, S. J., Staub, L., Bossuyt, P. M., & Irwig, L. (2011) · BMJ · doi:10.1136/bmj.d4684 · Cited by 50 · see citing works
Performance of rapid immunochromatographic assay in the diagnosis of Trichomoniasis vaginalis
Hegazy, M. M., El-Tantawy, N. L., Soliman, M. M., El-Sadeek, E. S., & El-Nagar, H. S. (2012) · Diagnostic Microbiology and Infectious Disease · doi:10.1016/j.diagmicrobio.2012.05.003 · Cited by 47 · see citing works
Evaluating Diagnostic Accuracy in the Face of Multiple Reference Standards
Naaktgeboren, C. A., de Groot, J. A. H., van Smeden, M., Moons, K. G. M., & Reitsma, J. B. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-3-201308060-00009 · Cited by 43 · see citing works
Self-citationWalter, S. D., Macaskill, P., Lord, S. J., & Irwig, L. (2012) · Statistics in Medicine · doi:10.1002/sim.4444 · Cited by 43 · see citing works
Tu, X. M., Kowalski, J., & Jia, G. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991130)18:22 · Cited by 28 · see citing works
Kerl, J. M., Schoepf, U. J., Zwerner, P. L., Bauer, R. W., Abro, J. A., Thilo, C., Vogl, T. J., & Herzog, C. (2011) · European Radiology · doi:10.1007/s00330-011-2134-2 · Cited by 26 · see citing works
Evaluation of Screening Tests for Detecting Chlamydia trachomatis
Hadgu, A., Dendukuri, N., & Wang, L. (2011) · Epidemiology · doi:10.1097/ede.0b013e31823b506b · Cited by 24 · see citing works
Point-of-Care Urine Tests for Smoking Status and Isoniazid Treatment Monitoring in Adult Patients
Nicolau, I. A., Tian, L., Menzies, D., Ostiguy, G., & Pai, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045913 · Cited by 16 · see citing works
(2012) · Clinical Governance An International Journal · doi:10.1108/cgij.2012.24817caa.005 · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [3]3. Alonzo TA, Pepe MS. Using a combination of reference tests to assess the accuracy of a new diagnostic test. Stat Med 1999;18:2987-3003.
Cited by
Sorted by citations
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · see citing works
Self-citationMoons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669 · see citing works
Self-citationDenkinger, C. M., Schumacher, S. G., Boehme, C. C., Dendukuri, N., Pai, M., & Steingart, K. R. (2014) · European Respiratory Journal · doi:10.1183/09031936.00007814 · Cited by 527 · see citing works
Umemneku-Chikere, C. M., Wilson, K. J., Graziadio, S., Vale, L. D., & Allen, A. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223832 · Cited by 220 · see citing works
Kohli, M., Schiller, I., Dendukuri, N., Yao, M., Dheda, K., Denkinger, C. M., Schumacher, S. G., & Steingart, K. R. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012768.pub3 · Cited by 215 · see citing works
Touw, H. R. W., Parlevliet, K. L., Beerepoot, M. A. J., Schober, P. R., Vonk, A. B. A., Twisk, J. W. R., Elbers, P., Boer, C., & Tuinman, P. R. (2018) · Anaesthesia · doi:10.1111/anae.14243 · Cited by 112 · see citing works
Meta-analysis of diagnostic accuracy studies in mental health
Takwoingi, Y., Riley, R. D., & Deeks, J. J. (2015) · Evidence-Based Mental Health · doi:10.1136/eb-2015-102228 · Cited by 102 · see citing works
Hydroxychloroquine and Chloroquine Retinopathy
Tsang, A. C., Ahmadi, S., Virgili, G., Gottlieb, C., Hamilton, J. B., & Coupland, S. G. (2015) · Ophthalmology · doi:10.1016/j.ophtha.2015.02.011 · Cited by 91 · see citing works
The estimation of diagnostic accuracy of tests for COVID-19: A scoping review
Axell‐House, D. B., Lavingia, R., Rafferty, M., Clark, E. H., Amirian, E. S., & Chiao, E. Y. (2020) · Journal of Infection · doi:10.1016/j.jinf.2020.08.043 · Cited by 82 · see citing works
Li, S., Liu, B., Peng, M., Chen, M., Yin, W., Tang, H. R., Luo, Y., Hu, P., & Ren, H. G. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180725 · Cited by 77 · see citing works
Wade, R. G., Takwoingi, Y., Wormald, J. C. R., Ridgway, J. P., Tanner, S. F., Rankine, J. J., & Bourke, G. (2019) · Radiology · doi:10.1148/radiol.2019190218 · Cited by 77 · see citing works
Patro, S., Meto, A., Mohanty, A., Chopra, V., Miglani, S., Das, A., Luke, A. M., Hadi, D. A., Meto, A., Fiorillo, L., et al. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159599 · Cited by 74 · see citing works
Bosman, L. P., Cadrin‐Tourigny, J., Bourfiss, M., Ghasabeh, M. A., Sharma, A., Tichnell, C., Roudijk, R. W., Murray, B. A., Tandri, H. S., Khairy, P., et al. (2020) · EP Europace · doi:10.1093/europace/euaa039 · Cited by 72 · see citing works
Self-citationBias due to composite reference standards in diagnostic accuracy studies
Schiller, I., van Smeden, M., Hadgu, A., Libman, M., Reitsma, J. B., & Dendukuri, N. (2015) · Statistics in Medicine · doi:10.1002/sim.6803 · Cited by 68 · see citing works
Self-citationFuzzy gold standards: Approaches to handling an imperfect reference standard
Walsh, T. (2018) · Journal of Dentistry · doi:10.1016/j.jdent.2018.04.022 · Cited by 56 · see citing works
Diagnostic accuracy of the Xpert MTB/RIF assay for bone and joint tuberculosis: A meta-analysis
Shen, Y., Yu, G., Zhong, F., & Kong, X. (2019) · PLoS ONE · doi:10.1371/journal.pone.0221427 · Cited by 54 · see citing works
Yu, G., Zhong, F., Ye, B., Xu, X., Chen, D., & Shen, Y. (2019) · BioMed Research International · doi:10.1155/2019/4878240 · Cited by 52 · see citing works
Assessing risk of bias and applicability
Reitsma, J. B., Rutjes, A. W., Whiting, P. F., Yang, B., Leeflang, M., Bossuyt, P. M., & Deeks, J. J. (2023) · Wiley eBooks · doi:10.1002/9781119756194.ch8 · Cited by 48 · see citing works
Self-citationYu, G., Shen, Y., Zhong, F., Ye, B., Yang, J., & Chen, G. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199290 · Cited by 45 · see citing works
Tatum, R. C., McGowan, C. M., & Ireland, J. L. (2021) · The Veterinary Journal · doi:10.1016/j.tvjl.2021.105695 · Cited by 43 · see citing works
Wideband Absorbance Outcomes in Newborns
Aithal, S., Kei, J., Driscoll, C., Khan, A., & Swanston, A. (2015) · Ear and Hearing · doi:10.1097/aud.0000000000000175 · Cited by 42 · see citing works
Décary, S., Fallaha, M., Pelletier, B., Frémont, P., Martel‐Pelletier, J., Pelletier, J., Feldman, D. E., Sylvestre, M., Vendittoli, P., & Desmeules, F. (2017) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-017-1799-3 · Cited by 36 · see citing works
Dittrich, S., Boutthasavong, L., Keokhamhoung, D., Phuklia, W., Craig, S. B., Tulsiani, S. M., Burns, M., Weier, S., Dance, D. A. B., Davong, V., et al. (2018) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.17-0702 · Cited by 25 · see citing works
Methodology for developing and evaluating diagnostic tools in Ayurveda – A review
Edavalath, M., & Benil, P. B. (2021) · Journal of Ayurveda and Integrative Medicine · doi:10.1016/j.jaim.2021.01.009 · Cited by 28 · see citing works
Diagnosis of allergy against beta-lactams in primary care: prevalence and diagnostic criteria
Salden, O. A. E., Röckmann, H., Verheij, T. J., & Broekhuizen, B. D. (2015) · Family Practice · doi:10.1093/fampra/cmv018 · Cited by 23 · see citing works
Screening for Voice Disorders in Older Adults (RAVI)—Part III: Cutoff Score and Clinical Consistency
Pernambuco, L. D. A., Espelt, A., & de Lima, K. C. (2016) · Journal of Voice · doi:10.1016/j.jvoice.2016.03.003 · Cited by 23 · see citing works
Maheshwari, V. (2016) · JOURNAL OF CLINICAL AND DIAGNOSTIC RESEARCH · doi:10.7860/jcdr/2016/20426.8684 · Cited by 23 · see citing works
Bias correction methods for test-negative designs in the presence of misclassification
Endo, A., Funk, S., & Kucharski, A. J. (2020) · Epidemiology and Infection · doi:10.1017/s0950268820002058 · Cited by 21 · see citing works
ROC study and SUV threshold using quantitative multi-modal SPECT for bone imaging
Vija, A. H., Bartenstein, P., FROELICH, J. W., Kuwert, T., Macapinlac, H. A., Daignault, C. P., Gowda, N., Hadjiev, O., Hephzibah, J., Huang, P., et al. (2019) · European Journal of Hybrid Imaging · doi:10.1186/s41824-019-0057-3 · Cited by 21 · see citing works
Elliott, D., McKibben, C. L., Conway, C., Purcell, M. K., Chase, D., & Applegate, L. (2015) · Diseases of Aquatic Organisms · doi:10.3354/dao02846 · Cited by 21 · see citing works
Bacteriological diagnosis of childhood TB: a prospective observational study
Brent, A., Mugo, D., Musyimi, R., Mutiso, A., Morpeth, S. C., Levin, M., & Scott, J. A. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-11969-5 · Cited by 21 · see citing works
Jenniskens, K., Naaktgeboren, C. A., Reitsma, J. B., Hooft, L., Moons, K. G. M., & van Smeden, M. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.002 · Cited by 20 · see citing works
Self-citationHeijboer, W. M. P., Weir, A., Delahunt, E., Hölmich, P., Schache, A. G., Tol, J. L., de Vos, R., Vuckovic, Z., & Serner, A. (2021) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2021.06.014 · Cited by 20 · see citing works
Byrne, R. L., Fogarty, U., Mooney, A., Marples, N. M., & Holland, C. V. (2018) · International Journal for Parasitology Parasites and Wildlife · doi:10.1016/j.ijppaw.2018.11.003 · Cited by 20 · see citing works
Myers, J., Kei, J., Aithal, S., Aithal, V., Driscoll, C., Khan, A., Manuel, A., Joseph, A., & Malicka, A. N. (2018) · Ear and Hearing · doi:10.1097/aud.0000000000000565 · Cited by 17 · see citing works
Gallos, I. D., Williams, C. R., Price, M. J., Tobı́as, A., Devall, A., Allotey, J., Althabe, F., Cresswell, J. A., Durocher, J., Gülmezoglu, A. M., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)01639-3 · Cited by 16 · see citing works
Miellet, W. R., van Veldhuizen, J., Litt, D. J., Mariman, R., Wijmenga‐Monsuur, A. J., Nieuwenhuijsen, T., Christopher, J., Thombre, R. S., Eletu, S. D., Bosch, T., et al. (2023) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1156695 · Cited by 16 · see citing works
Bertens, L. C. M., van Mourik, Y., Rutten, F. H., Cramer, M. J., Lammers, J. J., Hoes, A. W., Reitsma, J. B., & Moons, K. G. M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.09.020 · Cited by 16 · see citing works
Self-citationAn analysis reveals differences between pragmatic and explanatory diagnostic accuracy studies
Bossuyt, P. M., Olsen, M., Hyde, C., & Cohen, J. F. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.09.017 · Cited by 14 · see citing works
Brummaier, T., Archasuksan, L., Watthanakulpanich, D., Paris, D. H., Utzinger, J., McGready, R. M., Proux, S., & Nosten, F. H. (2021) · Tropical Medicine and Infectious Disease · doi:10.3390/tropicalmed6020051 · Cited by 14 · see citing works
Al‐Azazi, S., Singer, A. G., Rabbani, R., & Lix, L. M. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0845-5 · Cited by 12 · see citing works
Biomarker validation with an imperfect reference: Issues and bounds
Emerson, S. C., Waikar, S. S., Fuentes, C., Bonventre, J. V., & Betensky, R. A. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280216689806 · Cited by 12 · see citing works
Liu, Y., Li, S., Wu, Y., Wu, F., Chang, Y., Li, H., Jia, X., Saba, L., Ji, X., & Yang, Q. (2021) · Aging and Disease · doi:10.14336/ad.2021.0502 · Cited by 12 · see citing works
Deeks, J. J., Ashby, D., Takwoingi, Y., Perera, R., Evans, S. J. W., & Bird, S. M. (2024) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnae053 · Cited by 11 · see citing works
van der Pol, C. B., Costa, A. F., Lam, E. W. ‐., Dawit, H., Bashir, M. R., & McInnes, M. D. F. (2023) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.29049 · Cited by 10 · see citing works
Adams, A. A., Siard, M. H., Reedy, S. E., Barker, D., Elzinga, S. E., Sanz, M. G., Urschel, K. L., & Ireland, J. L. (2023) · The Veterinary Journal · doi:10.1016/j.tvjl.2023.106035 · Cited by 9 · see citing works
Tang, S., Hemyari, P., Canchola, J. A., & Duncan, J. (2018) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2018.1428613 · Cited by 9 · see citing works
Singhal, R., Dayal, R., Bhatnagar, S., Nayak, M., Yadav, N. K., Kumar, P., Kumar, S., Singh, H., & Singh, G. (2023) · The Indian Journal of Pediatrics · doi:10.1007/s12098-023-04849-6 · Cited by 9 · see citing works
Camacho, A., Fang, J., Cohen, M. P., Raptopoulos, V. D., & Brook, O. R. (2017) · Abdominal Radiology · doi:10.1007/s00261-017-1350-x · Cited by 9 · see citing works
Peng, J., Liu, Y., Zou, J., Wang, J., Luis, C. D. J., & Zhong, H. (2024) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2024.11.035 · Cited by 8 · see citing works
Utility of Routine Laboratory Biomarkers to Detect COVID-19: A Systematic Review and Meta-Analysis
Suklan, J., Cheaveau, J., Hill, S., Urwin, S., Green, K., Winter, A., Hicks, T., Boath, A., Kernohan, A., Price, D., et al. (2021) · Viruses · doi:10.3390/v13050803 · Cited by 8 · see citing works
Moons, K. G. M., Altman, D. G., Reitsma, J. B., loannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, P. G. S. (2022) · Digital Diagnostics · doi:10.17816/dd110794 · Cited by 8 · see citing works
Self-citationMadico, G. E., Mpeirwe, M., White, L. F., Vinhas, S. A., Orr, B. L., Orikiriza, P., Miller, N. S., Gaeddert, M., Mwanga‐Amumpaire, J., Palaci, M., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0158371 · Cited by 8 · see citing works
Giacomi, F. D., Andreano, A., Faverio, P., Biffi, A., Ruvolo, L., Sverzellati, N., Valsecchi, M. G., & Pesci, A. (2017) · Sarcoidosis vasculitis and diffuse lung diseases · doi:10.36141/svdld.v34i2.5467 · Cited by 8 · see citing works
Jones, W. S., Suklan, J., Winter, A., Green, K., Craven, T., Bruce, A. M., Mair, J., Dhaliwal, K., Walsh, T. S., Simpson, A. J., et al. (2022) · Diagnostic and Prognostic Research · doi:10.1186/s41512-022-00117-x · Cited by 8 · see citing works
Chen, Z.-K., Wu, Z., Ye, T., Lin, C.-Y., & Guo, X. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321507 · Cited by 7 · see citing works
Comparison of Child Poverty Measures: Looking for Consensus
Landiyanto, E. A. (2021) · Child Indicators Research · doi:10.1007/s12187-021-09867-4 · Cited by 7 · see citing works
Mulinganya, G. M., Keyser, K. D., Mongane, J., Kampara, F., Vulder, A. D., Boelens, J., Duyvejonck, H., Hendwa, E., Kujirakwinja, Y., Bisimwa, G. B., et al. (2024) · Frontiers in Global Women s Health · doi:10.3389/fgwh.2024.1339821 · Cited by 7 · see citing works
Molecular Characterization of Small Ruminant Lentiviruses in Sheep and Goats: A Systematic Review
Gobbi, P., Pavone, S., Orso, M., Passamonti, F., Righi, C., Beato, M. S., Feliziani, F., & Giammarioli, M. (2024) · Animals · doi:10.3390/ani14233545 · Cited by 6 · see citing works
Kohli, M., Inbaraj, L. R., Salomon, A., Scandrett, K., Korobitsyn, A., Ismail, N. A., Srinivasalu, V. A., Daniel, J., Steingart, K. R., & Takwoingi, Y. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012768.pub4 · Cited by 6 · see citing works
Sullivan, G., Guo, X., Tokman, J. I., Roof, S. E., Trmčić, A., Baker, R., Tang, S., Markwell, P., Wiedmann, M., & Kovac, J. (2020) · Journal of Food Protection · doi:10.4315/0362-028x.jfp-19-422 · Cited by 4 · see citing works
Oral fluid: Non-invasive alternative for parvovirus B19 diagnosis?
Bodewes, R., Kerkhof, J., Cremer, J., Gijselaar, D. B., Voordouw, B. C. G., Veldhuijzen, I. K., Schipper, M., & van Binnendijk, R. S. (2019) · Journal of Clinical Virology · doi:10.1016/j.jcv.2019.05.008 · Cited by 6 · see citing works
Parra-Colín, P. D. L., Palacios-Aguirre, K., Perez-Pria-Kasusky, A., Espinosa-Morales, R., & Hidalgo‐Bravo, A. (2023) · Diagnostics · doi:10.3390/diagnostics13182994 · Cited by 5 · see citing works
Systematic Reviews of Diagnostic Accuracy
Takwoingi, Y., & Deeks, J. J. (2022) · doi:10.1002/9781119099369.ch16 · Cited by 5 · see citing works
Han, Y., Xiao, N., Huang, S., Qin, M., Che, N., & Liu, Z. (2019) · Current Pharmaceutical Biotechnology · doi:10.2174/1389201020666190716104131 · Cited by 5 · see citing works
Assessment of the Utility of Cognitive Screening Instruments
Quinn, T. J., & Takwoingi, Y. (2016) · Springer eBooks · doi:10.1007/978-3-319-44775-9_2 · Cited by 4 · see citing works
Newer Molecular Diagnostic Tests for Tuberculosis
Nair, S., & Murthy, N. (2021) · Journal of Advanced Lung Health · doi:10.4103/jalh.jalh_3_21 · Cited by 4 · see citing works
Yoon, S., Speyer, R., Cordier, R., Pirjo Aunio, A., & Hakkarainen, A. M. (2022) · Trauma Violence & Abuse · doi:10.1177/15248380221093690 · Cited by 4 · see citing works
Moons, E. G. M., Altman, D. G., Reitsma, J. B., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, P. G. S. (2015) · Cited by 4 · see citing works
Self-citationde Beaulieu, M. A., & Paycha, F. (2015) · Médecine Nucléaire · doi:10.1016/j.mednuc.2015.09.003 · Cited by 4 · see citing works
Atkinson, P. J., Quimby, C., Datt, A., Nielsen, T. D., & Caraguel, C. (2026) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2026.106783 · Cited by 3 · see citing works
Accuracy of composite diagnostic standards for pneumococcal pneumonia in vaccine trials
Suzuki, M., Katoh, S., Miyahara, R., Ariyoshi, K., & Morimoto, K. (2018) · Epidemiology and Infection · doi:10.1017/s0950268818000651 · Cited by 3 · see citing works
Madico, G. E., Vinhas, S. A., Orr, B. L., White, L. F., Gaeddert, M., Miller, N. S., Mpeirwe, M., Orikiriza, P., Mwanga‐Amumpaire, J., Boum, Y., et al. (2019) · Tuberculosis · doi:10.1016/j.tube.2019.03.007 · Cited by 3 · see citing works
Mitchev, N., Singh, R., Garrett, N., Ramsuran, V., Niehaus, A. J., & Mlisana, K. P. (2021) · African Journal of Laboratory Medicine · doi:10.4102/ajlm.v10i1.1124 · Cited by 3 · see citing works
Ashiri, A., Rafiei, A., Noordin, R., Anuar, N. S., Teimoori, A., Ansari-Moghaddam, B., & Beiromvand, M. (2025) · Parasites & Vectors · doi:10.1186/s13071-025-06910-z · Cited by 3 · see citing works
Bharath, B. G., Ray, A., Jorwal, P., Vyas, S., Soneja, M., Biswas, A., Sinha, S., & Khan, M. A. (2022) · Lung India · doi:10.4103/lungindia.lungindia_103_21 · Cited by 3 · see citing works
Jayakody, N. K., Gordon, C. A., Wickramasinghe, N. D., Silva, A., Wickramasinghe, S., & Weerakoon, K. (2026) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0013974 · Cited by 2 · see citing works
Estimating diagnostic accuracy under uncertainty about disease status: a sepsis case study
Jenniskens, K., Naaktgeboren, C. A., Uffen, J. W., Kellerhuis, B. E., van Smeden, M., Kaasjager, K. A. H., Oosterheert, J. J., Dendukuri, N., & Reitsma, J. B. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112290 · Cited by 2 · see citing works
Self-citationIs sterile pyuria another minor diagnostic criterion in urinary tuberculosis?
Mallya, A., Karthikeyan, V. S., & Keshavamurthy, R. (2019) · Indian Journal of Tuberculosis · doi:10.1016/j.ijtb.2019.08.004 · Cited by 2 · see citing works
Tee, M. L., Rosell-Ubial, P. J. B., Rañoa, D. R. E., Tee, C., Abrilla, A. A., Trinidad, L. J. P. L., Chiong, C. M., Berba, R. P., Carrillo, R. J. D., Lim, M. C. F., et al. (2021) · Asian Journal of Research in Infectious Diseases · doi:10.9734/ajrid/2021/v6i230193 · Cited by 2 · see citing works
Liu, Y., & Chen, Y. (2018) · Springer eBooks · doi:10.1007/978-3-319-78966-8_20 · Cited by 2 · see citing works
van der Westhuizen, C., Newton-Foot, M., & Nel, P. (2024) · African Journal of Laboratory Medicine · doi:10.4102/ajlm.v13i1.2415 · Cited by 1 · see citing works
Sani, L., Senjarini, K., Steinke, S., Huyen, D. T., Hiền, T. T. T., Oktarianti, R., Huyền, T. T. T., Le, S. H., Velavan, T. P., Anh, D. D., et al. (2025) · Diagnostic Microbiology and Infectious Disease · doi:10.1016/j.diagmicrobio.2025.117050 · Cited by 1 · see citing works
Liao, W.-C., Huang, H.-Y., Chen, Y.-H., Huang, H.-B., Liaw, W., & Hsu, Y. (2026) · CardioVascular and Interventional Radiology · doi:10.1007/s00270-026-04533-0 · Cited by 1 · see citing works
Huisarts en glazen bol: voorspellen op het spreekuur
Geersing, G. (2014) · Huisarts en Wetenschap · doi:10.1007/s12445-014-0153-3 · Cited by 1 · see citing works
Liu, Y., Ying, G., Quinn, G. E., Zhou, X., & Chen, Y. (2021) · Statistics in Medicine · doi:10.1002/sim.9269 · Cited by 1 · see citing works
Moons, K. G. M., Altman, D. G., Reitsma, J. B., loannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, P. G. S. (2023) · Вопросы современной педиатрии · doi:10.15690/vsp.v22i2.2557 · Cited by 1 · see citing works
Self-citationMehta, A. (2017) · Journal of Medical Science And clinical Research · doi:10.18535/jmscr/v5i9.101 · Cited by 1 · see citing works
Bundred, N. J., Todd, C. J., Morris, J., Keeley, V. L., Purushotham, A. D., Bagust, A., Foden, P., Bramley, M., & Riches, K. (2019) · Programme Grants for Applied Research · doi:10.3310/pgfar07050 · Cited by 1 · see citing works
Wideband absorbance measures in neonates and young infants
Aithal, S. (2015) · The University of Queensland · doi:10.14264/uql.2015.288 · Cited by 1 · see citing works
Diagnostic research in daily practice: methodological challenges and applications
Bertens, L. C. M. (2014) · Utrecht University Repository (Utrecht University)
Self-citationAccuracy of Meta-Analysis Using Different Levels of Diagnostic Accuracy Measures
Song, Y., Lü, Y., & Tian, L. (2016) · ICSA book series in statistics · doi:10.1007/978-3-319-42568-9_3
Arifin, M. I. (2016) · Epsilon Archive for Student Projects (University of Southampton)
Is This the Right Reference Standard Diagnosis for Retinopathy of Prematurity?
Athikarisamy, S. E. (2018) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2018.4175
Evaluating Uncertainty in Dengue Seroprevalence in the Absence of a Gold Standard Diagnostic Test
Baker, T. E., & Wolfson, D. B. (2020) · McGill Journal of Medicine · doi:10.26443/mjm.v18i1.325
Using β hCG, prolactin and IGFBP I single or in Pairs to diagnose PROM
EL-GHANNAM, M. D. K. I. A. M. A., Khairy, H. T., Mohammad, M., Safty, M. S. E., & ABOZEID, A. (2020) · Evidence Based Women s Health Journal · doi:10.21608/ebwhj.2020.21883.1069
Personalized Medicine in Arrhythmogenic Right Ventricular Cardiomyopathy
Bosman, L. P. (2022) · doi:10.33540/606
Avoiding Bias in Diagnostic Accuracy Studies
Doshi, J., Deokar, K. K., & Jangir, K. K. (2024) · Journal of the Association of Physicians of India · doi:10.59556/japi.72.0748
Jones, W. S., Suklan, J., Winter, A., Green, K., Craven, T., Bruce, A., Mair, J., Dhaliwal, K., Walsh, T., Simpson, A. J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19159353
Haley, K. L., Jacks, A., & Mailend, M. (2026) · American Journal of Speech-Language Pathology · doi:10.1044/2025_ajslp-25-00178 · Cited by 1 · see citing works
- Authors
- Naaktgeboren, C. A., Bertens, L. C. M., Smeden, M. V., Groot, J. A. H. D., Moons, K. G. M., & Reitsma, J. B.
- Affiliations
- University Medical Center Utrecht (NL)
- Corresponding author
- Naaktgeboren, C. A.
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2013-10-25
- Volume
- 347
- Issue
- oct25 2
- Pages
- f5605-f5605
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W2025991594
- Semantic Scholar
- 8a21543e4ffabd1aacc8c2181000b9b6fafc626e
- Cited by
- 105
- References
- 27
- Citations by year
- 2026: 9 · 2025: 5 · 2024: 6 · 2023: 7 · 2022: 8 · 2021: 13 · 2020: 6 · 2019: 13 · 2018: 11 · 2017: 7 · 2016: 6 · 2015: 10 · 2014: 4
- FWCI
- 7.35
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Keywords
- composite reference standard, diagnostic accuracy, disease classification, test combination, reporting guidelines
- MeSH terms
- Diagnostic Errors, Reference Standards, Research Design, Diagnostic Techniques and Procedures, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
