The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Value of composite reference standards in diagnostic research
Open accessAbstract
Combining several tests is a common way to improve the final classification of disease status in diagnostic accuracy studies but is often used ambiguously. This article gives advice on proper use and reporting of composite reference standards
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, because of the uncertainties that surround a clinical diagnosis of tuberculosis and, in some instances, the conditional dependence of the index tests and other tests in the composite reference standard (for example, for most of these tests, detection of tuberculosis depends on bacillary load), a reference standard that uses additional tests and clinical characteristics (in culture‐”
From Xpert MTB/RIF Ultra and Xpert MTB/RIF assays for extrapulmonary tuberculosis and rifampicin resistance in adults (2021) · cites this paper as Naaktgeboren 2013
The cited source says what the claim attributes to it.
In the citing paper
“In diagnostic accuracy studies, an imperfect reference standard may lead to a misclassification of samples [33,34].”
From Xpert MTB/RIF assay for the diagnosis of extrapulmonary tuberculosis: a systematic review and meta-analysis (2014) · cites this paper as [34]
The cited source says what the claim attributes to it.
In the citing paper
“We also considered the possibility that the reference standard could introduce bias due to misclassification of participants (fig.2) [34,35].”
From Xpert MTB/RIF assay for the diagnosis of extrapulmonary tuberculosis: a systematic review and meta-analysis (2014) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Self-citationTowards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Self-citationTowards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Self-citationEvaluation of diagnostic tests when there is no gold standard. A review of methods
Rutjes, A., Reitsma, J., Coomarasamy, A., Khan, K., & Bossuyt, P. (2007) · Health Technology Assessment · doi:10.3310/hta11500 · Cited by 524
Self-citationExploring sources of heterogeneity in systematic reviews of diagnostic tests
Lijmer, J. G., Bossuyt, P. M., & Heisterkamp, S. H. (2002) · Statistics in Medicine · doi:10.1002/sim.1185 · Cited by 446
Xpert MTB/RIF: a New Pillar in Diagnosis of Extrapulmonary Tuberculosis?
Vadwai, V., Boehme, C., Nabeta, P., Shetty, A., Alland, D., & Rodrigues, C. (2011) · Journal of Clinical Microbiology · doi:10.1128/jcm.02319-10 · Cited by 357
Conditional dependence between tests affects the diagnosis and surveillance of animal diseases
Gardner, I. A., Stryhn, H., Lind, P., & Collins, M. T. (2000) · Preventive Veterinary Medicine · doi:10.1016/s0167-5877(00)00119-7 · Cited by 340
Using a combination of reference tests to assess the accuracy of a new diagnostic test
Alonzo, T. A., & PEPE, M. S. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991130)18:22 · Cited by 242
A review and critique of modelling in prioritising and designing screening programmes
Karnon, J. D., Goyder, E., Tappenden, P., McPhie, S., Towers, I., Brazier, J. E., & Madan, J. J. (2007) · Health Technology Assessment · doi:10.3310/hta11520 · Cited by 184
Insights into latent class analysis of diagnostic test performance
Pepe, M. S., & Janes, H. (2006) · Biostatistics · doi:10.1093/biostatistics/kxl038 · Cited by 180
Cited by
Sorted by citations
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationMoons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Self-citationDenkinger, C. M., Schumacher, S. G., Boehme, C. C., Dendukuri, N., Pai, M., & Steingart, K. R. (2014) · European Respiratory Journal · doi:10.1183/09031936.00007814 · Cited by 527
Umemneku-Chikere, C. M., Wilson, K. J., Graziadio, S., Vale, L. D., & Allen, A. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223832 · Cited by 229
Kohli, M., Schiller, I., Dendukuri, N., Yao, M., Dheda, K., Denkinger, C. M., Schumacher, S. G., & Steingart, K. R. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012768.pub3 · Cited by 215
Metadata
- Authors
- Naaktgeboren, C. A., Bertens, L. C. M., Smeden, M. V., Groot, J. A. H. D., Moons, K. G. M., & Reitsma, J. B.
- Affiliations
- University Medical Center Utrecht (NL)
- Corresponding author
- Naaktgeboren, C. A.
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2013-10-25
- Volume
- 347
- Issue
- oct25 2
- Pages
- f5605-f5605
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W2025991594
- Semantic Scholar
- 8a21543e4ffabd1aacc8c2181000b9b6fafc626e
- Cited by
- 105
- References
- 27
- Citations by year
- 2026: 9 · 2025: 5 · 2024: 6 · 2023: 7 · 2022: 8 · 2021: 13 · 2020: 6 · 2019: 13 · 2018: 11 · 2017: 7 · 2016: 6 · 2015: 10 · 2014: 4
- FWCI
- 7.35
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Keywords
- composite reference standard, diagnostic accuracy, disease classification, test combination, reporting guidelines
- MeSH terms
- Diagnostic Errors, Reference Standards, Research Design, Diagnostic Techniques and Procedures, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
