STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration
Open accessThe DOI matches its Crossref record; 127 of the 127 references it cites were found in a registry or an index.
Abstract
Diagnostic accuracy studies are, like other clinical studies, at risk of bias due to shortcomings in design and conduct, and the results of a diagnostic accuracy study may not apply to other patient groups and settings. Readers of study reports need to be informed about study design and conduct, in sufficient detail to judge the trustworthiness and applicability of the study findings. The STARD statement (Standards for Reporting of Diagnostic Accuracy Studies) was developed to improve the completeness and transparency of reports of diagnostic accuracy studies. STARD contains a list of essential items that can be used as a checklist, by authors, reviewers and other readers, to ensure that a report of a diagnostic accuracy study contains the necessary information. STARD was recently updated. All updated STARD materials, including the checklist, are available at http://www.equator-network.org/reporting-guidelines/stard . Here, we present the STARD 2015 explanation and elaboration document. Through commented examples of appropriate reporting, we clarify the rationale for each of the 30 items on the STARD 2015 checklist, and describe what is expected from authors in developing sufficiently informative study reports.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Results are presented in accordance with the standard framework for the validation and verification of clinical molecular genetic tests [25] and STARD guidelines for reporting diagnostic accuracy studies [26], using sensitivity, specificity and precision to evaluate assay performance.”
From Assessing the analytical validity of SNP-chips for detecting very rare pathogenic variants: implications for direct-to-consumer genetic testing (2019) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Diagnostic guidelines provide a standardized and evidence-based framework that enhances accuracy, consistency, and quality in diagnosis, ultimately supporting more efficient and reliable care and improved patient outcomes [139,140].”
From Toward Safer Diagnoses: A SEIPS-Based Narrative Review of Diagnostic Errors (2026) · cites this paper as [140]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Results are presented in accordance with the standard framework for the validation and verification of clinical molecular genetic tests and STARD guidelines for reporting diagnostic accuracy studies, using sensitivity, specificity, positive predictive value, and negative predictive value to evaluate assay performance.”
From Use of SNP chips to detect rare pathogenic variants: retrospective, population based diagnostic evaluation (2021) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“The STARD guidelines for the reporting of diagnostic accuracy studies were followed as closely as possible [24].”
The cited source says what the claim attributes to it.
In the citing paper
“aligns with the language of other scientific reporting guidelines, such as the Standards for Reporting of Diagnostic Accuracy Studies (STARD) statement (11).”
From Checklist for Artificial Intelligence in Medical Imaging (CLAIM): 2024 Update (2024) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Self-citationSTARD 2015: an updated list of essential items for reporting diagnostic accuracy studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · BMJ · doi:10.1136/bmj.h5527 · Cited by 3,660 · cited 1×
“The STARD statement was initially released in 2003 and updated in 2015.(10) The objectives of this update were to include recent evidence about sources of bias and variability”
Self-citationTowards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Self-citationTowards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Self-citationTowards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · Radiology · doi:10.1148/radiol.2261021292 · Cited by 3,215
Self-citationImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
The Statistical Evaluation of Medical Tests for Classification and Prediction
Pepe, M. S. (2003) · doi:10.1093/oso/9780198509844.001.0001 · Cited by 2,198
The Statistical Evaluation of Medical Tests for Classification and Prediction
(2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,899
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861 · cited 1×
“Значительные различия между тяжелыми «случаями» и здоровыми «контролями» могут привести к завышенным оценкам точности теста [6, 29].”
Self-citationProblems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
Ransohoff, D. F., & Feinstein, A. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197810262991705 · Cited by 1,734
Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement
Ioannidis, J. P. A., Evans, S. J. W., Gøtzsche, P. C., O'Neill, R. T., Altman, D. G., Schulz, K., Moher, D., & for the CONSORT Group* (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-10-200411160-00009 · Cited by 1,593
Self-citationDiagnostic Accuracy of Fractional Flow Reserve From Anatomic CT Angiography
Min, J. K., Leipsic, J., Pencina, M. J., Berman, D. S., Koo, B.-K., van Mieghem, C., Erglis, A., Lin, F. Y., Dunning, A. M., Apruzzese, P., et al. (2012) · JAMA · doi:10.1001/2012.jama.11274 · Cited by 1,162
Assessing the Generalizability of Prognostic Information
Justice, A. C., Covinsky, K. E., & Berlin, J. A. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-6-199903160-00016 · Cited by 1,160
The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124 · cited 1×
“a similar document that was prepared for the STARD 2003 version.(11) Through commented examples of appropriate reporting, we clarify the rationale for each item”
Increasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Clinical Chemistry · doi:10.1373/49.1.1 · Cited by 862
Self-citationSources of Variation and Bias in Studies of Diagnostic Accuracy: A Systematic Review
Whiting, P., Rutjes, A. W. S., Reitsma, J. B., Glas, A. S., Bossuyt, P. M. M., & Kleijnen, J. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-3-200402030-00010 · Cited by 798
Self-citationvan der Heijden, G. J. M. G., T. Donders, A. R., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.015 · Cited by 631
Evidence of bias and variation in diagnostic accuracy studies
Rutjes, A. W. S., Reitsma, J. B., Di Nisio, M., Smidt, N., van Rijn, J. C., & Bossuyt, P. M. M. (2006) · Canadian Medical Association Journal · doi:10.1503/cmaj.050090 · Cited by 611
Self-citationVariability in Radiologists' Interpretations of Mammograms
Elmore, J. G., Wells, C. K., Lee, C. H., Howard, D. H., & Feinstein, A. R. (1994) · New England Journal of Medicine · doi:10.1056/nejm199412013312206 · Cited by 601
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W., Westwood, M. E., Mallett, S. V., Deeks, J. J., Reitsma, J. B., Leeflang, M., Sterne, J. A. C., & Bossuyt, P. M. (2011) · Data Archiving and Networked Services (DANS) · doi:10.1059/0003-4819-155-8-201110180-00009 · Cited by 601
Self-citationHow to Use a Subgroup Analysis: Users’ Guide to the Medical Literature
Sun, X., Ioannidis, J. P. A., Agoritsas, T., Alba, A. C., & Guyatt, G. (2014) · JAMA · doi:10.1001/jama.2013.285063 · Cited by 550 · cited 1×
“Analyses that were prespecified in the protocol, before data were collected, have greater credibility.(72) In the example, the authors reported that the accuracy of the urinary indices was evaluated in two subgroups that were explicitly prespecified.”
MethodVariation of a test’s sensitivity and specificity with disease prevalence
Leeflang, M. M. G., Rutjes, A. W. S., Reitsma, J. B., Hooft, L., & Bossuyt, P. M. M. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.121286 · Cited by 530
Self-citationCase–Control and Two-Gate Designs in Diagnostic Accuracy Studies
Rutjes, A. W., Reitsma, J. B., Vandenbroucke, J. P., Glas, A. S., & Bossuyt, P. M. (2005) · Clinical Chemistry · doi:10.1373/clinchem.2005.048595 · Cited by 501
Self-citationBiases in the assessment of diagnostic tests
Begg, C. B. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060402 · Cited by 496
Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis
Leeflang, M. M. G., Bossuyt, P. M. M., & Irwig, L. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.04.007 · Cited by 482
Self-citationSample size calculation should be performed for design accuracy in diagnostic test studies
Flahault, A., Cadilhac, M., & Thomas, G. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.12.009 · Cited by 468
Comparative accuracy: assessing new tests against existing diagnostic pathways
Bossuyt, P. M., Irwig, L., Craig, J., & Glasziou, P. (2006) · BMJ · doi:10.1136/bmj.332.7549.1089 · Cited by 458
Self-citationA framework for evaluation of secondary data sources for epidemiological research
SØRENSEN, H. T., SABROE, S., & OLSEN, J. (1996) · International Journal of Epidemiology · doi:10.1093/ije/25.2.435 · Cited by 455
Factors affecting sensitivity and specificity of exercise electrocardiography
Hlatky, M. A., Pryor, D. B., Harrell, F. E., Califf, R. M., Mark, D. B., & Rosati, R. A. (1984) · The American Journal of Medicine · doi:10.1016/0002-9343(84)90437-6 · Cited by 371
Leeflang, M. M. G., Moons, K. G. M., Reitsma, J. B., & Zwinderman, A. H. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096032 · Cited by 346
Self-citationAssessment of the accuracy of diagnostic tests: the cross-sectional study
Knottnerus, J. A., & Muris, J. W. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00206-3 · Cited by 312
Peña, B. M. G. (1999) · JAMA · doi:10.1001/jama.282.11.1041 · Cited by 307
Pharmaceutical company funding and its consequences: A qualitative systematic review
Sismondo, S. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2007.08.001 · Cited by 304
GREENES, R. A., & BEGG, C. B. (1985) · Investigative Radiology · doi:10.1097/00004424-198510000-00018 · Cited by 292
A systematic review classifies sources of bias and variation in diagnostic test accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., & Mallett, S. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.05.014 · Cited by 283
The Evidence Base of Clinical Diagnosis: Theory and methods of diagnostic research
(2008) · Wiley eBooks · doi:10.1002/9781444300574 · Cited by 276
Lord, S. J., Irwig, L., & Simes, R. J. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-11-200606060-00011 · Cited by 268
Self-citationLachs, M. S., Nachamkin, I., Edelstein, P. H., Goldman, J., Feinstein, A. R., & Schwartz, J. S. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-117-2-135 · Cited by 261
Hodgdon, T., McInnes, M. D. F., Schieda, N., Flood, T. A., Lamb, L., & Thornhill, R. E. (2015) · Radiology · doi:10.1148/radiol.2015142215 · Cited by 261
Irwig, L. (2002) · BMJ · doi:10.1136/bmj.324.7338.669 · Cited by 246 · cited 1×
“Differences in the execution of the index test or reference standard are a potential source of variation in diagnostic accuracy.(39) 40 Authors should therefore describe the methods for executing the index test”
Self-citationBossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · PubMed · Cited by 242
Self-citationDerivation of a Decision Rule for the Use of Radiography in Acute Knee Injuries
Stiell, I. G., Greenberg, G. H., Wells, G. A., McKnight, R. D., Cwinn, A. A., Cacciotti, T., McDowell, I., & Smith, N. A. (1995) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(95)70106-0 · Cited by 242
Gutzwiller, F., & Paccaud, F. (1987) · PubMed · Cited by 240
A Proposal for More Informative Abstracts of Clinical Articles
AD HOC WORKING GROUP FOR CRITICAL APPRAISAL OF THE MEDICAL LITERATURE (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-4-598 · Cited by 233
Foerch, C., Niessner, M., Back, T., Bauerle, M., De Marchis, G. M., Ferbert, A., Grehl, H., Hamann, G. F., Jacobs, A., Kastrup, A., et al. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2011.172676 · Cited by 205
From biomarkers to medical tests: the changing landscape of test evaluation
Horvath, A. R., Lord, S. J., StJohn, A., Sandberg, S., Cobbaert, C. M., Lorenz, S., Monaghan, P. J., Verhagen-Kamerbeek, W. D. J., Ebert, C., & Bossuyt, P. M. M. (2014) · Clinica Chimica Acta · doi:10.1016/j.cca.2013.09.018 · Cited by 203 · cited 1×
“The intended use of a test can be diagnosis, screening, staging, monitoring, surveillance, prognosis, treatment selection or other purposes.(18) The clinical role of the test under evaluation refers to its anticipated position relative to other tests in the clinical pathway.”
Self-citationThe diagnostic accuracy of the exercise electrocardiogram: A meta-analysis of 22 years of research
Detrano, R., Gianrossi, R., & Froelicher, V. (1989) · Progress in Cardiovascular Diseases · doi:10.1016/0033-0620(89)90025-x · Cited by 199
Ruling a diagnosis in or out with “SpPIn” and “SnNOut”: a note of caution
Pewsner, D., Battaglia, M., Minder, C., Marx, A., Bucher, H. C., & Egger, M. (2004) · BMJ · doi:10.1136/bmj.329.7459.209 · Cited by 196
Moons, K. G. M., van Es, G.-A., Deckers, J. W., Habbema, J. D. F., & Grobbee, D. E. (1997) · Epidemiology · doi:10.1097/00001648-199701000-00002 · Cited by 189 · cited 1×
“Sensitivity of test exercises was higher in those with more diseased vessels (39% for single vessel disease, 58% for two and 77% for three vessels).(91)”
Sample sizes of studies on diagnostic accuracy: literature survey.
Bachmann, L. M., Puhan, M. A., Riet, G. T., & Bossuyt, P. M. (2006) · BMJ · doi:10.1136/bmj.38793.637789.2f · Cited by 184
Self-citationLimitations are not properly acknowledged in the scientific literature
Ioannidis, J. P. A. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.011 · Cited by 180 · cited 1×
“Some journals explicitly encourage authors to report on study limitations, but many are not specific about which elements should be addressed.(104) For diagnostic accuracy studies, we highly recommend that at least potential sources of bias are discussed, as well as impre-”
Methodologic problems of exercise testing for coronary artery disease: Groups, analysis and bias
Philbrick, J. T., Horwitz, R. I., & Feinstein, A. R. (1980) · The American Journal of Cardiology · doi:10.1016/0002-9149(80)90432-4 · Cited by 179
For The RDOG5 Investigators, Pisano, E. D., Fajardo, L. L., Tsimikas, J., Sneige, N., Frable, W. J., Gatsonis, C. A., Evans, W. P., Tocino, I., & McNeil, B. J. (1998) · Cancer · doi:10.1002/(sici)1097-0142(19980215)82:4<679::aid-cncr10>3.0.co;2-v · Cited by 176
Self-citationInterpretation of radiographs: effect of clinical history
Doubilet, P., & Herman, P. (1981) · American Journal of Roentgenology · doi:10.2214/ajr.137.5.1055 · Cited by 175
Thyroid papillary carcinoma of columnar cell type
Wenig, B. M., Thompson, L. D. �., Adair, C. F., Shmookler, B. M., & Heffess, C. S. (1998) · Cancer · doi:10.1002/(sici)1097-0142(19980215)82:4 · Cited by 163
Publications on diagnostic test evaluation in family medicine journals
Devillé, W. L. J. M., Bezemer, P. D., & Bouter, L. M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00144-4 · Cited by 161
Intermediate, Indeterminate, and Uninterpretable Diagnostic Test Results
Simel, D. L., Feussner, J. R., Delong, E. R., & Matchar, D. B. (1987) · Medical Decision Making · doi:10.1177/0272989x8700700208 · Cited by 159
Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013) · Radiology · doi:10.1148/radiol.12120527 · Cited by 158
Self-citationGeersing, G.-J., Erkens, P. M. G., Lucassen, W. A. M., Buller, H. R., Cate, H. T., Hoes, A. W., Moons, K. G. M., Prins, M. H., Oudega, R., van Weert, H. C. P. M., et al. (2012) · BMJ · doi:10.1136/bmj.e6564 · Cited by 156
Zalis, M. E., Blake, M. A., Cai, W., Hahn, P. F., Halpern, E. F., Kazam, I. G., Keroack, M. D., Magee, C., Näppi, J. J., Pérez-Johnston, R., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-10-201205150-00005 · Cited by 142
The influence of referral patterns on the characteristics of diagnostic tests
AndréKnorrnerus, J., & Leffers, P. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90155-g · Cited by 142
Diagnostic accuracy studies: how to report and analyse inconclusive test results
Shinkins, B., Thompson, M., Mallett, S., & Perera, R. (2013) · BMJ · doi:10.1136/bmj.f2778 · Cited by 142
Giard, R. W. M., & Hermans, J. (1992) · Cancer · doi:10.1002/1097-0142(19920415)69:8<2104::aid-cncr2820690816>3.0.co;2-o · Cited by 135
Tanz, R. R., Gerber, M. A., Kabat, W. J., Rippe, J., SESHADRI, R. M., & Shulman, S. T. (2009) · PEDIATRICS · doi:10.1542/peds.2008-0488 · Cited by 134
Stegeman, I., de Wijkerslooth, T. R., Stoop, E. M., van Leerdam, M. E., Dekker, E., van Ballegooijen, M., Kuipers, E. J., Fockens, P., Kraaijenhagen, R. A., & Bossuyt, P. M. (2013) · Gut · doi:10.1136/gutjnl-2013-305013 · Cited by 121
Self-citationThe evidence base of clinical diagnosis : theory and methods of diagnostic research
Knottnerus, J. A., & Buntinx, F. (2009) · Cited by 119
Korevaar, D. A., van Enst, W. A., Spijker, R., Bossuyt, P. M. M., & Hooft, L. (2014) · Evidence Based Medicine · doi:10.1136/eb-2013-101637 · Cited by 119
Self-citationReporting Diagnostic Accuracy Studies: Some Improvements after 10 Years of STARD
Korevaar, D. A., Wang, J., van Enst, W. A., Leeflang, M. M., Hooft, L., Smidt, N., & Bossuyt, P. M. M. (2015) · Radiology · doi:10.1148/radiol.14141160 · Cited by 110
Self-citationBomers, M. K., van Agtmael, M. A., Luik, H., van Veen, M. C., Vandenbroucke‐Grauls, C. M. J. E., & Smulders, Y. M. (2012) · BMJ · doi:10.1136/bmj.e7396 · Cited by 109
Sensitivity and specificity of a single diagnostic test in the presence of work-up bias
Choi, B. C. K. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90129-b · Cited by 107
Verification problems in diagnostic accuracy studies: consequences and solutions
de Groot, J. A. H., Bossuyt, P. M. M., Reitsma, J. B., Rutjes, A. W. S., Dendukuri, N., Janssen, K. J. M., & Moons, K. G. M. (2011) · BMJ · doi:10.1136/bmj.d4770 · Cited by 104
Self-citationPost hoc choice of cut points introduced bias to diagnostic research
Ewald, B. D. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.11.025 · Cited by 103
A model for assessing the sensitivity and specificity of tests subject to selection bias
Diamond, G. A., Rozanski, A., Forrester, J. S., Morris, D., Pollock, B. H., Staniloff, H. M., Berman, D. S., & Swan, H. J. C. (1986) · Journal of Chronic Diseases · doi:10.1016/0021-9681(86)90119-0 · Cited by 96
Fear of recurrence, breast-conserving surgery, and the trade-off hypothesis
Lasry, J.-C. M., & Margolese, R. G. (1992) · Cancer · doi:10.1002/1097-0142(19920415)69:8<2111::aid-cncr2820690817>3.0.co;2-t · Cited by 95
Hayen, A. D., Macaskill, P., Irwig, L., & Bossuyt, P. M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.08.024 · Cited by 95
Self-citationFreer, P. E., Niell, B. L., & Rafferty, E. A. (2015) · Radiology · doi:10.1148/radiol.14140515 · Cited by 94
Kok, L., Elias, S. G., Witteman, B. J. M., Goedhard, J. G., Muris, J. W. M., Moons, K. G. M., & de Wit, N. J. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2011.177980 · Cited by 89
Leeuwenburgh, M. M. N., Wiarda, B. M., Wiezer, M. J., Vrouenraets, B. C., Gratama, J. W., Spilt, A., Richir, M. C., Bossuyt, P. M., Stoker, J., Boermeester, M. A., et al. (2013) · Radiology · doi:10.1148/radiol.13121753 · Cited by 89
Self-citationPark, S. H., Lee, J. H., Lee, S. S., Kim, J. C., Yu, C. S., Kim, H. C., Ye, B. D., Kim, M., Kim, A. Y., & Ha, H. K. (2011) · Gut · doi:10.1136/gutjnl-2011-301135 · Cited by 84
Cecil, M. P., Kosinski, A. S., Jones, M. T., Taylor, A. T., Alazraki, N. P., Pettigrew, R. I., & Weintraub, W. S. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(96)00014-5 · Cited by 82
Gieseker, K. E., Roe, M. H., MacKenzie, T. A., & Todd, J. K. (2003) · PEDIATRICS · doi:10.1542/peds.111.6.e666 · Cited by 81
The influence of uninterpretability on the assessment of diagnostic tests
Begg, C. B., Greenes, R. A., & Iglewicz, B. (1986) · Journal of Chronic Diseases · doi:10.1016/0021-9681(86)90182-7 · Cited by 76
Pons, B., Lautrette, A., Oziel, J., Dellamonica, J., Vermesch, R., Ezingeard, E., Mariat, C., Bernardin, G., Zéni, F., Cohen, Y., et al. (2013) · Critical Care · doi:10.1186/cc12582 · Cited by 72
Bias in plain film reading performance studies
Brealey, S., & Scally, A. J. (2001) · The British Journal of Radiology · doi:10.1259/bjr.74.880.740307 · Cited by 71
The limited spectrum of patients studied in exercise test research. Analyzing the tip of the iceberg
Philbrick, J. T. (1982) · JAMA · doi:10.1001/jama.248.19.2467 · Cited by 71
Stewart, C. M. W., Schoeman, S., Booth, R. A., Smith, S. D., Wilcox, M. H., & Wilson, J. (2012) · BMJ · doi:10.1136/bmj.e8107 · Cited by 65
Effect of verification bias on positive and negative predictive values
Zhou, X. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131705 · Cited by 65
Lung Morphology Assessment with Balanced Steady-State Free Precession MR Imaging Compared with CT
Rajaram, S., Swift, A. J., Capener, D. A., Telfer, A., Davies, C., Hill, C., Condliffe, R. A., Elliot, C. A., Hurdman, J. A., Kiely, D. G., et al. (2012) · Radiology · doi:10.1148/radiol.12110990 · Cited by 65
Røsjø, H. R., Kravdal, G., Høiseth, A. D., Jørgensen, M. E., Badr, P., Røysland, R., & Omland, T. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2012.190868 · Cited by 62
Cohen, M. B., Rodgers, R. P., Hales, M., Gonzales, J. M., Ljung, B., Beckstead, J. H., Bottles, K., & Miller, T. R. (1987) · PubMed · Cited by 59
Reporting Bias in Diagnostic and Prognostic Studies: Time for Action
Rifai, N., Altman, D. G., & Bossuyt, P. M. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2008.108993 · Cited by 57
Self-citationPerformance of Rapid Streptococcal Antigen Testing Varies by Personnel
Fox, J. W., Cohen, D. M., Marcon, M. J., Cotton, W. H., & Bonsu, B. K. (2006) · Journal of Clinical Microbiology · doi:10.1128/jcm.01399-06 · Cited by 53
A comparison of methods of analysing exercise tests for diagnosis of coronary artery disease.
Deckers, J. W., Rensing, B. J., Tijssen, J. G., Vinke, R. V., Azar, A. J., & Simoons, M. L. (1989) · Heart · doi:10.1136/hrt.62.6.438 · Cited by 53
Collins, M. G., Teo, E., Cole, S. R., Chan, C.-Y., McDonald, S. P., Russ, G. R., Young, G. P., Bampton, P. A., & Coates, P. T. (2012) · BMJ · doi:10.1136/bmj.e4657 · Cited by 51
Anticipating missing reference standard data when planning diagnostic accuracy studies
Naaktgeboren, C. A., de Groot, J. A. H., Rutjes, A. W., Bossuyt, P. M., Reitsma, J. B., & Moons, K. G. M. (2016) · BMJ · doi:10.1136/bmj.i402 · Cited by 50
Self-citationPain over speed bumps in diagnosis of acute appendicitis: diagnostic accuracy study
Ashdown, H. F., D’Souza, N., Karim, M. R., Stevens, R., Huang, A., & Harnden, A. (2012) · BMJ · doi:10.1136/bmj.e8012 · Cited by 48
Publication and Reporting of Test Accuracy Studies Registered in ClinicalTrials.gov
Korevaar, D. A., Ochodo, E. A., Bossuyt, P. M. M., & Hooft, L. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2013.218149 · Cited by 47
Self-citationHarris, J. M. (1981) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1981.03320220052025 · Cited by 44
Multivariate Predictive Models for Group A Beta‐hemolytic Streptococcal Pharyngitis in Children
Attia, M. W., Zaoutis, T. E., Eppes, S. C., Klein, J. D., & Meier, F. A. (1999) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.1999.tb00087.x · Cited by 41
D’Orsi, C. J., Getty, D. J., Pickett, R. M., Sechopoulos, I., Newell, M. S., Gundry, K., Bates, S. R., Nishikawa, R. M., Sickles, E. A., Karellas, A., et al. (2012) · Radiology · doi:10.1148/radiol.12120382 · Cited by 41
Assessing the efficacy of 2 screening measures for depression in people with epilepsy
Gandy, M., Sharpe, L., Perry, K. N., Miller, L., Thayer, Z., Boserio, J., & Mohamed, A. (2012) · Neurology · doi:10.1212/wnl.0b013e318260cbfc · Cited by 40
van der Schouw, Y. T. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00144-f · Cited by 39
The Time Has Come to Register Diagnostic and Prognostic Research
Altman, D. G. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2013.220335 · Cited by 39
Self-citationAll That Glitters Isn't Gold: A Survey on Acknowledgment of Limitations in Biomedical Studies
ter Riet, G., Chesley, P., Gross, A. G., Siebeling, L., Muggensturm, P., Heller, N., Umbehr, M., Vollenweider, D., Yu, T., Akl, E. A., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073623 · Cited by 37
Off Bayes: Effect of Verification Bias on Posterior Probabilities Calculated Using Bayes' Theorem
Diamond, G. A. (1992) · Medical Decision Making · doi:10.1177/0272989x9201200105 · Cited by 36
Korevaar, D. A., Cohen, J. F., Hooft, L., & Bossuyt, P. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.01.014 · Cited by 34
Self-citationO'Connor, P. W., Tansey, C. M., Detsky, A. S., Mushlin, A. I., & Kucharczyk, W. (1996) · Neurology · doi:10.1212/wnl.47.1.140 · Cited by 32
Sample size in studies on diagnostic accuracy in ophthalmology: a literature survey
Bochmann, F., Johnson, Z. K., & Azuara‐Blanco, A. (2007) · British Journal of Ophthalmology · doi:10.1136/bjo.2006.113290 · Cited by 31
Infrequent and incomplete registration of test accuracy studies: analysis of recent study reports
Korevaar, D. A., Bossuyt, P. M. M., & Hooft, L. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-004596 · Cited by 27
Self-citationEstimating the sensitivity of cervical cytology: errors of interpretation and test limitations
RONCO, G., MONTANARI, G., AIMONE, V., PARISIO, F., SEGNAN, N., VALLE, A., & VOLANTE, R. (1996) · Cytopathology · doi:10.1046/j.1365-2303.1996.39382393.x · Cited by 25
The spectrum of patients strongly influences the usefulness of diagnostic tests for pneumonia
Melbye, H., & Straume, B. (1993) · Scandinavian Journal of Primary Health Care · doi:10.3109/02813439308994838 · Cited by 24
Registering Diagnostic and Prognostic Trials of Tests: Is It the Right Thing to Do?
Rifai, N., Bossuyt, P. M., Ioannidis, J. P. A., Bray, K. R., McShane, L. M., Golub, R. M., & Hooft, L. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2014.226100 · Cited by 22
Self-citationNaraghi, A., Gupta, S. K., Jacks, L. M., Essue, J., Marks, P., & White, L. M. (2012) · Radiology · doi:10.1148/radiol.12110779 · Cited by 22
Ezike, E. N., Rongkavilit, C., Fairfax, M. R., Thomas, R., & Asmar, B. I. (2005) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.159.5.486 · Cited by 22
Three principles to define the success of a diagnostic study could be identified
Vach, W., Gerke, O., & Høilund‐Carlsen, P. F. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.07.004 · Cited by 21
Designing Studies to Ensure that Estimates of Test Accuracy Will Travel
Irwig, L., Bossuyt, P. M., Glasziou, P., Gatsonis, C., & Lijmer, J. G. (2008) · Wiley eBooks · doi:10.1002/9781444300574.ch6 · Cited by 20
Self-citationKnottnerus, J. A., Knipschild, P. G., & STURMANS, F. (1989) · Metamedicine · doi:10.1007/bf00625761 · Cited by 20
Reporting Weaknesses in Conference Abstracts of Diagnostic Accuracy Studies in Ophthalmology
Korevaar, D. A., Cohen, J. F., de Ronde, M. W. J., Virgili, G., Dickersin, K., & Bossuyt, P. M. (2015) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2015.3577 · Cited by 20
Self-citationProspective Registration of Marker Evaluation Studies: Time to Act
Hooft, L., & Bossuyt, P. M. (2011) · Clinical Chemistry · doi:10.1373/clinchem.2011.176230 · Cited by 17
Self-citationStudy Design And Hypothesis Testing
PEPE, M. S. (2003) · Oxford University Press eBooks · doi:10.1093/oso/9780198509844.003.0008 · Cited by 14
Completeness of Safety Reporting in Randomized Trials: An Evaluation of 7 Medical Areas
Ioannidis, J. P. A., & Lau, J. (2001) · JAMA · doi:10.1001/jama.285.4.437 · Cited by 3
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
Research works printed but not linked: 1
- 10.1001/jama.1982.03330190031026 · doi:10.1001/jama.1982.03330190031026 · Paper page
Cited by
Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 23,868
McInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Bossuyt, P. M., and the PRISMA-DTA Group, Clifford, T., Cohen, J. F., Deeks, J. J., Gatsonis, C., et al. (2018) · JAMA · doi:10.1001/jama.2017.19163 · Cited by 3,210
Self-citationHofman, M. S., Lawrentschuk, N., Francis, R. J., Tang, C., Vela, I., Thomas, P., Rutherford, N., Martin, J. M., Frydenberg, M., Shakher, R., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30314-7 · Cited by 2,040
Serdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2021) · Biochemia medica · doi:10.11613/bm.2021.010502 · Cited by 1,570
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443
Metadata
- Authors
- Cohen, J. F., Korevaar, D. A., Altman, D. G., Bruns, D. E., Gatsonis, C. A., Hooft, L., Irwig, L., Levine, D., Reitsma, J. B., de Vet, H. C. W., & Bossuyt, P. M. M.
- Affiliations
- Inserm (FR)
- Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands
- University of Oxford (GB)
- University of Virginia (US)
- Brown University (US)
- Utrecht University (NL)
- The University of Sydney (AU)
- Beth Israel Deaconess Medical Center (US)
- Department of Epidemiology and Biostatistics, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands
- Amsterdam UMC Location University of Amsterdam (NL)
- Corresponding author
- Bossuyt, Patrick M M
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2016-11
- Volume
- 6
- Issue
- 11
- Pages
- e012799
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5128957
- OpenAlex
- W2554140915
- Semantic Scholar
- 23bcfa8689fd3158e413b978193deb6b0d4cc345
- Cited by
- 2,570
- References
- 125
- Citations by year
- 2026: 367 · 2025: 433 · 2024: 356 · 2023: 279 · 2022: 279 · 2021: 299 · 2020: 242 · 2019: 179 · 2018: 109 · 2017: 20
- FWCI
- 95.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Cancer Research UK (16895)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- STARD 2015, reporting guidelines, diagnostic accuracy studies, reporting checklist, EQUATOR Network
- MeSH terms
- Humans, Terminology as Topic, Publishing, Research Design, Bias, Diagnostic Techniques and Procedures, Advisory Committees, Biomedical Research, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

