Facilitating Prospective Registration of Diagnostic Accuracy Studies: A STARD Initiative
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Although the introduction of prospective trial registration policies has been successful in reducing waste in research, diagnostic accuracy studies are rarely registered. We describe why diagnostic accuracy studies should be registered, and where and how this can be done. Advantages of registration include the identification of unpublished studies, prevention of selective outcome reporting, prevention of unnecessary duplication of research, collaboration between researchers, and linkage of study materials. In a survey among representatives of 16 major trial registries, such as ClinicalTrials.gov, ANZCTR (Australian New Zealand Clinical Trials Registry), and the UK-based ISRCTN registry (International Standard Randomised Controlled Trial Number), 13 responded, of which 8 (62%) indicated they always accept registration of diagnostic accuracy studies and 5 (38%) do so in some cases. However, all but one of them (92%) indicated that their registry currently does not provide specific guidance for registering diagnostic accuracy studies. A second survey among the 85 members of the STARD Group (Standards for Reporting Diagnostic Accuracy) resulted in the identification of 14 essential protocol items and was used for developing a guide on how these items can be registered in existing major trial registries. We propose that investigators responsible for diagnostic accuracy studies should register their study, before recruiting patients, in 1 of the existing major trial registries that are willing to host such studies. We also propose that governmental, research, and academic institutions that provide funding for and journals that publish diagnostic accuracy studies require such registration. Over the past decade, there have been growing concerns about a wide range of sources of avoidable waste in biomedical research (1). Examples include studies addressing low-priority clinical questions, study results that are unreported, and published study reports that are not as informative as they could be (1, 2). One approach to reduce research waste has been the introduction of prospective trial registration policies (3). In 2005, the International Committee of Medical Journal Editors (ICMJE) declared that its member journals would only consider reports of trials for publication if they had been registered in a publicly accessible trial registry prospectively, before enrollment of the first study participant (4). Subsequently, similar requirements have been implemented by several governmental organizations, funders, and academic institutions (2). These policies led to a large increase in registered studies, (5), and about half of recently published trials now report a registration number (6). Unfortunately, registration rates remain low for diagnostic accuracy studies, (7, 8) despite the compelling rationale for prospective registration that applies to this type of study design (9–12). One reason may be that registration policies have thus far mainly addressed randomized trials of interventions, whereas diagnostic accuracy studies, which compare medical tests against a clinical reference standard, are often considered to be observational. Another reason may be the unavailability of specific guidance for registration of these studies. In this article, we explained why we believe that there is a need to register diagnostic accuracy studies and where and how this can be done. We provide guidance for authors and readers based on 2 online surveys (Fig. 1). Diagnostic tests are indispensable in clinical practice. Physical examination, imaging techniques, laboratory tests, and other forms of medical testing inform clinicians about the likelihood that a tested patient has the suspected target disease or condition and guide subsequent decisions about further testing or treatment. Most diagnostic tests are not perfectly accurate in classifying patients as having the target condition or not, and some of those tested will have a false-positive or a false-negative test result (13). Diagnostic accuracy is typically evaluated by comparing test results with those of a reference standard in a series of patients suspected of having a target condition. The diagnostic accuracy of the test under investigation is then expressed in measures such as sensitivity and specificity, positive and negative predictive values, likelihood ratios, and area under the receiver operating characteristic curve (13). Every year, thousands of these diagnostic accuracy studies are being undertaken. Some are based on a retrospective review of chart data; many others prospectively collect data of patients who have specifically consented to data collection. Sometimes, evaluations of diagnostic accuracy are incorporated into larger overarching projects that have other non-diagnostic study objectives (7). There are numerous reasons why prospective registration of diagnostic accuracy studies is beneficial for those involved in conducting research as well as those who rely o
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration
Cohen, J. F., Korevaar, D. A., Altman, D. G., Bruns, D. E., Gatsonis, C. A., Hooft, L., Irwig, L., Levine, D., Reitsma, J. B., de Vet, H. C. W., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012799 · Cited by 2,570
Self-citationBiomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · Clinical Chemistry · doi:10.1373/clinchem.2015.246280 · Cited by 984
Self-citationIncreasing value and reducing waste in biomedical research: who's listening?
Moher, D., Glasziou, P., Chalmers, I., Nasser, M., Bossuyt, P. M. M., Korevaar, D. A., Graham, I. D., Ravaud, P., & Boutron, I. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00307-4 · Cited by 462
Self-citationA systematic review classifies sources of bias and variation in diagnostic test accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., & Mallett, S. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.05.014 · Cited by 283
The Evolution of Trial Registries and Their Use to Assess the Clinical Trial Enterprise
Dickersin, K. (2012) · JAMA · doi:10.1001/jama.2012.4230 · Cited by 127
Trial Registration Numbers Are Underreported in Biomedical Publications
van de Wetering, F. T., Scholten, R. J. P. M., Haring, T., Clarke, M., & Hooft, L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049599 · Cited by 79
Self-citationJones, C. W., Keil, L. G., Weaver, M. A., & Platts-Mills, T. F. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-126 · Cited by 61
The Time Has Come to Register Diagnostic and Prognostic Research
Altman, D. G. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2013.220335 · Cited by 39
Cited by
Park, S. H., & Han, K. (2018) · Radiology · doi:10.1148/radiol.2017171920 · Cited by 894
Salameh, J.-P., Bossuyt, P. M., McGrath, T. A., Thombs, B. D., Hyde, C. J., Macaskill, P., Deeks, J. J., Leeflang, M., Korevaar, D. A., Whiting, P., et al. (2020) · BMJ · doi:10.1136/bmj.m2632 · Cited by 719
Self-citationKim, D. W., Jang, H. Y., Kim, K. W., Shin, Y., & Park, S. H. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0025 · Cited by 459
“Prospective registration of diagnostic test accuracy studies, which include studies to validate AI performance, has already been proposed (28).”
BackgroundDesigning deep learning studies in cancer diagnostics
Kleppe, A., Skrede, O.-J., De Raedt, S., Liestøl, K., Kerr, D. J., & Danielsen, H. E. (2021) · Nature Reviews Cancer · doi:10.1038/s41568-020-00327-9 · Cited by 316
A Clinician's Guide to Artificial Intelligence: How to Critically Appraise Machine Learning Studies
Faes, L., Liu, X., Wagner, S. K., Fu, D. J., Balaskas, K., Sim, D. A., Bachmann, L. M., Keane, P. A., & Denniston, A. K. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.2.7 · Cited by 162
Metadata
- Authors
- Korevaar, D. A., Hooft, L., Askie, L. M., Barbour, V., Faure, H., Gatsonis, C. A., Hunter, K. E., Kressel, H. Y., Lippman, H., McInnes, M. D. F., Moher, D., Rifai, N., Cohen, J. F., & Bossuyt, P. M. M.
- Venue
- Clinical Chemistry
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-08-01
- Volume
- 63
- Issue
- 8
- Pages
- 1331-1341
- ISSN
- 0009-9147 (ISSN-L)
- 1530-8561
- OpenAlex
- W2712249504
- Cited by
- 36
- References
- 9
- FWCI
- 3.61
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.