Infrequent and incomplete registration of test accuracy studies: analysis of recent study reports
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Objectives: To identify the proportion of articles reporting on test accuracy for which the corresponding study had been registered. Design: Analysis of a consecutive sample of published study reports. Participants: PubMed was searched for publications in journals with an impact factor of 5 or higher in May and June 2012. Articles were included if they reported on original studies evaluating the accuracy of one or more diagnostic or prognostic tests or markers against a clinical reference standard in humans. Primary and secondary outcome measures: Primary outcome was registration of the reported test accuracy study. We additionally explored study characteristics associated with registration. Results: We found 1941 references; 351 study reports fulfilled the inclusion criteria, of which 52 studies (15%) had been registered. Of these, 27 (52%) provided a registration number in the publication, and 12 (23%) provided a reference to the publication in the registry. Registration rates were similar for studies on diagnostic versus those on prognostic tests, and among studies on imaging tests versus those on laboratory techniques. Studies reporting some form of industry involvement were more often registered (33%) than studies reporting another source of funding (11%), and studies without a (reported) source of (external) funding (9%; p<0.001). Of the registered studies, 8 (15%) had been registered after completion, 14 were registered before initiation (27%) and 30 (58%) between initiation and completion. Only 16 (31%; 5% of the total sample) had registered the published primary outcome measures before completion. Conclusions: Few test accuracy studies published in higher impact journals are registered. Only 1 in 22 of such studies register their primary outcomes before study completion. Owing to the reasons for registering studies that investigate the cause-and-effect relationship between health-related interventions and health outcomes also apply to test accuracy studies, prospective study registration of these studies should be further promoted among investigators and journal editors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417 · cited 1×
“reporting of research findings depending on the strength and direction of outcomes.(2) 3 This requirement improves the evidence base on which clinical decisions are made.”
BackgroundSterne, J. A., Egger, M., & Moher, D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch10 · Cited by 651
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401
Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov
Bourgeois, F. T., Murthy, S., & Mandl, K. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-3-201008030-00006 · Cited by 332
Song, F., Parekh-Bhurke, S., Hooper, L., Loke, Y. K., Ryder, J. J., Sutton, A. J., Hing, C. B., & Harvey, I. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-79 · Cited by 175
Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”
Ochodo, E. A., de Haan, M. C., Reitsma, J. B., Hooft, L., Bossuyt, P. M., & Leeflang, M. M. G. (2013) · Radiology · doi:10.1148/radiol.12120527 · Cited by 158 · cited 1×
“This impact factor cut-off is in line with previously published analyses of test accuracy studies.(15) 16 The final search was performed on 25 February 2013.”
ResultSelf-citationRegistration of observational studies: Is it time?
Williams, R. J., Tse, T., Harlan, W. R., & Zarin, D. A. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.092252 · Cited by 152
Quantifying the Added Value of a Diagnostic Test or Marker
Moons, K. G. M., de Groot, J. A. H., Linnet, K., Reitsma, J. B., & Bossuyt, P. M. M. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2012.182550 · Cited by 152 · cited 1×
“and proper usage of medical tests should be based on a thorough scientific evaluation.(8) Test accuracy studies form an essential part in this process.”
BackgroundSelf-citationThe Registration of Observational Studies—When Metaphors Go Bad
(2010) · Epidemiology · doi:10.1097/ede.0b013e3181eafbcf · Cited by 56
Cited by
McInnes, M. D. F., Moher, D., Thombs, B. D., McGrath, T. A., Bossuyt, P. M., and the PRISMA-DTA Group, Clifford, T., Cohen, J. F., Deeks, J. J., Gatsonis, C., et al. (2018) · JAMA · doi:10.1001/jama.2017.19163 · Cited by 3,210
Self-citationSTARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration
Cohen, J. F., Korevaar, D. A., Altman, D. G., Bruns, D. E., Gatsonis, C. A., Hooft, L., Irwig, L., Levine, D., Reitsma, J. B., de Vet, H. C. W., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012799 · Cited by 2,570
Self-citationKorevaar, D. A., Westerhof, G. A., Wang, J., Cohen, J. F., Spijker, R., Sterk, P. J., Bel, E. H., & Bossuyt, P. M. M. (2015) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(15)00050-8 · Cited by 282
Self-citationBashir, R., Bourgeois, F. T., & Dunn, A. G. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0518-3 · Cited by 47
Treanor, L., Frank, R. A., Cherpak, L. A., Dehmoobad Sharifabadi, A., Salameh, J.-P., Hallgrimson, Z., Fabiano, N., McGrath, T. A., Kraaijpoel, N., Yao, J., et al. (2020) · European Radiology · doi:10.1007/s00330-019-06568-z · Cited by 38
Self-citation
Metadata
- Authors
- Korevaar, D. A., Bossuyt, P. M. M., & Hooft, L.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2014-01
- Volume
- 4
- Issue
- 1
- Pages
- e004596
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W1987845650
- Cited by
- 27
- References
- 9
- FWCI
- 4.48
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Infrequent and incomplete registration of test accuracy studies: analysis of recent study reports. https://app.cochat.ai/papers/10.1136/bmjopen-2013-004596
- The paper
- Korevaar, D. A., Bossuyt, P. M. M., & Hooft, L. (2014). Infrequent and incomplete registration of test accuracy studies: analysis of recent study reports. BMJ Open. https://doi.org/10.1136/bmjopen-2013-004596
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.