Registration Rates, Adequacy of Registration, and a Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials Published in Surgery Journals
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To determine the proportion of registered trials published in the surgical literature, to compare, in registered trials, the primary outcomes registered with those published and to determine whether outcome-reporting bias favored significant primary outcomes. BACKGROUND: Trial protocol registration before patient enrolment for randomized controlled trials (RCTs) is a perquisite for many journals in attempt to decrease publication and selective reporting bias. Analysis of the medical literature demonstrates poor registration rates with discrepancies between reported and registered primary outcomes. This has not been evaluated in contemporary surgical journals. METHODS: RCTs were identified for 2009 and 2010 from 10 high-impact factor surgical journals. One investigator identified all RCTs and extracted primary and secondary outcomes, dates of commencement and completion of study, funding source, and trial registration number. Trial registers were searched using the trial registration number for primary and secondary outcomes, dates of commencement and completion of study, and date of registration. Trial registration rates and registration adequacy were recorded. Register and published primary outcomes were then compared. RESULTS: A total of 246 papers were analyzed, among which 86 (34.9%) were not registered and 52 (21%) were inadequately registered. Of the 108 adequately registered trials, 32 (29%) had a discrepancy between the published primary outcome and that registered in trial register. In the 24 published studies where it was possible to assess, the discrepancy favored a statistically significant primary outcome in 22 (91.7%) whereas in 2 (8.3%) the discrepancy produced a statistically insignificant result. CONCLUSIONS: Less than half of all RCTs published in general surgical journals were adequately registered, and approximately 30% had discrepancies in the registered and published primary outcome with 90% of those assessable favoring a statistically positive result.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Epidemiology and reporting of randomised trials published in PubMed journals
Chan, A.-W., & Altman, D. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71879-1 · Cited by 474
Bero, L., Oostvogel, F., Bacchetti, P., & Lee, K. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040184 · Cited by 249
Comparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K., Altman, D. G., Cresswell, L., Blundell, M., Gamble, C. L., & Williamson, P. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000031.pub2 · Cited by 243
Clinical trial registration: transparency is the watchword
Sim, I., Chan, A.-W., Gülmezoglu, A. M., Evans, T., & Pang, T. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68708-4 · Cited by 165
Bias, Spin, and Misreporting: Time for Full Access to Trial Protocols and Results
Chan, A.-W. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050230 · Cited by 144
Cited by
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Comparison of registered and published outcomes in randomized controlled trials: a systematic review
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015) · BMC Medicine · doi:10.1186/s12916-015-0520-3 · Cited by 237
“, 2014 [26] 108 9 (8) 9 (8) 6 (6) 6 (6) 7 (6)”
ResultOutcome Discrepancies and Selective Reporting: Impacting the Leading Journals?
Fleming, P. S., Koletsi, D., Dwan, K., & Pandis, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127495 · Cited by 80
Chen, T., Li, C., Qin, R., Wang, Y., Yu, D., Dodd, J., Wang, D., & Cornelius, V. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.7242 · Cited by 68
Arunachalam, L., Hunter, I. A., & Killeen, S. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000001795 · Cited by 56
Self-citation
Metadata
- Authors
- Killeen, S., Sourallous, P., Hunter, I. A., Hartley, J. E., & Grady, H. L. O.
- Venue
- Annals of Surgery
- Published
- 2014-01
- Volume
- 259
- Issue
- 1
- Pages
- 193-196
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W1979123616
- Cited by
- 90
- References
- 6
- FWCI
- 10.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Registration Rates, Adequacy of Registration, and a Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials Published in Surgery Journals. https://app.cochat.ai/papers/10.1097/sla.0b013e318299d00b
- The paper
- Killeen, S., Sourallous, P., Hunter, I. A., Hartley, J. E., & Grady, H. L. O. (2014). Registration Rates, Adequacy of Registration, and a Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials Published in Surgery Journals. Annals of Surgery. https://doi.org/10.1097/sla.0b013e318299d00b
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.