Comparison of Randomized Controlled Trial Registry Entries and Content of Reports in Surgery Journals
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
In Brief Objective: To evaluate discrepancies between trial registry entries and final reports of randomized controlled trials (RCTs) published in major general surgical journals. Background: Health care decisions are based on published results in peer-reviewed journals. Mandatory trial registration was introduced to increase transparency and reduce publication and outcome reporting bias. Methods: The discrepancy rate between trial registry entries and final reports of all RCTs published during 2010 in the Annals of Surgery, Archives of Surgery, and British Journal of Surgery was evaluated. Results: Of 596 identified studies, 545 were excluded because they were not RCTs or interim reports/secondary analysis of RCTs or because of missing trial registry information. In the remaining 51 RCTs, prospective registration was found in 9.8% (n = 5), registration during trial conduct in 33.3% (n = 17), and retrospective registration in 56.9% (n = 29), respectively. For the primary and secondary outcomes, there was no discrepancy in 54.9% and 33.3%, complete omission in 7.8% and 31.3%, new introduction in 7.8% and 39.2%, a change in definition in 9.8% and 5.8%, downgrading from primary to secondary in 21.6%, and upgrading from secondary to primary in 13.7%. There were few discrepancies in randomization, blinding, and intervention and some in targeted sample size and inclusion/exclusion criteria. Conclusions: When interpreting the results of surgical RCTs, the possibility of selective reporting, and thus outcome reporting bias, has to be kept in mind. For future trials, prospective registration should be strictly respected with the ultimate goal to increase transparency and contribute to high-level evidence reports for optimal patient care in surgery. This study evaluated discrepancy rates between trial registry entries and final reports of randomized controlled trials published during 2010 in 3 major general surgery journals. Considerable discrepancies were found concerning outcomes, few regarding randomization, blinding, and interventions, and some concerning targeted sample size and inclusion/exclusion criteria. Potential reporting bias needs to be considered when interpreting individual study results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Chi-squared and Fisher-Irwin tests of two-by-two tables with small sample recommendations
Campbell, I. (2007) · Statistics in Medicine · doi:10.1002/sim.2832 · Cited by 912
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444
Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov
Bourgeois, F. T., Murthy, S., & Mandl, K. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-3-201008030-00006 · Cited by 332 · cited 1×
“1% of discrepancies in outcomes were found whereas in the literature these rates have been reported to be between 18%(14) and 31%(15,16).”
BackgroundAssociation of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284
Expression of Concern Reaffirmed
Curfman, G. D., Morrissey, S., & Drazen, J. M. (2006) · New England Journal of Medicine · doi:10.1056/nejme068054 · Cited by 109
Cited by
Comparison of registered and published outcomes in randomized controlled trials: a systematic review
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015) · BMC Medicine · doi:10.1186/s12916-015-0520-3 · Cited by 237
“, 2013 [33] 51 10 (20) 9 (18) 11 (22) 7 (14) 12 (24)”
BackgroundResultDwan, K., Altman, D. G., Clarke, M., Gamble, C., Higgins, J. P. T., Sterne, J. A. C., Williamson, P. R., & Kirkham, J. J. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001666 · Cited by 187
“Five studies considered whether an intention-totreat analysis or per protocol analysis was specified or reported [6,20,23,25,28].”
BackgroundMethodInfluentialSelf-citationOutcome Discrepancies and Selective Reporting: Impacting the Leading Journals?
Fleming, P. S., Koletsi, D., Dwan, K., & Pandis, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127495 · Cited by 80
“This distribution is in accordance with other studies reporting the previous two issues with a frequency of 8% to 18% [6, 8] and the latter at between 4% and 22% [6, 7].”
BackgroundResultInfluentialSelf-citationUse of guidelines to improve the quality and transparency of reporting oral health research
Sarkis-Onofre, R., Cenci, M. S., Demarco, F. F., Lynch, C. D., Fleming, P. S., Pereira-Cenci, T., & Moher, D. (2015) · Journal of Dentistry · doi:10.1016/j.jdent.2015.01.006 · Cited by 73
Chen, T., Li, C., Qin, R., Wang, Y., Yu, D., Dodd, J., Wang, D., & Cornelius, V. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.7242 · Cited by 68
Metadata
- Authors
- Rosenthal, R., & Dwan, K.
- Venue
- Annals of Surgery
- Published
- 2013-06
- Volume
- 257
- Issue
- 6
- Pages
- 1007-1015
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W2048256300
- Cited by
- 50
- References
- 11
- FWCI
- 7.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.