CoChat

The reporting quality of randomised controlled trials in surgery: A systematic review

Open access
Agha, Riaz, Cooper, Derek, Muir, Gordon · 2007 · International Journal of Surgery
Cited by 142

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

OBJECTIVES: In order to examine the reporting quality of urological RCTs, the initial objectives of this study were to evaluate the degree to which RCTs involving urological surgical techniques (as the intervention) published in the years 2000-2003 complied with the CONSORT statement, and to assess trends and patterns of compliance. Following our initial findings in urology, we extended the methodology to a number of other specialties to assess whether our findings in urology could be generalised to other surgical disciplines. METHODS: The Royal Society of Medicine (RSM) Library was commissioned to search the Medline and Cochrane databases for RCTs in compliance with the study inclusion criteria below. Additional analyses of five other specialties (non-urological trials: cardiovascular, gastrointestinal, hepatic, orthopaedic and vascular) were also made. For the non-urological trials, 15 English language trials (from each specialty) were randomly picked from a blast search conducted by the RSM for the year 2003. The RCTs were given a score out of 22, reflecting how many of the 22 CONSORT items were complied with (with each item being given equal weighting), this score was termed the "CONSORT score". RESULTS: Urology trials: In total 122 RCT abstracts were identified which met the inclusion criteria for this study. From these, 32 were excluded as they were follow-up studies, involved a virtual procedure or were a cost analysis, leaving 90 RCTs published across 35 different journals which were analysed (68.2%, 90/122). The average score of 11.1 for urological trials indicates that RCTs in our sample do not comply with the CONSORT statement. No trials reported how they implemented their randomisation process. Only 46% of RCTs stated that they had permission from an ethics review board, 20% had declared their sources of funding, 14% stated whether there were any conflicts of interest and only 1.1% stated their trial registry number. For non-urological studies, an average CONSORT score of 11.2 was obtained. CONCLUSION: Clinical research teams conducting RCTs in urology and other surgical disciplines demonstrate poor compliance with the CONSORT statement. We would recommend that trials should be registered at their outset and that urological and other surgical journals to consider supporting the CONSORT statement and to have compliance 'hard-wired' into their submission, editorial and peer-review processes. Since it seems the best researchers are unable to produce an RCT results which enable surgical techniques to be critically assessed, there is a need for education about the CONSORT statement and its importance at all levels of surgical training. We believe that an open debate is needed on the possible role of other research designs, such as tracker studies. Whether this study actually raises the question of how appropriate RCTs are to surgical techniques, we leave to the reader.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.ijsu.2007.06.002

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Cited by

Metadata

Authors
Agha, R., Cooper, D., & Muir, G.
Venue
International Journal of Surgery
Published
2007-12
Volume
5
Issue
6
Pages
413-422
ISSN
  • 1743-9159 (ISSN-L)
  • 1743-9191
OpenAlex
W1967839855
Cited by
142
References
10
FWCI
1.93
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.