Standards of Reporting of Randomized Controlled Trials in General Surgery: Can We Do Better?
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
In Brief Objective: To evaluate the quality of reporting of surgical randomized controlled trials published in surgical and general medical journals using Jadad score, allocation concealment, and adherence to CONSORT guidelines and to identify factors associated with good quality. Summary Background Data: Randomized controlled trials (RCTs) provide the best evidence about the relative effectiveness of different interventions. Improper methodology and reporting of RCTs can lead to erroneous conclusions about treatment effects, which may mislead decision-making in health care at all levels. Methods: Information was obtained on RCTs published in 6 general surgical and 4 general medical journals in the year 2003. The quality of reporting of RCTs was assessed under masked conditions using allocation concealment, Jadad score, and a CONSORT checklist devised for the purpose. Results: Of the 69 RCTs analyzed, only 37.7% had a Jadad score of ≥3, and only 13% of the trials clearly explained allocation concealment. The modified CONSORT score of surgical trials reported in medical journals was significantly higher than those reported in surgical journals (Mann-Whitney U test, P < 0.001). Overall, the modified CONSORT score was higher in studies with higher author numbers (P = 0.03), multicenter studies (P = 0.002), and studies with a declared funding source (P = 0.022). Conclusion: The overall quality of reporting of surgical RCTs was suboptimal. There is a need for improving awareness of the CONSORT statement among authors, reviewers, and editors of surgical journals and better quality control measures for trial reporting and methodology. We evaluated the reporting quality of surgical randomized controlled trials published in general surgical and medical journals. We show suboptimal quality of reporting as assessed by standard quality scores and the CONSORT guidelines. The low quality cannot be explained by limitations inherent in the scientific assessment of operative interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308 · cited 1×
“Successful randomization hinges on 2 steps: generation of an unpredictable allocation sequence and concealment of this sequence from the investigator enrolling the participant (allocation concealment).(9) The latter helps to prevent selection bias, protects the randomization sequence before and until the interventions…”
BackgroundMoher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027 · cited 3×
“The need to improve the quality of reporting of RCTs has been highlighted in several specialties across healthcare.(6,11,15,16) We performed an exploratory survey of the quality of reporting of surgical RCTs in the surgical literature and assessed similar studies published in general medical literature, which served a…”
MethodStatistical Considerations in the Intent-to-Treat Principle
Lachin, J. M. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00046-5 · Cited by 652
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397 · cited 1×
“Inadequate methodology may be due to several reasons: subversion of randomization resulting in biased allocation to comparison groups; unequal provision of care apart from the intervention under evaluation; biased assessment of outcomes and inadequate handling of dropouts and losses to follow-up.(5) Results of such bi…”
BackgroundSchulz, K. F., Grimes, D. A., Altman, D. G., & Hayes, R. J. (1996) · BMJ · doi:10.1136/bmj.312.7033.742 · Cited by 163
Cited by
Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740
Evaluation and stages of surgical innovations
Barkun, J. S., Aronson, J. K., Feldman, L. S., Maddern, G. J., & Strasberg, S. M. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61083-7 · Cited by 573
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008-w1 · Cited by 523
Scoping review on interventions to improve adherence to reporting guidelines in health research
Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026589 · Cited by 154
Jin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Li, G., Bhatt, M., Zielinski, L., Bantoto, B., Wang, M., et al. (2018) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s155103 · Cited by 134
Metadata
- Authors
- Balasubramanian, S. P., Wiener, M., Alshameeri, Z., Tiruvoipati, R., Elbourne, D., & Reed, M. W.
- Venue
- Annals of Surgery
- Published
- 2006-11
- Volume
- 244
- Issue
- 5
- Pages
- 663-667
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W1973983211
- Cited by
- 161
- References
- 9
- FWCI
- 10.53
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Standards of Reporting of Randomized Controlled Trials in General Surgery: Can We Do Better? https://app.cochat.ai/papers/10.1097/01.sla.0000217640.11224.05
- The paper
- Balasubramanian, S. P., Wiener, M., Alshameeri, Z., Tiruvoipati, R., Elbourne, D., & Reed, M. W. (2006). Standards of Reporting of Randomized Controlled Trials in General Surgery: Can We Do Better? Annals of Surgery. https://doi.org/10.1097/01.sla.0000217640.11224.05
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.