Comparison of Effects in Randomized Controlled Trials With Observational Studies in Digestive Surgery
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
In Brief Objectives: To compare the results of randomized controlled trials versus observational studies in meta-analyses of digestive surgical topics. Summary Background Data: While randomized controlled trials have been recognized as providing the highest standard of evidence, claims have been made that observational studies may overestimate treatment benefits. This debate has recently been renewed, particularly with regard to pharmacotherapies. Methods: The PubMed (1966 to April 2004), EMBASE (1986 to April 2004) and Cochrane databases (Issue 2, 2004) were searched to identify meta-analyses of randomized controlled trials in digestive surgery. Fifty-two outcomes of 18 topics were identified from 276 original articles (96 randomized trials, 180 observational studies) and included in meta-analyses. All available binary data and study characteristics were extracted and combined separately for randomized and observational studies. In each selected digestive surgical topic, summary odds ratios or relative risks from randomized controlled trials were compared with observational studies using an equivalent calculation method. Results: Significant between-study heterogeneity was seen more often among observational studies (5 of 12 topics) than among randomized trials (1 of 9 topics). In 4 of the 16 primary outcomes compared (10 of 52 total outcomes), summary estimates of treatment effects showed significant discrepancies between the two designs. Conclusions: One fourth of observational studies gave different results than randomized trials, and between-study heterogeneity was more common in observational studies in the field of digestive surgery. Comparison of the results of randomized controlled trials versus observational studies in meta-analyses of digestive surgical topics was performed. One fourth of observational studies gave different results than randomized trials, and between-study heterogeneity was more common in observational studies in the field of digestive surgery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205 · cited 1×
“10,11 Heterogeneity between studies was assessed using Q statistics.”
MethodA comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347 · cited 1×
“Some reports have suggested that for selected medical topics, both randomized and observational studies, may yield very similar results.(7,8) Conversely, opposing results have been reported from a large number of diverse medical topics.”
ResultStreptomycin Treatment of Pulmonary Tuberculosis: A Medical Research Council Investigation
(1948) · BMJ · doi:10.1136/bmj.2.4582.769 · Cited by 986
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
Randomized versus historical controls for clinical trials
Sacks, H., Chalmers, T. C., & Smith, H. (1982) · The American Journal of Medicine · doi:10.1016/0002-9343(82)90815-4 · Cited by 834
Cited by
Evaluation and stages of surgical innovations
Barkun, J. S., Aronson, J. K., Feldman, L. S., Maddern, G. J., & Strasberg, S. M. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61083-7 · Cited by 573
Anglemyer, A., Horvath, H. T., & Bero, L. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000034.pub2 · Cited by 534
Golder, S., Loke, Y. K., & Bland, M. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001026 · Cited by 269
Ribaric, G., Buchwald, J. N., & McGlennon, T. W. (2014) · Obesity Surgery · doi:10.1007/s11695-013-1160-3 · Cited by 264
Prasad, V., Jorgenson, J., Ioannidis, J. P. A., & Cifu, A. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.11.005 · Cited by 90
Metadata
- Authors
- Shikata, S., Nakayama, T., Noguchi, Y., Taji, Y., & Yamagishi, H.
- Venue
- Annals of Surgery
- Published
- 2006-11
- Volume
- 244
- Issue
- 5
- Pages
- 668-676
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W1967947002
- Cited by
- 91
- References
- 6
- FWCI
- 4.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparison of Effects in Randomized Controlled Trials With Observational Studies in Digestive Surgery. https://app.cochat.ai/papers/10.1097/01.sla.0000225356.04304.bc
- The paper
- Shikata, S., Nakayama, T., Noguchi, Y., Taji, Y., & Yamagishi, H. (2006). Comparison of Effects in Randomized Controlled Trials With Observational Studies in Digestive Surgery. Annals of Surgery. https://doi.org/10.1097/01.sla.0000225356.04304.bc
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.