Blinding in randomized controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Blinding is a measure in randomized controlled trials (RCT) to reduce detection and performance bias. There is evidence that lack of blinding leads to overestimated treatment effects. Because of the physical component of interventions, blinding is not easily applicable in surgical trials. This is a protocol for a systematic review and empirical study about actual impact on outcomes and future potential of blinding in general and abdominal surgery RCT. METHODS/DESIGN: A systematic literature search in CENTRAL, MEDLINE and Web of Science will be conducted to locate RCT between 1996 and 2015 with a surgical intervention. General study characteristics and information on blinding methods will be extracted. The risk of performance and detection bias will be rated as low, unclear or high according to the Cochrane Collaboration's tool for assessing risk of bias. The main outcome of interest will be the association of a high risk of performance or detection bias with significant trial results and will be tested at a level of significance of 5 %. Further, trials will be meta-analysed in a Mantel-Haenszel model comparing trials with high risk of bias to other trials at a level of significance of 5 %. DISCUSSION: Detection and performance bias distort treatment effects. The degree of such bias in general and abdominal surgery is unknown. Evidence on influence of missing blinding would improve critical appraisal and conduct of general and abdominal surgery RCT. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 2015: CRD42015026837.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 3×
“The existing literature clearly shows that existing detection and performance bias distort the measured effect from the true effect in pharmacological trials [7, 12].”
BackgroundImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Trials · doi:10.1186/1745-6215-11-32 · Cited by 1,871
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 1×
“An a priori defined primary endpoint is necessary in order to have a sample in which trials are excluded with changed, newly introduced or omitted primary endpoints which therefore are at high risk of bias due to selective reporting [17].”
BackgroundSingle data extraction generated more errors than double data extraction in systematic reviews
Buscemi, N., Hartling, L., Vandermeer, B., Tjosvold, L., & Klassen, T. P. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.11.010 · Cited by 464 · cited 1×
“Data extraction will be performed by two reviewers independently for quality assurance purposes [19].”
MethodReporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389
Boutron, I., Tubach, F., Giraudeau, B., & Ravaud, P. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.010 · Cited by 300 · cited 1×
“Blinding of patients and outcome assessors is not easily applicable [3, 4, 13].”
Background
Research works printed but not linked: 8
- Phillips B, Ball C, Sackett D, Badenoch D, Straus S, Haynes B, Dawes M. Oxford Centre for Evidence-based Medicine—levels of evidence (March 2009). Available from: www.cebm.net/oxford-centre-evidence-based-medicine-levels-evidence-march-2009/(Last accessed 01 Nov 2015)
- Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials in evaluating surgical procedures? Surgery. 1995;118:459–67. · DOI · Paper page
- Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273:408–12. · DOI
- Kjaergard LL, Villumsen J, Gluud C. Proceedings of the 7th Cochrane colloquium. Universita S.Tommaso D’Aquino, Rome. Milan: Centro Cochrane Italiano; 1999. Quality of randomised clinical trials affects estimates of intervention efficacy; p. 57. (poster B10).
- Jüni P, Tallon D, Egger M. Proceedings of the 3rd symposium on systematic reviews: beyond the basics, St Catherine’s College, Oxford. Oxford: Centre for Statistics in Medicine; 2000. ‘Garbage in - garbage out’? Assessment of the quality of controlled trials in meta-analyses published in leading journals; p. 19.
- Noseworthy JH, Ebers GC, Vandervoort MK, Farquhar RE, Yetisir E, Roberts R. The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology. 1994;44(1):16–20. · DOI · Paper page
- Probst P, Grummich K, Tenckhoff S, Ulrich A, Büchler MW, Knebel P, Diener MK. Industry bias in randomized controlled trials in general and abdominal surgery: an empirical study. Ann Surg. 2015 [Epub ahead of print] · DOI
- Probst P, Grummich K, Ulrich A, Büchler MW, Knebel P, Diener MK. Association of industry sponsorship and positive outcome in randomised controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study. Syst Rev. 2014;3:138. · DOI
Cited by
Junqueira, D. R., Zorzela, L., Golder, S., Loke, Y., Gagnier, J. J., Julious, S. A., Li, T., Mayo-Wilson, E., Pham, B., Phillips, R., et al. (2023) · BMJ · doi:10.1136/bmj-2022-073725 · Cited by 281
Nickel, F., Haney, C. M., Kowalewski, K. F., Probst, P., Limen, E. F., Kalkum, E., Diener, M. K., Strobel, O., Müller-Stich, B. P., & Hackert, T. (2020) · Annals of Surgery · doi:10.1097/sla.0000000000003309 · Cited by 275
Self-citationExpectancy in placebo-controlled trials of psychedelics: if so, so what?
Butler, M., Jelen, L., & Rucker, J. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06221-6 · Cited by 100
“In one review of the current state of surgical evidence which discussed the utility of modified RCTs to bolster the wider evidence base, the authors suggested that ‘it remains unclear if ornate blinding measures for surgical interventions are really justified by the gain of better evidence’ (Probst et al. 2016).”
BackgroundJunqueira, D. R., Zorzela, L., Golder, S., Loke, Y., Gagnier, J. J., Julious, S. A., Li, T., Mayo-Wilson, E., Pham, B., Phillips, R., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.04.005 · Cited by 67
Metadata
- Authors
- Probst, P., Grummich, K., Heger, P., Zaschke, S., Knebel, P., Ulrich, A., Büchler, M. W., & Diener, M. K.
- Venue
- Systematic Reviews
- Published
- 2016-03-24
- Volume
- 5
- Issue
- 1
- Pages
- 48-48
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2304862114
- Cited by
- 89
- References
- 11
- FWCI
- 2.01
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Universität Heidelberg (-)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Blinding in randomized controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study. https://app.cochat.ai/papers/10.1186/s13643-016-0226-4
- The paper
- Probst, P., Grummich, K., Heger, P., Zaschke, S., Knebel, P., Ulrich, A., Büchler, M. W., & Diener, M. K. (2016). Blinding in randomized controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study. Systematic Reviews. https://doi.org/10.1186/s13643-016-0226-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.