Do randomized clinical trials with inadequate blinding report enhanced placebo effects for intervention groups and nocebo effects for placebo groups?
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Studies suggest that expectations powerfully shape clinical outcomes. For subjective outcomes in adequately blinded trials, health improvements are substantial and largely explained by non-specific factors.The objective of this study was to investigate if unblinding in randomized controlled trials (RCTs) is associated with enhanced placebo effects for intervention groups and nocebo effects for placebo groups. For these effects, a secondary objective was to explore potential moderating factors. METHODS: We included RCTs that investigated the efficacy of phosphodiesterase-5 (PDE-5) inhibitors for male erectile dysfunction by comparing one PDE-5 inhibitor to placebo. In addition, to be included studies must have reported scores for change from baseline, or baseline and final International Index of Erectile Functioning-Erectile Functioning domain score (IIEF-EF), and be published in either English, French, Dutch, or German.We searched for both published and unpublished relevant trials using PUBMED, EMBASE, the Cochrane Central Register of Controlled Trials, a clinical trials register (clinicaltrials.gov) and the Food and Drug Administration clinical reviews through March 2012.We evaluated the blinding status of trials with the Cochrane Risk of Bias Tool, using the domains of allocation sequence concealment, blinding of participants, healthcare providers and outcome assessors. Across these four domains, studies that scored low risk of bias were judged to be adequately blinded and studies that scored unclear or high risk of bias were judged to be inadequately blinded. RESULTS: We included 110 studies (205 journal publications and 2 unpublished sources) that involved 23,877 participants; 93 (85%), 51 (46%), 93 (85%) and 93 (85%) studies were assessed with an unclear risk of bias for allocation concealment, blinding of participant, blinding of caregiver and blinding of outcome assessor, respectively. None of the studies reported testing of blinding.None of the 205 journal publications provided sufficient details to assess allocation concealment, blinding of participants, caregivers and outcome assessors. After contacting authors for additional information, we judged five studies to be adequately (n = 1,202) and 16 to be inadequately (n = 3,006) blinded. The IIEF-EF score for placebo groups in adequately blinded trials versus inadequately blinded trials was 1.92 points (95% CI, 0.64 to 3.20) versus 1.56 (95% CI, 0.93 to 2.20), respectively. The IIEF-EF score for intervention groups in adequately blinded trials versus inadequately blinded trials was 9.40 (95% CI, 6.96 to 11.83) versus 8.33 (95% CI, 7.29 to 9.37), respectively. In a secondary analysis, prior experience with the drug affected the scores; in placebo groups with participants naïve to the intervention the score was 2.89 (95% CI, 2.33 to 3.45) versus -0.11 (95% CI, -2.06 to 1.84) with participants having prior experience. In the intervention groups, these scores were 7.99 (95% CI, 6.85 to 9.14) versus 8.33 (95% CI, 7.51 to 9.16), respectively.Unblinding lowered placebo scores (creating a nocebo effect) by 19% (0.33 points; 95% CI, -0.96 to 1.62). Unblinding lowered intervention scores by 11% (1.0; 95% CI, -1.35 to 3.47). The results provided no conclusive evidence for nocebo or enhanced placebo effects. Patients taking a PDE-5 inhibitor for the first time experience a larger placebo effect that accounts for 35% of the total effect. CONCLUSIONS: Given the overall poor reporting of blinding in clinical trial reports and the small number of trials that could be rated as adequately or inadequately blinded, we could not draw any robust conclusions about the existence or absence of nocebo and enhanced placebo effects. A large placebo effect was found for patients taking PDE-5 inhibitors for the first time. It was not clear if previous exposure to the drug impacted trial blinding.We found clear evidence that studies assessing a subjective continuous outcome fail to report on measures taken to secure double blinding. Although we observed a trend for the presence of a nocebo effect, there was insufficient evidence to quantify its impact on expectations. RCTs with patients with no prior experience with PDE-5 inhibitors reported larger placebo effects and possibly these studies were better blinded. Future research should further investigate the factors that contribute to blinding and their impact on health outcomes in randomized trials of subjectively assessed conditions. This research is part of a PhD project and has no external funding. The authors have no competing interests to declare.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296
Bingel, U., Wanigasekera, V., Wiech, K., Ni Mhuircheartaigh, R., Lee, M. C., Ploner, M., & Tracey, I. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3001244 · Cited by 810 · cited 1×
“Conversely, negative treatment expectancies interfered with the analgesic potential of the painkiller to the extent that the analgesic effect was completely abolished [3].”
Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740 · cited 1×
“Using data from the systematic review of Turner and colleagues on the completeness of reporting for a random set of RCTs published in medical journals after the CONSORT statement [18], allocation concealment was roughly two times more likely to be reported adequately than in our publications, blinding of participants…”
Savović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668 · cited 1×
“Inadequate concealment of the sequence allocation, blinding of participants and outcome assessor is associated with 15%, 22% and 36% overestimation of treatment effects of subjective outcomes [20].”
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401
Surveillance for ocular hypertension: an evidence synthesis and economic evaluation.
Burr, J., Botello-Pinzon, P., Takwoingi, Y., Hernández, R., Vazquez-Montes, M., Elders, A., Asaoka, R., Banister, K., van der Schoot, J., Fraser, C., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16290 · Cited by 180
Commentary: Measuring the success of blinding in RCTs: don't, must, can't or needn't?
Sackett, D. L. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym088 · Cited by 150
Cited by
The impact of blinding on trial results: A systematic review and meta‐analysis
(2023) · doi:10.1002/cesm.12015 · Cited by 35
Rezende, M., Martins, A. C. R., da Silva, J. A., Reis, A., & de Geus, J. L. (2022) · Clinical Oral Investigations · doi:10.1007/s00784-021-04198-8 · Cited by 12
Compliance of RCTs in endodontic instrumentation with the CONSORT Statement: A systematic review
Cabral, K. A., Martins, A. C. R., Wambier, L. M., Vivacqua-Gomes, N., Rezende, M., Reis, A., & Geus, J. L. D. (2021) · Research, Society and Development · doi:10.33448/rsd-v10i8.17350 · Cited by 2
“When done successfully, it prevents the introduction of information bias (Feys et al. 2014).”
Background
Metadata
- Authors
- Feys, F., Bekkering, G. E., Singh, K., & Devroey, D.
- Venue
- Systematic Reviews
- Published
- 2014-02-21
- Volume
- 3
- Issue
- 1
- Pages
- 14-14
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2116192092
- Cited by
- 51
- References
- 8
- FWCI
- 1.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do randomized clinical trials with inadequate blinding report enhanced placebo effects for intervention groups and nocebo effects for placebo groups? https://app.cochat.ai/papers/10.1186/2046-4053-3-14
- The paper
- Feys, F., Bekkering, G. E., Singh, K., & Devroey, D. (2014). Do randomized clinical trials with inadequate blinding report enhanced placebo effects for intervention groups and nocebo effects for placebo groups? Systematic Reviews. https://doi.org/10.1186/2046-4053-3-14
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.