Unreported formal assessment of unblinding occurred in 4 of 10 randomized clinical trials, unreported loss of blinding in 1 of 10 trials
Abstract
Objectives Randomized clinical trials often involve blinding as a methodological procedure to avoid bias. Unfortunately, blinding procedures may be unsuccessful, but the risk of unblinding is rarely reported in trial publications. Our primary aim was to assess the occurrence of unreported assessment of the risk of unblinding in randomized clinical trials and to describe the assessment procedures involved. Our secondary aim was to assess the occurrence of unreported suspected or overt unblinding and the mechanisms of unblinding.Study design and setting A Web-based questionnaire survey of authors to trial publications which did not report risk of unblinding. Respondents were corresponding authors to a random sample of PubMed indexed articles on blinded randomized clinical trials published in 2010. We initially sampled 300 publications of which 24 reported on risk of unblinding.Results Of the 276 contacted trial authors, 129 (47%) responded. Assessment of the risk of unblinding was conducted in 56 trials (43%), often based on a pretrial evaluation involving a group of healthy assessors trying to identify differences between experimental and control interventions. When we included informal assessments of the risk of unblinding, the number of trials assessing the risk of unblinding increased to 75 (58%). Suspected or overt unblinding occurred in 14 trials (11%), mostly based on perceptible differences between experimental and control interventions.Conclusion Approximately 4 of 10 trials assessed risk of unblinding without reporting such assessments in the trial publication, and approximately 1 in 10 trials identified cases of overt or suspected unblinding, also without reporting them. Unblinding is not an exceptional event in randomized clinical trials; it occurs regularly but is rarely reported.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Inadequate matching-distinguishable differences in physical properties of compared interventions-seems to be the main mechanism for unblinding in drug trials.
“Indeed, inadequate matching—that is, distinguishable differences in the physical properties of compared interventions—seems to be the main mechanism for unblinding in drug trials.372”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [372]
Cites
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · see citing works
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251 · see citing works
Response rates to mail surveys published in medical journals
Asch, D. A., Jedrziewski, M. K., & Christakis, N. A. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00126-1 · Cited by 2,110 · see citing works
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · see citing works
Self-citationSavović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049 · see citing works
Brent, D. A., Emslie, G. J., Clarke, G. N., Wagner, K. D., Asarnow, J. R., Keller, M., Vitiello, B., Ritz, L., Iyengar, S., Abebe, K. Z., et al. (2008) · JAMA · doi:10.1001/jama.299.8.901 · Cited by 705 · see citing works
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614 · see citing works
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.120744 · Cited by 527 · see citing works
Self-citationHopewell, S., Dutton, S., Yu, L.-M., Chan, A.-W., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c723 · Cited by 504 · see citing works
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2012) · BMJ · doi:10.1136/bmj.e1119 · Cited by 487 · see citing works
Self-citationEpidemiology and reporting of randomised trials published in PubMed journals
Chan, A.-W., & Altman, D. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71879-1 · Cited by 474 · see citing works
Hróbjartsson, A., Emanuelsson, F., Skou Thomsen, A. S., Hilden, J., & Brorson, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu115 · Cited by 462 · see citing works
Self-citationShipton, D., Tappin, D. M., Vadiveloo, T., Crossley, J. A., Aitken, D. A., & Chalmers, J. W. T. (2009) · BMJ · doi:10.1136/bmj.b4347 · Cited by 380 · see citing works
The Landscape and Lexicon of Blinding in Randomized Trials
Schulz, K. F., Chalmers, I., & Altman, D. G. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-3-200202050-00022 · Cited by 242 · see citing works
Reduction in duration of common colds by zinc gluconate lozenges in a double-blind study
Eby, G. A., Davis, D. R., & Halcomb, W. W. (1984) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.25.1.20 · Cited by 217 · see citing works
Devereaux, P. J., Choi, P. T.-L., El-Dika, S., Bhandari, M., Montori, V. M., Schünemann, H. J., Garg, A. X., Busse, J. W., Heels-Ansdell, D., Ghali, W. A., et al. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.017 · Cited by 209 · see citing works
Hróbjartsson, A., Forfang, E., Haahr, M. T., Als-Nielsen, B. E. T., & Brorson, S. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym020 · Cited by 206 · see citing works
Self-citationIn the dark The reporting of blinding status in randomized controlled trials
Montori, V. M., Bhandari, M., Devereaux, P. J., Manns, B., Ghali, W. A., & Guyatt, G. H. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00446-8 · Cited by 175 · see citing works
Who is blinded in randomized clinical trials? A study of 200 trials and a survey of authors
Haahr, M. T., & Hróbjartsson, A. (2006) · Clinical Trials · doi:10.1177/1740774506069153 · Cited by 152 · see citing works
Self-citationHróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Rasmussen, J. V., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyt270 · Cited by 142 · see citing works
Self-citationDiscrepancy between published report and actual conduct of randomized clinical trials
Hill, C. L., LaValley, M. P., & Felson, D. T. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00440-7 · Cited by 111 · see citing works
Blinding in Randomized Clinical Trials: Imposed Impartiality
Hróbjartsson, A., & Boutron, I. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.207 · Cited by 96 · see citing works
Self-citationTurning a blind eye:Why we don't test for blindness at the end of our trials
Sackett, D. L. (2004) · BMJ · doi:10.1136/bmj.328.7448.1136-a · Cited by 88 · see citing works
The problems of taste in placebo matching: An evaluation of zinc gluconate for the common cold
Farr, B. M., & Gwaltney, J. M. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90187-1 · Cited by 56 · see citing works
Assessment of Double-blindness at the Conclusion of the β-Blocker Heart Attack Trial
Byington, R. P. (1985) · JAMA · doi:10.1001/jama.1985.03350360059018 · Cited by 47 · see citing works
Bello, S., Moustgaard, H., & Hróbjartsson, A. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.05.007 · Cited by 44 · see citing works
Self-citationTurning a blind eye:Testing the success of blinding and the CONSORT statement
Altman, D. G., Schulz, K. F., & Moher, D. (2004) · BMJ · doi:10.1136/bmj.328.7448.1135-a · Cited by 41 · see citing works
Static Magnetic Field Therapy for Carpal Tunnel Syndrome: A Feasibility Study
Colbert, A. P., Markov, M. S., Carlson, N. L., Gregory, W. L., Carlson, H. L., & Elmer, P. J. (2010) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2010.02.013 · Cited by 26 · see citing works
Bello, S., Wei, M., Hilden, J., & Hróbjartsson, A. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0111-9 · Cited by 26 · see citing works
Self-citationFai, C. K., Qi, G. D., Wei, D. A., et al. (2011) · Recent Patents on Inflammation & Allergy Drug Discovery · doi:10.2174/187221311795399237 · Cited by 15 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Assessing risk of bias in a randomized trial
Higgins, J. P., Savović, J., Page, M. J., Elbers, R. G., & Sterne, J. A. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch8 · Cited by 1,765 · see citing works
Moustgaard, H., Clayton, G. L., Jones, H. E., Boutron, I., Jørgensen, L., Laursen, D. R. T., Olsen, M. F., Paludan-Müller, A., Ravaud, P., Savović, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6802 · Cited by 300 · see citing works
Self-citationSPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials
Hróbjartsson, A., Boutron, I., Hopewell, S., Moher, D., Schulz, K. F., Collins, G. S., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081660 · Cited by 171 · see citing works
Self-citationvan der Ende, N. A., Roozenbeek, B., Broderick, J. P., Khatri, P., Lingsma, H. F., & Dippel, D. W. (2023) · International Journal of Stroke · doi:10.1177/17474930221131706 · Cited by 14 · see citing works
- Authors
- Bello, S., Moustgaard, H., & Hróbjartsson, A.
- Affiliations
- University of Ibadan (NG)
- Rigshospitalet (DK)
- University of Southern Denmark (DK)
- Corresponding author
- Bello, Segun
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2017-01
- Volume
- 81
- Pages
- 42-50
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2520689516
- Cited by
- 33
- References
- 30
- Citations by year
- 2025: 5 · 2023: 9 · 2022: 7 · 2021: 4 · 2020: 3 · 2019: 3 · 2018: 1 · 2016: 1
- FWCI
- 1.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Keywords
- unblinding, randomized controlled trials, reporting bias
- MeSH terms
- Humans, Surveys and Questionnaires, Risk, Epidemiologic Research Design, Bias, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
