The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Reporting Methods of Blinding in Randomized Trials Assessing Nonpharmacological Treatments
Open accessAbstract
BACKGROUND: Blinding is a cornerstone of treatment evaluation. Blinding is more difficult to obtain in trials assessing nonpharmacological treatment and frequently relies on "creative" (nonstandard) methods. The purpose of this study was to systematically describe the strategies used to obtain blinding in a sample of randomized controlled trials of nonpharmacological treatment. METHODS AND FINDINGS: We systematically searched in Medline and the Cochrane Methodology Register for randomized controlled trials (RCTs) assessing nonpharmacological treatment with blinding, published during 2004 in high-impact-factor journals. Data were extracted using a standardized extraction form. We identified 145 articles, with the method of blinding described in 123 of the reports. Methods of blinding of participants and/or health care providers and/or other caregivers concerned mainly use of sham procedures such as simulation of surgical procedures, similar attention-control interventions, or a placebo with a different mode of administration for rehabilitation or psychotherapy. Trials assessing devices reported various placebo interventions such as use of sham prosthesis, identical apparatus (e.g., identical but inactivated machine or use of activated machine with a barrier to block the treatment), or simulation of using a device. Blinding participants to the study hypothesis was also an important method of blinding. The methods reported for blinding outcome assessors relied mainly on centralized assessment of paraclinical examinations, clinical examinations (i.e., use of video, audiotape, photography), or adjudications of clinical events. CONCLUSIONS: This study classifies blinding methods and provides a detailed description of methods that could overcome some barriers of blinding in clinical trials assessing nonpharmacological treatment, and provides information for readers assessing the quality of results of such trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In manual therapy, blinding is an issue, as patients tend to be aware of the manual treatment and therapists cannot be blinded to the treatment intervention they deliver.37”
From Efficacy and safety of osteopathic manipulative treatment: an overview of systematic reviews (2022) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The most common method reported was avoiding unblinding by participants through asking them not to discuss their treatment, a method frequently reported in the existing literature [5, 14, 18, 23].”
From Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review (2026) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“In particular, only one study (Epton et al., 2014) evidently concealed group allocation and, as is often the case in non-pharmacological trials (Boutron et al., 2007), none clearly ensured blinding of participants.”
From The effect of e-mental health interventions on academic performance in university and college students: A meta-analysis of randomized controlled trials (2020) · cites this paper as Boutron et al., 2007
The cited source says what the claim attributes to it.
In the citing paper
“methods have been proposed to mitigate these issues in trial design and quality assessment (Boutron et al., 2007”
From Systematic review and meta-analysis of interventions for depression and anxiety in persons with multiple sclerosis (2016) · cites this paper as Boutron et al., 2007
In the citing paper
“it is difficult to use a doubleblind design for patients in trials of psychotherapy”
In the citing paper
“which would affect the transitivity of the whole network and restricts the interpretation of these results.15”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationMoher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Self-citationAssessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 1×
“Empirical evidence has demonstrated that lack of reporting of double blinding is responsible for biased treatment estimates [1,2,11–13].”
BackgroundTransplantation of Embryonic Dopamine Neurons for Severe Parkinson's Disease
Freed, C. R., Greene, P. E., Breeze, R. E., Tsai, W.-Y., DuMouchel, W., Kao, R., Dillon, S., Winfield, H., Culver, S., Trojanowski, J. Q., et al. (2001) · New England Journal of Medicine · doi:10.1056/nejm200103083441002 · Cited by 2,366
Psychometric properties of the credibility/expectancy questionnaire
Devilly, G. J., & Borkovec, T. D. (2000) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(00)00012-4 · Cited by 2,295 · cited 1×
“, use of validated credibility scales [43,44]), participants’ expectations (i.”
BackgroundGluud, L. L., Villumsen, J., & Gluud, C. N. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,266
A Controlled Trial of Arthroscopic Surgery for Osteoarthritis of the Knee
Moseley, J. B., O’Malley, K. J., Petersen, N. J., Menke, T. J., Brody, B. A., Kuykendall, D. H., Hollingsworth, J. C., Ashton, C. M., & Wray, N. P. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa013259 · Cited by 2,146
Hróbjartsson, A., & Gøtzsche, P. C. (2001) · New England Journal of Medicine · doi:10.1056/nejm200105243442106 · Cited by 1,504
Self-citationA CONTROLLED TRIAL OF ARTHROSCOPIC SURGERY FOR OSTEOARTHRITIS OF THE KNEE
Ruce, J. B., Imberly, K., Etersen, A. J. P., Enke, T. E. J. M., Rody, A., Uykendall, D. A. H. K., Ohn, J., Shton, C. A. M. A., & Ray, E. P. W. (2002) · Cited by 1,087
Randomised trials in surgery: problems and possible solutions
McCulloch, P. G., Taylor, I., Sasako, M., Lovett, B., & Griffin, D. (2002) · BMJ · doi:10.1136/bmj.324.7351.1448 · Cited by 761
Bias in clinical intervention research.
Gluud, L. L. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj069 · Cited by 636
Edinger, J. D., Wohlgemuth, W. K., Radtke, R. A., Marsh, G. R., & Quillian, R. E. (2001) · JAMA · doi:10.1001/jama.285.14.1856 · Cited by 625 · cited 1×
“Once all participants completed treatment, the investigative team debriefed the therapists about the study hypotheses and placebo treatment [34].”
BackgroundCharacteristic and incidental (placebo) effects in complex interventions such as acupuncture
Paterson, C., & Dieppe, P. A. (2005) · BMJ · doi:10.1136/bmj.330.7501.1202 · Cited by 478
Need for expertise based randomised controlled trials
Devereaux, P. J., Bhandari, M., Clarke, M., Montori, V. M., Cook, D. J., Yusuf, S., Sackett, D. L., Cinà, C. S., Walter, S. D., Haynes, B., et al. (2005) · BMJ · doi:10.1136/bmj.330.7482.88 · Cited by 427
Splinting vs Surgery in the Treatment of Carpal Tunnel Syndrome
Gerritsen, A. A. M., de Vet, H. C. W., Scholten, R. J. P. M., Bertelsmann, F. W., de Krom, M. C. T. F. M., & Bouter, L. M. (2002) · JAMA · doi:10.1001/jama.288.10.1245 · Cited by 396
Baker, K., Nelson, M. E., Felson, D. T., Layne, J. E., Sarno, R., & Roubenoff, R. (2001) · PubMed · Cited by 345
Noseworthy, J. H., Ebers, G. C., Vandervoort, M. K., Farquhar, R. E., Yetisir, E., & Roberts, R. (1994) · Neurology · doi:10.1212/wnl.44.1.16 · Cited by 342
BOUTRON, I., MOHER, D., TUGWELL, P., GIRAUDEAU, B., POIRAUDEAU, S., NIZARD, R., & RAVAUD, P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.05.004 · Cited by 308
Self-citationAnalgesic effect of breast feeding in term neonates: randomised controlled trial
Carbajal, R., Veerapen, S., Couderc, S., Jugie, M., & Ville, Y. G. (2003) · BMJ · doi:10.1136/bmj.326.7379.13 · Cited by 306
Boutron, I., Tubach, F., Giraudeau, B., & Ravaud, P. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.010 · Cited by 300
Self-citationAssociation of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284
Fergusson, D. (2004) · BMJ · doi:10.1136/bmj.37952.631667.ee · Cited by 264
Devereaux, P. J. (2001) · JAMA · doi:10.1001/jama.285.15.2000 · Cited by 258
The Landscape and Lexicon of Blinding in Randomized Trials
Schulz, K. F., Chalmers, I., & Altman, D. G. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-3-200202050-00022 · Cited by 247
Bhandari, M., Richards, R. R., Sprague, S., & Schemitsch, E. H. (2002) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200203000-00009 · Cited by 242
Pildal, J., Chan, A.-W., Hróbjartsson, A., Forfang, E., Altman, D. G., & Gøtzsche, P. C. (2005) · BMJ · doi:10.1136/bmj.38414.422650.8f · Cited by 209
Self-citationIn the dark The reporting of blinding status in randomized controlled trials
Montori, V. M., Bhandari, M., Devereaux, P. J., Manns, B., Ghali, W. A., & Guyatt, G. H. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00446-8 · Cited by 175
Balon, J., Aker, P. D., Crowther, E. R., Danielson, C. D., Cox, G., O’Shaughnessy, D., Walker, C., Goldsmith, C. H., Duku, E., & Sears, M. R. (1998) · New England Journal of Medicine · doi:10.1056/nejm199810083391501 · Cited by 173
What are the main methodological problems in the estimation of placebo effects?
Hróbjartsson, A. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00496-6 · Cited by 171
Self-citationBoutron, I., Estellat, C., Guittet, L., Dechartres, A., Sackett, D. L., Hróbjartsson, A., & Ravaud, P. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030425 · Cited by 168
Self-citationSchulz, K. F., Grimes, D. A., Altman, D. G., & Hayes, R. J. (1996) · BMJ · doi:10.1136/bmj.312.7033.742 · Cited by 163
Boutron, I. (2003) · JAMA · doi:10.1001/jama.290.8.1062 · Cited by 155
Self-citationUnderstanding controlled trials: What is Zelen's design?
Torgerson, D. J., & Roland, M. O. (1998) · BMJ · doi:10.1136/bmj.316.7131.606 · Cited by 141
Jacquier, I., Boutron, I., Moher, D., Roy, C., & Ravaud, P. (2006) · Annals of Surgery · doi:10.1097/01.sla.0000242707.44007.80 · Cited by 136
Self-citationLilford, R., Braunholtz, D., Harris, J., & Gill, T. (2004) · British Journal of Surgery · doi:10.1002/bjs.4418 · Cited by 131
Quilty, B., Tucker, M., Campbell, R. M., & Dieppe, P. A. (2003) · PubMed · Cited by 113
Are Randomized Controlled Trials Controlled? Patient Preferences and Unblind Trials
McPherson, K., Britton, A. R., & Wennberg, J. E. (1997) · Journal of the Royal Society of Medicine · doi:10.1177/014107689709001205 · Cited by 98
A review of blinding in randomized controlled trials found results inconsistent and questionable
Boutron, I., Estellat, C., & Ravaud, P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.04.006 · Cited by 92
Self-citationTurning a blind eye:Why we don't test for blindness at the end of our trials
Sackett, D. L. (2004) · BMJ · doi:10.1136/bmj.328.7448.1136-a · Cited by 88
Wolsko, P. M., Eisenberg, D. M., Simon, L. S., Davis, R. B., Walleczek, J., Mayo‐Smith, M. F., Kaptchuk, T. J., & Phillips, R. S. (2004) · PubMed · Cited by 87
Bishop, F. L., Yardley, L., & Lewith, G. T. (2005) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2005.01.005 · Cited by 82
Parental Auricular Acupuncture as an Adjunct for Parental Presence during Induction of Anesthesia
Wang, S., Maranets, I., Weinberg, M. E., Caldwell-Andrews, A. A., & Kain, Z. N. (2004) · Anesthesiology · doi:10.1097/00000542-200406000-00011 · Cited by 82
Evaluating preference effects in partially unblinded, randomized clinical trials
Halpern, S. D. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00598-x · Cited by 59
Ethgen, M., Boutron, I., Baron, G., Giraudeau, B., Sibilia, J., & Ravaud, P. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-143-1-200507050-00006 · Cited by 49
Self-citationTurning a blind eye:Testing the success of blinding and the CONSORT statement
Altman, D. G., Schulz, K. F., & Moher, D. (2004) · BMJ · doi:10.1136/bmj.328.7448.1135-a · Cited by 41
Self-citationIncorporating patient preferences into clinical trials
McPherson, K., & Chalmers, I. (1998) · BMJ · doi:10.1136/bmj.317.7150.78 · Cited by 35
Preferences and understanding their effects on health.
McPherson, K., & Britton, A. R. (2001) · PubMed · doi:10.1136/qhc.0100061 · Cited by 33
Turning a blind eye: Authors have blinkered view of blinding
Senn, S. J. (2004) · BMJ · doi:10.1136/bmj.328.7448.1135-b · Cited by 24
Methodologic Issues in Randomized Controlled Trials of Surgical Interventions
Devereaux, P. J., McKee, M. D., & Yusuf, S. (2003) · Clinical Orthopaedics and Related Research · doi:10.1097/01.blo.0000080539.81794.54 · Cited by 23
Patients' evaluation of informed consent to postponed information: cohort study
Boter, H., van Delden, J. J. M., de Haan, R. J., & Rinkel, G. J. E. (2004) · BMJ · doi:10.1136/bmj.38041.636250.ee · Cited by 21
Zelen, M. (1992) · The Lancet · doi:10.1016/0140-6736(92)91454-g · Cited by 15
The impact of patient treatment preferences on the interpretation of randomised controlled trials
McPherson, K., & Britton, A. R. (1999) · European Journal of Cancer · doi:10.1016/s0959-8049(99)00196-3 · Cited by 14
The validity and ethics of giving placebo in a randomized nonpharmacologic trial was evaluated
Spigt, M., Knipschild, P. G., van Schayck, O. C. P., & Knottnerus, J. A. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.08.009 · Cited by 13
Patient Preference and Validity of Randomized Controlled Trials
Torgerson, D. J., & Moffett, J. K. (2005) · JAMA · doi:10.1001/jama.294.1.41-b · Cited by 7
Research works printed but not linked: 55
- Gluud, 2006, Am J Epidemiol, 163, 493
- Schulz, 1995, JAMA, 273, 408
- Schulz, 2002, Ann Intern Med, 136, 254
- Schulz, 1996, BMJ, 312, 742
- Devereaux, 2001, JAMA, 285, 2000
- Montori, 2002, J Clin Epidemiol, 55, 787
- Hrobjartsson, 2002, J Clin Epidemiol, 55, 430
- Hrobjartsson, 2001, N Engl J Med, 344, 1594
- Noseworthy, 1994, Neurology, 44, 16
- Altman, 2001, Ann Intern Med, 134, 663
- Moher, 1998, Lancet, 352, 609
- Juni, 2001, BMJ, 323, 42
- Kjaergard, 2001, Ann Intern Med, 135, 982
- Fergusson, 2004, BMJ, 328, 432
- Sackett, 2004, BMJ, 328, 1136
- Boutron, 2005, J Clin Epidemiol, 58, 1220
- Hrobjartsson, 2004, 12th Cochrane Colloquium: Bridging the Gaps, 138
- Boutron, 2004, J Clin Epidemiol, 57, 543
- Boutron, 2003, JAMA, 290, 1062
- McCulloch, 2002, BMJ, 324, 1448
- Lilford, 2004, Br J Surg, 91, 6
- Devereaux, 2005, BMJ, 330, 88
- Bhandari, 2002, J Bone Joint Surg Am, 84-A, 388
- Jacquier, 2006, Ann Surg, 244, 677
- Ethgen, 2005, Ann Intern Med, 143, 20
- Lee, 2002, JAMA, 287, 2805
- Freed, 2001, N Engl J Med, 344, 710
- Balon, 1998, N Engl J Med, 339, 1013
- Baker, 2001, J Rheumatol, 28, 1655
- Wolsko, 2004, Altern Ther Health Med, 10, 36
- Quilty, 2003, J Rheumatol, 30, 1311
- Edinger, 2001, JAMA, 285, 1856
- Wang, 2004, Anesthesiology, 100, 1399
- Carbajal, 2003, BMJ, 326, 13
- Boutron, 2005, J Clin Epidemiol, 58, 1233
- Paterson, 2005, BMJ, 330, 1202
- Moseley, 2002, N Engl J Med, 347, 81
- Spigt, 2005, J Clin Epidemiol, 58, 350
- Zelen, 1992, Lancet, 340, 375
- Boter, 2004, BMJ, 329, 86
- Bishop, 2005, Complement Ther Med, 13, 144
- Devilly, 2000, J Behav Ther Exp Psychiatry, 31, 73
- Torgerson, 2005, JAMA, 294, 41
- Torgerson, 1998, BMJ, 316, 606
- McPherson, 1999, Eur J Cancer, 35, 1598
- McPherson, 2001, Qual Health Care 10 Suppl, 1, i61
- McPherson, 1997, J R Soc Med, 90, 652
- McPherson, 1998, BMJ, 317
- Halpern, 2003, J Clin Epidemiol, 56, 109
- Wood, 2006, 14th Cochrane Colloquium:Bridging the Gaps
- Gerritsen, 2002, JAMA, 288, 1245
- Altman, 2004, BMJ, 328, 1135
- Sackett, 1986, Clin Res, 34, 711A
- Senn, 2004, BMJ, 328, 1135
- Pildal, 2005, BMJ, 330, 1049
Cited by
Sorted by citations
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Self-citationBoutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Self-citationBoutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538
Self-citationSmith, M., Hosking, J., Woodward, A. J., Witten, K., Macmillan, A. K., Field, A., Baas, P. H., & Mackie, H. W. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0613-9 · Cited by 955
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842
Self-citation
Metadata
- Authors
- Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P.
- Affiliations
- Inserm (FR)
- University of Ottawa (CA)
- Rigshospitalet (DK)
- Corresponding author
- Boutron, Isabelle
- ORCID
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-02-20
- Volume
- 4
- Issue
- 2
- Pages
- e61
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC1800311
- OpenAlex
- W2118789584
- Cited by
- 389
- References
- 55
- Citations by year
- 2026: 34 · 2025: 27 · 2024: 14 · 2023: 21 · 2022: 20 · 2021: 27 · 2020: 27 · 2019: 24 · 2018: 36 · 2017: 17 · 2016: 16 · 2015: 24 · 2014: 20 · 2013: 20 · 2012: 18
- FWCI
- 10.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HAL (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- University of Ottawa
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
- Keywords
- blinding, randomization, non-pharmacological treatment, sham procedure, placebo, rehabilitation, psychotherapy, trial reporting quality
- MeSH terms
- Double-Blind Method, Humans, Research Design, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review