Cited by 135Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsPsychotherapy Techniques and Applications

The DOI matches its Crossref record; 111 of the 113 references it cites were found in a registry or an index.

Blinding in randomised clinical trials of psychological interventions: a retrospective study of published trial reports

Juul, Sophie, Gluud, Christian, Simonsen, Sebastian, Frandsen, Frederik Weischer, Kirsch, Irving, Jakobsen, Janus Christian·2021·BMJ Evidence-Based Medicine

DOI 10.1136/bmjebm-2020-111407

Open this paper in CoChat — free account

Abstract

Objectives: To study the extent of blinding in randomised clinical trials of psychological interventions and the interpretative considerations if randomised clinical trials are not blinded. Design: Retrospective study of trial reports published in six high impact factor journals within the field of psychiatry in 2017 and 2018. Setting: Trial reports published in World Psychiatry , JAMA Psychiatry , Lancet Psychiatry , American Journal of Psychiatry , British Journal of Psychiatry , or Psychotherapy and Psychosomatics . Main outcome measures: Blinding status of participants, treatment providers, outcome assessors, data managers, the data safety and monitoring committee, statisticians and conclusion makers, if trialists rejected the null hypothesis on the primary outcome measure, and if trialists discussed the potential bias risk from lack of blinding in the published trial report. Results: 63 randomised clinical trials of psychological interventions were identified. None (0%; 95% CI 0% to 5.75%) of the trials reported blinding of all possible key persons. 37 (58.7%; 95% CI 46.42% to 70.04%) trials reported blinding of outcome assessors. Two (3.2%; 95% CI 0.87% to 10.86%) trials reported blinding of participants. Two (3.2%; 95% CI 0.87% to 10.86%) trials reported blinding of data managers. Three (4.8%; 95% CI 1.63% to 13.09%) trials reported blinding of statisticians. None of the trials reported blinding of treatment providers, the data safety and monitoring committee, and conclusion makers. 45 (71.4%; 95% CI 59.30% to 81.10%) trials rejected the null hypothesis on the primary outcome(s). 13 (20.7%; 95% CI 12.48% to 32.17%) trials discussed the potential bias risk from lack of blinding in the published trial report. Conclusions: Blinding of key persons involved in randomised clinical trials of psychological interventions is rarely sufficiently documented. The possible interpretative limitations are only rarely considered. There is a need of randomised clinical trials of psychological interventions with documented blinding attempts of all possible key persons.

Integrity signals

Registry

Crossref · 10.1136/bmjebm-2020-111407

Cites

111 of 111 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Untitled work
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Probable Inference, the Law of Succession, and Statistical Inference
Wilson, E. B. (1927) · Journal of the American Statistical Association · doi:10.1080/01621459.1927.10502953 · Cited by 4,476
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824
Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Self-citation
Reported Methodologic Quality and Discrepancies between Large and Small Randomized Trials in Meta-Analyses
Gluud, L. L., Villumsen, J., & Gluud, C. N. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,266
Self-citation
Hydroxyethyl Starch 130/0.42 versus Ringer's Acetate in Severe Sepsis
Perner, A., Haase, N., Guttormsen, A. B., Tenhunen, J. J., Klemenzson, G., Åneman, A., Madsen, K. R., Møller, M. H., Elkjær, J. M., Poulsen, L. M., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1204242 · Cited by 1,808
Response expectancy as a determinant of experience and behavior.
Kirsch, I. (1985) · American Psychologist · doi:10.1037/0003-066x.40.11.1189 · Cited by 1,014
Self-citation
Blinding in randomised trials: hiding who got what
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07816-9 · Cited by 952
The Unified Protocol for Transdiagnostic Treatment of Emotional Disorders Compared With Diagnosis-Specific Protocols for Anxiety Disorders: A Randomized Clinical Trial
Barlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W., Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Conklin, L. R., Boswell, J. F., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2164 · Cited by 853
The effects of improving sleep on mental health (OASIS): a randomised controlled trial with mediation analysis
Freeman, D., Sheaves, B., Goodwin, G. M., Yu, L.-M., Nickless, A., Harrison, P. J., Emsley, R., Luik, A. I., Foster, R. G., Wadekar, V., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30328-0 · Cited by 652
Bias in clinical intervention research.
Gluud, L. L. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj069 · Cited by 636
Efficacy of Dialectical Behavior Therapy for Adolescents at High Risk for Suicide: A Randomized Clinical Trial
McCauley, E., Berk, M. S., Asarnow, J. R., Adrian, M., Cohen, J., Korslund, K., Avina, C., Hughes, J., Harned, M., Gallop, R., et al. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.1109 · Cited by 531
Observer bias in randomized clinical trials with measurement scale outcomes: a systematic review of trials with both blinded and nonblinded assessors
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.120744 · Cited by 527
Observer bias in randomised clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2012) · BMJ · doi:10.1136/bmj.e1119 · Cited by 505
Correlation of Quality Measures With Estimates of Treatment Effect in Meta-analyses of Randomized Controlled Trials
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478
Bias due to lack of patient blinding in clinical trials. A systematic review of trials randomizing patients to blind and nonblind sub-studies
Hróbjartsson, A., Emanuelsson, F., Skou Thomsen, A. S., Hilden, J., & Brorson, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu115 · Cited by 462
AVATAR therapy for auditory verbal hallucinations in people with psychosis: a single-blind, randomised controlled trial
Craig, T. K., Rus-Calafell, M., Ward, T., Leff, J. P., Huckvale, M., Howarth, E., Emsley, R., & Garety, P. A. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30427-3 · Cited by 403
Reporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389
Association between risk-of-bias assessments and results of randomized trials in Cochrane reviews: The ROBES meta-epidemiologic study
Savović, J., Turner, R. M., Mawdsley, D., Jones, H. E., Beynon, R., Higgins, J. P. T., & Sterne, J. A. C. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwx344 · Cited by 382
Automated psychological therapy using immersive virtual reality for treatment of fear of heights: A single-blind, parallel-group, randomised controlled trial
Freeman, D., Haselton, P., Freeman, J., Spanlang, B., Kishore, S., Albery, E., Denne, M., Brown, P., Slater, M., & Nickless, A. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30226-8 · Cited by 377
Virtual reality compared with in vivo exposure in the treatment of social anxiety disorder: A three-arm randomised controlled trial
Bouchard, S., Dumoulin, S., Robillard, G., Guitard, T., Klinger, É., Forget, H., Loranger, C., & Roucaut, F. X. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.184234 · Cited by 354
Practical tips for surgical research: blinding: who, what, when, why, how?
Karanicolas, P. J., Farrokhyar, F., & Bhandari, M. (2010) · PubMed Central · Cited by 346
Effect of Group vs Individual Cognitive Processing Therapy in Active-Duty Military Seeking Treatment for Posttraumatic Stress Disorder
Resick, P. A., Wachen, J. S., Dondanville, K. A., Pruiksma, K. E., Yarvis, J. S., Peterson, A. L., Mintz, J., Borah, E. V., Brundige, A. R., Hembree, E. A., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.2729 · Cited by 327
Effect of a Web-Based Cognitive Behavior Therapy for Insomnia Intervention With 1-Year Follow-up: A Randomized Clinical Trial
Ritterband, L. M., Thorndike, F. P., Ingersoll, K. S., Lord, H. R., Gonder-Frederick, L., Frederick, C., Quigg, M. S., Cohn, W. F., & Morin, C. M. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.3249 · Cited by 325
Impact of blinding on estimated treatment effects in randomised clinical trials: meta-epidemiological study
Moustgaard, H., Clayton, G. L., Jones, H. E., Boutron, I., Jørgensen, L., Laursen, D. R. T., Olsen, M. F., Paludan-Müller, A., Ravaud, P., Savović, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6802 · Cited by 300
Turning a blind eye: the success of blinding reported in a random sample of randomised, placebo controlled trials
Fergusson, D. (2004) · BMJ · doi:10.1136/bmj.37952.631667.ee · Cited by 264
Response expectancy theory and application: A decennial review
Kirsch, I. (1997) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(05)80012-5 · Cited by 262
Self-citation
Cognitive behavioural therapy and short-term psychoanalytical psychotherapy versus a brief psychosocial intervention in adolescents with unipolar major depressive disorder (IMPACT): a multicentre, pragmatic, observer-blind, randomised controlled superiority trial
Goodyer, I. M., Reynolds, S., Barrett, B., Byford, S., Dubicka, B., Hill, J., Holland, F., Kelvin, R., Midgley, N., Roberts, C., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30378-9 · Cited by 259
The Landscape and Lexicon of Blinding in Randomized Trials
Schulz, K. F., Chalmers, I., & Altman, D. G. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-3-200202050-00022 · Cited by 247
Virtual-reality-based cognitive behavioural therapy versus waiting list control for paranoid ideation and social avoidance in patients with psychotic disorders: a single-blind randomised controlled trial.
Pot-Kolder, R. M. C. A., Geraets, C. N. W., Veling, W., van Beilen, M., Staring, A. B. P., Gijsman, H. J., Delespaul, P. A. E. G., & van der Gaag, M. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30053-1 · Cited by 239
A brief exposure-based treatment vs cognitive processing therapy for posttraumatic stress disorder: a randomized noninferiority clinical trial
Sloan, D. M., Marx, B. P., Lee, D. J., & Resick, P. A. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.4249 · Cited by 232
An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods
Devereaux, P. J., Choi, P. T.-L., El-Dika, S., Bhandari, M., Montori, V. M., Schünemann, H. J., Garg, A. X., Busse, J. W., Heels-Ansdell, D., Ghali, W. A., et al. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.017 · Cited by 209
In the dark The reporting of blinding status in randomized controlled trials
Montori, V. M., Bhandari, M., Devereaux, P. J., Manns, B., Ghali, W. A., & Guyatt, G. H. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00446-8 · Cited by 175
Methods of Blinding in Reports of Randomized Controlled Trials Assessing Pharmacologic Treatments: A Systematic Review
Boutron, I., Estellat, C., Guittet, L., Dechartres, A., Sackett, D. L., Hróbjartsson, A., & Ravaud, P. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030425 · Cited by 168
CONSORT 2010 changes and testing blindness in RCTs
Schulz, K. F., Altman, D. G., Moher, D., & Fergusson, D. A. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60413-8 · Cited by 154
Neurofeedback, sham neurofeedback, and cognitive-behavioural group therapy in adults with attention-deficit hyperactivity disorder: a triple-blind, randomised, controlled trial
Schönenberg, M., Wiedemann, E., Schneidt, A., Scheeff, J., Logemann, H. N. A., Keune, P. M., & Hautzinger, M. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30291-2 · Cited by 154
Effect of Internet-Based Guided Self-help vs Individual Face-to-Face Treatment on Full or Subsyndromal Binge Eating Disorder in Overweight or Obese Patients: The INTERBED Randomized Clinical Trial
de Zwaan, M., Herpertz, S., Zipfel, S., Svaldi, J., Friederich, H.-C., Schmidt, F., Mayr, A., Lam, T., Schade-Brittinger, C., & Hilbert, A. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2150 · Cited by 153
A Randomized Controlled Trial of Parent-Child Psychotherapy Targeting Emotion Development for Early Childhood Depression
Luby, J. L., Barch, D. M., Whalen, D. J., Tillman, R., & Freedland, K. E. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.18030321 · Cited by 153
Who is blinded in randomized clinical trials? A study of 200 trials and a survey of authors
Haahr, M. T., & Hróbjartsson, A. (2006) · Clinical Trials · doi:10.1177/1740774506069153 · Cited by 152
Feedback-informed treatment versus usual psychological treatment for depression and anxiety: a multisite, open-label, cluster randomised controlled trial
Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., Nevin, J., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30162-7 · Cited by 152
Commentary: Measuring the success of blinding in RCTs: don't, must, can't or needn't?
Sackett, D. L. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym088 · Cited by 150
Blinded interpretation of study results can feasibly and effectively diminish interpretation bias
Järvinen, T. L. N., Sihvonen, R., Bhandari, M., Sprague, S., Malmivaara, A. O. V., Paavola, M. P., Schünemann, H. J., & Guyatt, G. H. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.011 · Cited by 149
Mitigating the effect of persistent postnatal depression on child outcomes through an intervention to treat depression and improve parenting: a randomised controlled trial
Stein, A., Netsi, E., Lawrence, P. J., Granger, C., Kempton, C., Craske, M. G., Nickless, A., Mollison, J., Stewart, D. A., Rapa, E., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30006-3 · Cited by 148
Effect of Combination of Paracetamol (Acetaminophen) and Ibuprofen vs Either Alone on Patient-Controlled Morphine Consumption in the First 24 Hours After Total Hip Arthroplasty: The PANSAID Randomized Clinical Trial
Thybo, K. H., Hägi-Pedersen, D., Dahl, J. B., Wetterslev, J., Nersesjan, M., Jakobsen, J. C., Pedersen, N. A., Overgaard, S., Schrøder, H. M., Schmidt, H., et al. (2019) · JAMA · doi:10.1001/jama.2018.22039 · Cited by 142
Self-citation
Effect of Disorder-Specific vs Nonspecific Psychotherapy for Chronic Depression
Schramm, E., Kriston, L., Zobel, I., Bailer, J., Wambach, K., Backenstraß, M., Klein, J. P., Schoepf, D., Schnell, K., Gumz, A., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.3880 · Cited by 140
Brief Behavioral Therapy for Pediatric Anxiety and Depression in Primary Care: A Randomized Clinical Trial
Weersing, V. R., Brent, D. A., Rozenman, M. S., Gonzalez, A., Jeffreys, M., Dickerson, J. F., Lynch, F. L., Porta, G., & Iyengar, S. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0429 · Cited by 139
Randomized Clinical Trial of Computerized and Clinician-Delivered CBT in Comparison With Standard Outpatient Treatment for Substance Use Disorders: Primary Within-Treatment and Follow-Up Outcomes
Kiluk, B. D., Nich, C., Buck, M. B., Devore, K. A., Frankforter, T. L., LaPaglia, D. M., Muvvala, S. B., & Carroll, K. M. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17090978 · Cited by 138
Towards a proposal for assessment of blinding success in clinical trials: up-to-date review
Kolahi, J., Bang, H., & Park, J. (2009) · Community Dentistry and Oral Epidemiology · doi:10.1111/j.1600-0528.2009.00494.x · Cited by 137
How “blind” are double-blind studies?
Margraf, J., Ehlers, A., Roth, W. T., Clark, D. B., Sheikh, J., Agras, W. S., & Taylor, C. B. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.184 · Cited by 135
Improving the Efficiency of Psychotherapy for Depression: Computer-Assisted Versus Standard CBT
Thase, M. E., Wright, J. H., Eells, T. D., Barrett, M. S., Wisniewski, S. R., Balasubramani, G. K., McCrone, P., & Brown, G. K. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.17010089 · Cited by 131
Effectiveness of preventive cognitive therapy while tapering antidepressants versus maintenance antidepressant treatment versus their combination in prevention of depressive relapse or recurrence (DRD study): a three-group, multicentre, randomised controlled trial
Bockting, C. L. H., Klein, N. S., Elgersma, H. J., van Rijsbergen, G. D., Slofstra, C., Ormel, J., Buskens, E., Dekker, J., de Jong, P. J., Nolen, W. A., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30100-7 · Cited by 130
Internet-based behavioural activation with lay counsellor support versus online minimal psychoeducation without support for treatment of depression: a randomised controlled trial in Indonesia
Arjadi, R., Nauta, M. H., Scholte, W. F., Hollon, S. D., Chowdhary, N., Suryani, A. O., Uiterwaal, C. S. P. M., & Bockting, C. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30223-2 · Cited by 128
Clinical outcomes and cost-effectiveness of brief guided parent-delivered cognitive behavioural therapy and solution-focused brief therapy for treatment of childhood anxiety disorders: a randomised controlled trial
Creswell, C., Violato, M., Fairbanks, H., White, E., Parkinson, M., Abitabile, G., Leidi, A., & Cooper, P. J. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30149-9 · Cited by 126
Gaze-contingent music reward therapy for social anxiety disorder: a randomized controlled trial
Lazarov, A., Pine, D. S., & Bar-Haim, Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16080894 · Cited by 125
Cognitive behavioural therapy in clozapine-resistant schizophrenia (FOCUS): an assessor-blinded, randomised controlled trial
Morrison, A. P., Pyle, M., Gumley, A. I., Schwannauer, M., Turkington, D., MacLennan, G., Norrie, J. D., Hudson, J., Bowe, S. E., French, P., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30184-6 · Cited by 124
Evidence-based recommendations for blinding in surgical trials
Probst, P., Zaschke, S., Heger, P., Harnoss, J. C., Hüttner, F. J., Mihaljević, A. L., Knebel, P., & Diener, M. K. (2019) · Langenbeck s Archives of Surgery · doi:10.1007/s00423-019-01761-6 · Cited by 124
Blinding during data analysis and writing of manuscripts
Gøtzsche, P. C. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00263-4 · Cited by 123
Blinding: Who, what, when, why, how?
Karanicolas, P. J., Farrokhyar, F., & Bhandari, M. (2010) · Europe PMC (PubMed Central) · Cited by 122
Effectiveness of Online Collaborative Care for Treating Mood and Anxiety Disorders in Primary Care
Rollman, B. L., Belnap, B. H., Abebe, K. Z., Spring, M. B., Rotondi, A. J., Rothenberger, S. D., & Karp, J. F. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.3379 · Cited by 118
Telephone-supported computerised cognitive–behavioural therapy: REEACT-2 large-scale pragmatic randomised controlled trial
Gilbody, S., Brabyn, S., Lovell, K., Kessler, D., Devlin, T., Smith, L., Araya, R., Barkham, M., Bower, P., Cooper, C., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.192435 · Cited by 116
Effectiveness of systemic family therapy versus treatment as usual for young people after self-harm: a pragmatic, phase 3, multicentre, randomised controlled trial
Cottrell, D. J., Wright-Hughes, A., Collinson, M., Boston, P., Eisler, I., Fortune, S., Graham, E. H., Green, J., House, A. O., Kerfoot, M., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30058-0 · Cited by 109
Non-trauma-focused meditation versus exposure therapy in veterans with post-traumatic stress disorder: a randomised controlled trial
Nidich, S. I., Mills, P. J., Rainforth, M. V., Heppner, P. S., Schneider, R. H., Rosenthal, N. E., Salerno, J. W., Gaylord‐King, C., & Rutledge, T. R. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30384-5 · Cited by 109
Online Self-Help as an Add-On to Inpatient Psychotherapy: Efficacy of a New Blended Treatment Approach
Zwerenz, R., Becker, J., Knickenberg, R. J., Siepmann, M., Hagen, K., & Beutel, M. E. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000481177 · Cited by 108
Concurrent treatment with prolonged exposure for co-occurring full or subthreshold posttraumatic stress disorder and substance use disorders: a randomized clinical trial
Ruglass, L. M., Lopez-Castro, T., Papini, S., Killeen, T., Back, S. E., & Hien, D. A. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000462977 · Cited by 105
Acceptance and Commitment Therapy for the Management of Suicidal Patients: A Randomized Controlled Trial.
Ducasse, D., Jaussent, I., Arpon-Brand, V., Vienot, M., Laglaoui, C., Béziat, S., Calati, R., Carrière, I., Guillaume, S., Courtet, P., et al. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000488715 · Cited by 103
How blind is blind? Assessment of patient and doctor medication guesses in a placebo-controlled trial of imipramine and phenelzine
Rabkin, J. G., Markowitz, J. S., Stewart, J. W., McGrath, P. J., Harrison, W. M., Quitkin, F. M., & Klein, D. F. (1986) · Psychiatry Research · doi:10.1016/0165-1781(86)90094-6 · Cited by 103
CBT4BN: A Randomized Controlled Trial of Online Chat and Face-to-Face Group Therapy for Bulimia Nervosa
Zerwas, S. C., Watson, H. J., Hofmeier, S. M., Levine, M. D., Hamer, R. M., Crosby, R. D., Runfola, C. D., Peat, C. M., Shapiro, J. R., Zimmer, B., et al. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000449025 · Cited by 102
Comparison of effectiveness and cost-effectiveness of an intensive community supported discharge service versus treatment as usual for adolescents with psychiatric emergencies: a randomised controlled trial
Ougrin, D., Corrigall, R., Poole, J., Zundel, T., Sarhane, M., Slater, V., Stahl, D., Reavey, P., Byford, S., Heslin, M., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30129-9 · Cited by 101
Multisystemic therapy versus management as usual in the treatment of adolescent antisocial behaviour (START): a pragmatic, randomised controlled, superiority trial
Fonagy, P., Butler, S., Cottrell, D. J., Scott, S., Pilling, S., Eisler, I., Fuggle, P., Kraam, A., Byford, S., Wason, J. M. S., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30001-4 · Cited by 100
Blinding in Randomized Clinical Trials: Imposed Impartiality
Hróbjartsson, A., & Boutron, I. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2011.207 · Cited by 96
Social recovery therapy in combination with early intervention services for enhancement of social recovery in patients with first-episode psychosis (SUPEREDEN3): A single-blind, randomised controlled trial
Fowler, D., Hodgekins, J., French, P., Marshall, M., Freemantle, N., McCrone, P., Everard, L., Lavis, A., Jones, P. B., Amos, T., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30476-5 · Cited by 95
Democratic therapeutic community treatment for personality disorder: Randomised controlled trial
Pearce, S., Scott, L., Attwood, G., Saunders, K. E. A., Dean, M., Ridder, R. D., Galea, D., Konstantinidou, H., & Crawford, M. (2016) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.116.184366 · Cited by 94
Comparison of behavioural activation with guided self-help for treatment of depression in adults with intellectual disabilities: a randomised controlled trial
Jahoda, A. J., Hastings, R. P., Hatton, C., Cooper, S., Dagnan, D., Zhang, R., McConnachie, A., McMeekin, N., Appleton, K., Jones, R., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30426-1 · Cited by 94
Mindfulness-based cognitive therapy as a treatment for chronic tinnitus: a randomized controlled trial
McKenna, L., Marks, E. M., Hallsworth, C. A., & Schaette, R. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000478267 · Cited by 93
A review of blinding in randomized controlled trials found results inconsistent and questionable
Boutron, I., Estellat, C., & Ravaud, P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.04.006 · Cited by 92
Acceptance and commitment therapy for psychosis: Randomised controlled trial
Shawyer, F., Farhall, J., Thomas, N., Hayes, S. C., Gallop, R., Copolov, D., & Castle, D. J. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.182865 · Cited by 89
Turning a blind eye:Why we don't test for blindness at the end of our trials
Sackett, D. L. (2004) · BMJ · doi:10.1136/bmj.328.7448.1136-a · Cited by 88
A brief psychological intervention to reduce repetition of self-harm in patients admitted to hospital following a suicide attempt: A randomised controlled trial
O'Connor, R. C., Ferguson, E., Scott, F., Smyth, R., McDaid, D., Park, A.-L., Beautrais, A., & Armitage, C. J. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30129-3 · Cited by 88
Antipsychotic drugs versus cognitive behavioural therapy versus a combination of both in people with psychosis: a randomised controlled pilot and feasibility study
Morrison, A. P., Law, H., Carter, L., Sellers, R., Emsley, R., Pyle, M., French, P., Shiers, D., Yung, A. R., Murphy, E., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30096-8 · Cited by 88
Adherence to Depression Treatment in Primary Care: A Randomized Clinical Trial
Sirey, J. A., Banerjee, S., Marino, P., Bruce, M. L., Halkett, A., Turnwald, M., Chiang, C., Liles, B., Artis, A., Blow, F., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.3047 · Cited by 87
Comparing three‐year extension of early intervention service to regular care following two years of early intervention service in first‐episode psychosis: a randomized single blind clinical trial
MALLA, A. K., Joober, R., Iyer, S. N., Norman, R. M. G., Schmitz, N., Brown, T. G., Lutgens, D., Jarvis, E., Margolese, H. C., Casacalenda, N., et al. (2017) · World Psychiatry · doi:10.1002/wps.20456 · Cited by 85
Benefits of Individualized Feedback in Internet-Based Interventions for Depression: A Randomized Controlled Trial
Zagorscak, P., Heinrich, M., Sommer, D., Wagner, B., & Knaevelsrud, C. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000481515 · Cited by 85
Randomized trials published in higher vs. lower impact journals differ in design, conduct, and analysis
Bała, M. M., Akl, E. A., Sun, X., Bassler, D., Mertz, D., Mejza, F., Vandvik, P. O., Málaga, G., Johnston, B. C., Dahm, P., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.10.005 · Cited by 84
Comparing the Effects of Mindfulness-Based Cognitive Therapy and Sleep Psycho-Education with Exercise on Chronic Insomnia: A Randomised Controlled Trial
Wong, S. Y. S., Zhang, D., Chi-kwan, C. L., Yip, B. H. K., Chan, D. C.-C., Ling, Y.-M., Lo, C. S. L., Woo, D. M.-S., Sun, Y., Ma, H., et al. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000470847 · Cited by 76
Individual Treatment of Posttraumatic Stress Disorder Using Mantram Repetition: A Randomized Clinical Trial
Bormann, J. E., Thorp, S. R., Smith, E. G., Glickman, M. E., Beck, D. J., Plumb, D. N., Zhao, S., Ackland, P. E., Rodgers, C. S., Heppner, P. S., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17060611 · Cited by 74
Efficacy of web-based cognitive–behavioural therapy for chronic fatigue syndrome: randomised controlled trial
Janse, A., Worm-Smeitink, M., Bleijenberg, G., Donders, R., & Knoop, H. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2017.22 · Cited by 72
Controlling for the placebo effect in psychotherapy: Noble quest or tilting at windmills?
Kirsch, I., Wampold, B., & Kelley, J. M. (2016) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000065 · Cited by 71
Self-citation
Prolonged exposure therapy and supportive counselling for post-traumatic stress disorder in adolescents: Task-shifting randomised controlled trial
Rossouw, J., Yadin, E., Alexander, D., & Seedat, S. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.130 · Cited by 71
Long-term clinical and cost-effectiveness of collaborative care (versus usual care) for people with mental-physical multimorbidity: cluster-randomised trial
Camacho, E. M., Davies, L. M., Hann, M., Small, N., Bower, P., Chew-Graham, C., Baguely, C., Gask, L., Dickens, C. M., Lovell, K., et al. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.70 · Cited by 66
A randomized controlled trial of medication and cognitive-behavioral therapy for hypochondriasis
Fallon, B. A., Ahern, D. K., Pavlicova, M., Slavov, I., Skritskya, N., & Barsky, A. J. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16020189 · Cited by 65
Internet-Based Cognitive Behavioral Therapy for Chronic Stress: A Randomized Controlled Trial
Lindsäter, E., Axelsson, E., Salomonsson, S., Santoft, F., Ejeby, K., Ljótsson, B., Åkerstedt, T., Lekander, M., & Hedman-Lagerlöf, E. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000490742 · Cited by 64
Placebo-Controlled Trials in Surgery
Probst, P., Grummich, K., Harnoss, J. C., Hüttner, F. J., Jensen, K., Braun, S., Kieser, M., Ulrich, A. B., Büchler, M. W., & Diener, M. K. (2016) · Medicine · doi:10.1097/md.0000000000003516 · Cited by 61
A Randomized Controlled Trial in Routine Clinical Practice Comparing Acceptance and Commitment Therapy with Cognitive Behavioral Therapy for the Treatment of Major Depressive Disorder
A-Tjak, J. G. L., Morina, N., Topper, M., & Emmelkamp, P. M. G. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000486807 · Cited by 61
Efficacy of nature-based therapy for individuals with stress-related illnesses: randomised controlled trial
Stigsdotter, U. K., Corazon, S. S., Sidenius, U., Nyed, P. K., Larsen, H. B., & Fjorback, L. O. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.2 · Cited by 61
Early Psychological Counseling for the Prevention of Posttraumatic Stress Induced by Acute Coronary Syndrome: The MI-SPRINT Randomized Controlled Trial
von Känel, R., Barth, J., Princip, M., Meister‐Langraf, R. E., Schmid, J., Znoj, H., Herbert, C., & Schnyder, U. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000486099 · Cited by 60
Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory
Hróbjartsson, A., Pildal, J., Chan, A.-W., Haahr, M. T., Altman, D. G., & Gøtzsche, P. C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.04.003 · Cited by 56
Computerised cognitive–behavioural therapy for adults with intellectual disability: randomised controlled trial
Cooney, P., Jackman, C., Coyle, D., & O’Reilly, G. (2017) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.117.198630 · Cited by 51
Assessing assumptions for statistical analyses in randomised clinical trials
Nielsen, E. E., Nørskov, A. K., Lange, T., Thabane, L., Wetterslev, J., Beyersmann, J., de Uña‐Álvarez, J., Torri, V., Billot, L., Putter, H., et al. (2019) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111174 · Cited by 44
Self-citation
The Journal Impact Factor as a Predictor of Trial Quality and Outcomes: Cohort Study of Hepatobiliary Randomized Clinical Trials
Gluud, L. L., Sørensen, T. I. A., Gøtzsche, P. C., & Gluud, C. N. (2005) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2005.00327.x · Cited by 38
Self-citation
Cognitive-Behavioral and Psychodynamic Therapy in Adolescents with Social Anxiety Disorder: A Multicenter Randomized Controlled Trial
Salzer, S., Stefini, A., Kronmüller, K., Leibing, E., Leichsenring, F., Henningsen, P., Peseschkian, H., Reich, G., Rosner, R., Ruhl, U. E., et al. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000488990 · Cited by 33
Efficacy of a Maternal Depression Prevention Strategy in Head Start
Silverstein, M., Díaz‐Linhart, Y., Cabral, H., Beardslee, W. R., Hegel, M. T., Haile, W., Sander, J., Patts, G. J., & Feinberg, E. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1001 · Cited by 32
Effectiveness of Supported Self-Help in Recurrent Depression: A Randomized Controlled Trial in Primary Care
Biesheuvel-Leliefeld, K. E. M., Dijkstra‐Kersten, S. M. A., van Schaik, A., van Marwijk, H., Smit, F., van der Horst, H. E., & Bockting, C. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000472260 · Cited by 32
Comparing the Efficacy of CBASP with Two Versions of CBT for Depression in a Routine Care Center: A Randomized Clinical Trial
Rief, W., Bleichhardt, G., Dannehl, K., Euteneuer, F., & Wambach, K. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000487893 · Cited by 30
The Effects of an Internet-Based Imagery Rehearsal Intervention: A Randomized Controlled Trial
Gieselmann, A., Böckermann, M., Sorbi, M. J., & Pietrowsky, R. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000470846 · Cited by 27
Attenuated Psychophysiological Reactivity following Single-Session Group Imagery Rescripting versus Verbal Restructuring in Social Anxiety Disorder: Results from a Randomized Controlled Trial
Hyett, M. P., Bank, S. R., Lipp, O. V., Erceg‐Hurn, D. M., Alvares, G. A., Maclaine, E., Puckridge, E., Hayes, S., & McEvoy, P. M. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000493897 · Cited by 26
Community-based group guided self-help intervention for low mood and stress: randomised controlled trial
Williams, C. M., McClay, C.-A., Matthews, L., McConnachie, A., Haig, C. E., Walker, A., & Morrison, J. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2017.18 · Cited by 20
Blindsided: challenging the dogma of masking in clinical trials
Drucker, A. M., & Chan, A. (2020) · BMJ · doi:10.1136/bmj.m229 · Cited by 12

Research works printed but not linked: 1

10.2307/2276774 · DOI · Paper page

Sorted by citations

Great Expectations: recommendations for improving the methodological rigor of psychedelic clinical trials
Aday, J. S., Heifets, B. D., Pratscher, S. D., Bradley, E., Rosen, R., & Woolley, J. D. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06123-7 · Cited by 237
Recommendations for the development, implementation, and reporting of control interventions in efficacy and mechanistic trials of physical, psychological, and self-management therapies: the CoPPS Statement
Hohenschurz‐Schmidt, D., Vase, L., Scott, W., Annoni, M., Ajayi, O. K., Barth, J., Bennell, K. L., Berna, C., Bialosky, J. E., BRAITHWAITE, F., et al. (2023) · BMJ · doi:10.1136/bmj-2022-072108 · Cited by 110
Expectancy in placebo-controlled trials of psychedelics: if so, so what?
Butler, M., Jelen, L., & Rucker, J. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06221-6 · Cited by 100
Cognitive rehabilitation for people with mild to moderate dementia
Kudlicka, A., Martyr, A., Bahar‐Fuchs, A., Sabatés, J., Woods, B. T., & Clare, L. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013388.pub2 · Cited by 95
Effectiveness of cognitive behavioural therapy-based interventions for maternal perinatal depression: a systematic review and meta-analysis
Pettman, D., O’Mahen, H., Blomberg, O., Svanberg, A. S., von Essén, L., & Woodford, J. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-04547-9 · Cited by 90

See all 135

Authors: Juul, S., Gluud, C., Simonsen, S., Frandsen, F. W., Kirsch, I., & Jakobsen, J. C.
Affiliations: Mental Health Services (DK)
Copenhagen University Hospital (DK)
Harvard University (US)
University of Southern Denmark (DK)
Corresponding author: Juul, Sophie
ORCID: Juul, Sophie
Gluud, Christian
Simonsen, Sebastian
Frandsen, Frederik Weischer
Kirsch, Irving
Jakobsen, Janus Christian
Venue: BMJ Evidence-Based Medicine
Publisher: BMJ
Published: 2020-09-30
Volume: 26
Issue: 3
Pages: 109-109
ISSN: 1356-5524 (ISSN-L)
2515-446X
2515-4478
DOI: 10.1136/bmjebm-2020-111407
OpenAlex: W3091014787
Semantic Scholar: d3805f0a7094ac1f67a6cd4cf28729cf664779c8
Cited by: 135
References: 113
Citations by year: 2026: 21 · 2025: 28 · 2024: 47 · 2023: 22 · 2022: 12 · 2021: 5
FWCI: 5.95
Type: journal article
Language: en
Open access: closed
Locations: BMJ Evidence-Based Medicine (publishedVersion)
PubMed (publishedVersion)
University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Keywords: blinding, randomized controlled trials, psychological intervention, risk of bias, null hypothesis rejection
MeSH terms: Humans, Retrospective Studies, Randomized Controlled Trials as Topic, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Blinding in randomised clinical trials of psychological interventions: a retrospective study of published trial reports

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks