The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index; 20 of the 39 sources its claims cite were checked for support.
Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review
Open accessAbstract
Background Blinding of patients, clinicians and outcome assessors is a key measure for minimising bias in randomised controlled trials (RCTs). In trials of psychological interventions, where outcome measures often use subjective measures, the blinding of outcome assessors is particularly important. However, there are few guidelines on how blinding of outcome assessors can be achieved in practice. The aim of this study was to identify procedures used for blinding outcome assessors in RCTs of psychological interventions. Methods A narrative review was conducted through a PubMed database search covering the period from January 2023 to December 2024, restricted to studies published in the six highest impact factor journals in the field of psychiatry and mental health. Studies were included if they were (1) an RCT and (2) focused on psychological intervention(s). Descriptive statistics were used to summarise the study characteristics, and content analysis of the published reports was conducted to describe the methods used to maintain blinding of outcome assessors. Results Fifty-two eligible studies were identified which reported on RCTs of psychological interventions. Of those, the majority reported that outcome assessors were blinded to participants’ treatment allocation ( n = 44, 85%). Of the studies with blinded outcome assessors, 27 reported information on the procedures used to maintain blinding (61%). Methods for maintaining blinding were avoiding unblinding by participants…
Overview
CoChat Summary
## TL;DR
This narrative review examined how outcome assessor blinding was reported in 52 RCTs of psychological interventions published in six high-impact psychiatry and mental health journals from January 2023 to December 2024. Most studies reported blinded outcome assessors (44/52, 85%), but 39% of studies did not provide sufficient detail on how blinding was maintained in practice.
## Key findings
- The review included 52 eligible RCTs; 44/52 (85%) reported that outcome assessors were blind to participants’ treatment allocation.
- Of the 44 blinded studies, only 27 (61%) reported any procedures used to maintain blinding.
- The most commonly reported blinding procedures were:
- avoiding unblinding by participants (n = 16),
- tracking and assessing blinding efficacy (n = 12),
- replacing unblinded assessors (n = 11),
- managing communication within the team (n = 9),
- clear designation of blind/unblind staff roles (n = 8),
- and management of records (n = 6).
- Most studies reported a single blinding method (n = 11, 41%); only 2 studies reported using all six blinding methods identified.
## Methods
- Narrative review using a PubMed search covering January 2023 to December 2024, restricted to studies in six high-impact psychiatry/mental health journals.
- Included studies had to be RCTs focused on psychological interventions; 52 studies met criteria after screening 114 potentially relevant articles.
- The authors used descriptive statistics to summarize reporting of blinded outcome assessors and conventional content analysis to classify blinding procedures reported in full texts and supplementary materials.
## Limitations
- The paper states the review was restricted to RCTs in high-impact journals, so it does not provide a comprehensive review of all relevant studies.
- The authors note it is unknown how representative these findings are of RCTs published in lower-ranking journals.
- The review examined only published RCT reports and supplementary materials; it is possible additional blinding methods were described elsewhere, such as in trial protocols or could have been learned by contacting corresponding authors.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
13 Valid · 0 Not valid · 5 Not checked · 25 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“only two studies reported using all six blinding methods identified in the content analysis [52, 69].”
§ Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review > Results > Number of blinding methods reported per study
What the sources say
- Partly supportedcites [52] Lincoln TM, Schlier B, Müller R, Hayward M, Fladung AK, Bergmann N, et al. Reducing distress from auditory verbal hallucinations: a multicenter, parallel, single-blind, randomized controlled feasibility trial of relating therapy. Psychother Psychosom. 2024;93(5):328–39. sourceExperimental — accuracy not yet measured
The Methods section (Randomization and Masking; page unavailable) reports several masking measures: restricted access to allocation information, blinded assessors, and reassignment to another assessor after unblinding. It does not identify six blinding methods or establish that this trial used all six. As one of two cited studies, it also cannot establish the total count. (LLM, conf=0.76)
- Partly supportedcites [69] Waite F, Černis E, Kabir T, Iredale E, Johns L, Maughan D, et al. A targeted psychological treatment for sleep problems in young people at ultra-high risk of psychosis in England (SleepWell): a parallel group, single-blind, randomised controlled feasibility trial. Lancet Psychiatry. 2023;10(9):706–18. sourceExperimental — accuracy not yet measured
The Randomisation and masking section (page not available) reports that trial assessors were masked, that the coordinator informed patients of their allocation, and that another masked assessor completed an assessment if allocation was revealed. It does not identify six blinding methods or establish the citing paper’s count of two studies. (LLM, conf=0.80)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Of the remaining eight studies, two collected primary outcome data online which meant blinded outcome assessors were not needed [25, 66].”
§ Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review > Results > Blinding of outcome assessors
What the sources say
- Not checked — no full text of the sourcecites [25] Babiy Z, Layton H, Savoy CD, Xie F, Brown JSL, Bieling PJ, et al. One-day peer-delivered cognitive behavioral therapy-based workshops for postpartum depression: a randomized controlled trial. Psychother Psychosom. 2024;93(2):129–40. source
- Supportedcites [66] Slade M, Rennick-Egglestone S, Elliott RA, Newby C, Robinson C, Gavan SP, et al. Effectiveness and cost-effectiveness of online recorded recovery narratives in improving quality of life for people with non-psychotic mental health problems: a pragmatic randomized controlled trial. World Psychiatry. 2024;23(1):101–12. source
The Follow-up and usage data collection section states that participants completed web-based questionnaires for the primary outcome at week 52. This supports citing the trial as one of the studies that collected primary-outcome data online, without an outcome assessor administering the questionnaire; the paper does not establish the citing review’s count of eight studies. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Three studies reported that outcome assessors were unblinded (reasons were open-label trial [41], differences in the data collected between arms [34] and outcome assessors part of the clinical team [70]).”
§ Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review > Results > Blinding of outcome assessors
What the sources say
- Not checked — no full text of the sourcecites [41] Gardner DM, Turner JP, Magalhaes S, Rajda M, Murphy AL. Patient self-guided interventions to reduce sedative use and improve sleep: the YAWNS NB randomized clinical trial. JAMA Psychiatr. 2024;81(12):1187–97. source
- Supportedcites [34] Creswell C, Taylor L, Giles S, Howitt S, Radley L, Whitaker E, et al. Digitally augmented, parent-led CBT versus treatment as usual for child anxiety problems in child mental health services in England and Northern Ireland: a pragmatic, non-inferiority, clinical effectiveness and cost-effectiveness randomised controlled trial. Lancet Psychiatry. 2024;11(3):193–209. source
The limitations discussion states that researchers collecting data were not blind to treatment arm because some therapist-reported data differed between arms. This supports the part of the citing sentence attributed to this study [34]; the other two studies are not attributed to this source. (LLM, conf=0.91)
- Supportedcites [70] Walburg FS, van Meijel B, Hoekstra T, Kol J, Pape LM, de Joode JW, et al. Effectiveness of a lifestyle intervention for people with a severe mental illness in Dutch outpatient mental health care: a randomized clinical trial. JAMA Psychiat. 2023;80(9):886–94. source
The Methods > Assessments section says trained FACT team staff conducted assessments. The Discussion > Strengths and Limitations section says blinding measurement assessors was not feasible. Together, these support the part of the citing sentence attributed to this study: its assessors were unblinded and were members of the clinical team. (LLM, conf=0.93)
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Studies that provided extensive detail about all blinding methods strengthen confidence in the validity of findings [52, 69].”
§ Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review > Discussion
What the sources say
- Partly supportedcites [52] Lincoln TM, Schlier B, Müller R, Hayward M, Fladung AK, Bergmann N, et al. Reducing distress from auditory verbal hallucinations: a multicenter, parallel, single-blind, randomized controlled feasibility trial of relating therapy. Psychother Psychosom. 2024;93(5):328–39. sourceExperimental — accuracy not yet measured
The Methods > Randomization and Masking section (page unavailable) describes assessor blinding, ten instances of unblinding, and how subsequent assessments were remasked. It does not say that detailing all blinding methods strengthens confidence in the validity of findings; that broader judgment is not supported by this paper. (LLM, conf=0.78)
- Partly supportedcites [69] Waite F, Černis E, Kabir T, Iredale E, Johns L, Maughan D, et al. A targeted psychological treatment for sleep problems in young people at ultra-high risk of psychosis in England (SleepWell): a parallel group, single-blind, randomised controlled feasibility trial. Lancet Psychiatry. 2023;10(9):706–18. sourceExperimental — accuracy not yet measured
The Randomisation and masking section describes how assessors were kept masked, what happened when allocation was revealed, and three occasions of unmasking. It does not address all blinding methods or state that detailed reporting of blinding strengthens confidence in the validity of findings. (LLM, conf=0.78)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Three studies did not specify whether outcome assessors were blinded [28, 46, 63].”
§ Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review > Results > Blinding of outcome assessors
What the sources say
- Not checked — no full text of the sourcecites [28] Boudreaux ED, Larkin C, Vallejo Sefair A, Ma Y, Li YF, Ibrahim AF, et al. Effect of an emergency department process improvement package on suicide prevention: the ED-SAFE 2 cluster randomized clinical trial. JAMA Psychiat. 2023;80(7):665–74. source
- Not checked — no full text of the sourcecites [46] Hertenstein E, Trinca E, Schneider CL, Fehér KD, Johann AF, Nissen C. Acceptance and commitment therapy, combined with bedtime restriction, versus cognitive behavioral therapy for insomnia: a randomized controlled pilot trial. Psychother Psychosom. 2024;93(2):114–28. source
- Supportedcites [63] Seinsche RJ, Fricke S, Neudert MK, Zimmer RI, Stark R, Hermann A. Emotional changes during imagery rescripting of aversive social memories in social anxiety disorder: a randomized controlled trial. Psychother Psychosom. 2024;93(4):264–70. source
The Materials and Methods (Participants; page unavailable) state that participants were blind to treatment assignment, but do not specify whether outcome assessors were blinded. This supports the claim as it applies to this cited study; the other two studies are outside the scope of this citation. (LLM, conf=0.88)
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
19 more claims · 2 with their cited sources checked
Create a free account to see all 43 claims and every source verdict.
- It may state two separate claims as one. 7
- Probably not a substantial claim. 13
- The quote only partly states this claim. 1
Citations
Cites
Graneheim, U. H., & Lundman, B. (2004) · Nurse Education Today · doi:10.1016/j.nedt.2003.10.001 · Cited by 20,772
CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
Hariton, E., & Locascio, J. J. (2018) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15199 · Cited by 1,604
Blinding in randomised trials: hiding who got what
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07816-9 · Cited by 952 · cited 1×
“It assumes that outcome assessors’ guesses of treatment allocation should be equivalent to those that would be found by chance if blinding efforts have been successful [20].”
Assessment of blinding in clinical trials
Bang, H., Ni, L., & Davis, C. E. (2004) · Controlled Clinical Trials · doi:10.1016/j.cct.2003.10.016 · Cited by 682 · cited 1×
“Successful blinding in RCTs ensures the validity and credibility of results from RCTs [4, 5].”
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.120744 · Cited by 527 · cited 2×
“Given exaggerated treatment effects when outcome assessors are unblinded [6, 7], it is crucial that sufficient detail on blinding methods is reported in RCTs so that conclusions drawn from these studies can be made with confidence [14].”
CONSORT 2025 statement: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00672-5 · Cited by 510 · cited 2×
“The Consolidated Standards of Reporting Trials (CON-SORT) statement defines a minimum set of items to be included in the reporting of RCTs, and is endorsed globally by hundreds of journals, and has been associated with improvements in the reporting of RCTs [10].”
Hrobjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2012) · BMJ · doi:10.1136/bmj.e1119 · Cited by 483 · cited 3×
“Given exaggerated treatment effects when outcome assessors are unblinded [6, 7], it is crucial that sufficient detail on blinding methods is reported in RCTs so that conclusions drawn from these studies can be made with confidence [14].”
Reporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389 · cited 4×
“In pharmaceutical research, blinding is relatively straightforward, as the interventions are indistinguishable [5, 8].”
InfluentialSavović, J., Turner, R. M., Mawdsley, D., Jones, H. E., Beynon, R., Higgins, J. P. T., & Sterne, J. A. C. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwx344 · Cited by 382
Research works printed but not linked: 1
- Beecham J, Knapp M. Costing psychiatric interventions. Measuring mental health needs. 2001;2:200–24.
Metadata
- Authors
- O’Keeffe, S.
- Affiliations
- Newcastle University (GB)
- Corresponding author
- O’Keeffe, Sally
- ORCID
- O’Keeffe, Sally
- Venue
- Trials
- Published
- 2026-06-09
- Volume
- 27
- Issue
- 1
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC13474860
- OpenAlex
- W7163984030
- Semantic Scholar
- e428378f20917701ea235fa095fab2ddf32702a8
- Cited by
- 0
- References
- 81
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 66 d)
- Locations
- Trials (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Institute for Health and Care Research (NIHR200173)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- randomized controlled trials, psychological intervention, bias mitigation, unblinding, mental health research
- MeSH terms
- Psychosocial Intervention, Humans, Psychotherapy, Research Design, Randomized Controlled Trials as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review. https://app.cochat.ai/papers/10.1186/s13063-026-09698-0
- The paper
- O’Keeffe, S. (2026). Blinding outcome assessors in randomised controlled trials of psychological interventions: how is it done? A narrative review. Trials. https://doi.org/10.1186/s13063-026-09698-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

