CoChat

Blinding of outcome assessors and its association with outcome in a randomized open-label stroke trial

Open access
van der Ende, Nadinda AM, Roozenbeek, Bob, Broderick, Joseph P, Khatri, Pooja, Lingsma, Hester F, Dippel, Diederik WJ · 2023 · International Journal of Stroke

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

Background: It is challenging for outcome assessors to remain blinded during outcome assessment in trials with prospective randomized open blinded endpoint (PROBE) design. If assessors are able to guess the correct treatment allocation more often than expected based on chance, the assessors may have been not properly blinded. Aims: We aimed to assess blinding of outcome assessors in a stroke trial with PROBE design and its association with outcome. Methods: We used data of the Interventional Management of Stroke (IMS) III trial. The modified Rankin Scale (mRS) at 90 days was assessed by local assessors who were unaware of treatment allocation. To assess success of blinding, each assessor was asked to guess the patient’s treatment allocation. We assessed whether the percentage of correct guesses was higher than chance (i.e. 50%). The association between correctly guessed treatment allocation and the mRS at 90 days was analyzed with ordinal logistic regression stratified by treatment allocation. We tested for interaction of correctly versus incorrectly guessed treatment allocation with actual treatment allocation on the mRS. Patients with missing data on guessed treatment allocation and patients who died prior to 90-day assessment were excluded. Results: In total, 459 patients were included in this study. The assessors guessed the correct treatment allocation significantly more often than expected (267/459, 58.2%, one-sided p = 0.0003). Correctly guessed treatment allocations were associated with better mRS scores in the intervention group (common odds ratio (cOR): 2.28, 95% confidence interval (CI): 1.50–3.48) and with worse mRS scores in the control group (cOR: 0.47, 95% CI: 0.27–0.83) (p interaction < 0.001). Conclusions: Assessors may not always be truly blinded for treatment allocation in clinical trials, and their guesses may be associated with outcome. Although causality between the assessors’ guess and patient outcome cannot be determined, future trials with subjective outcome should make efforts to ensure blinding and should report their blinding method and the success of blinding like the IMS III trial. Clinical Trial Registration: URL: https://clinicaltrials.gov . Unique identifier: NCT00359424.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/17474930221131706

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Flowchart of patients included in this study. IMS: Interventional Management of Stroke.
Figure 1. Flowchart of patients included in this study. IMS: Interventional Management of Stroke.CC BY · PubMed Central
Figure 2. Items that the assessors based their guess upon and the guessed treatment allocation by the assessors. *Data on improvement in symptoms were missing for four patients. †Data on lack of improvement in symptoms were missing for six patients. ‡Data on adverse effects of study treatment were missing for six patients. §Data on lack of adverse effects of study treatment were missing for seven patients. ||Data on other reasons were missing for 18 patients.
Figure 2. Items that the assessors based their guess upon and the guessed treatment allocation by the assessors. *Data on improvement in symptoms were missing for four patients. †Data on lack of improvement in symptoms were missing for six patients. ‡Data on adverse effects of study treatment were missing for six patients. §Data on lack of adverse effects of study treatment were missing for seven patients. ||Data on other reasons were missing for 18 patients.CC BY · PubMed Central
Figure 3. Functional outcome by incorrectly versus correctly guessed treatment allocation by the assessor stratified by actual treatment allocation. Correctly guessed treatment allocations were associated with better mRS scores in the intervention group (cOR: 2.28, 95% CI: 1.50–3.48) and with worse mRS scores in the control group (cOR: 0.47, 95% CI: 0.27–0.83) (pinteraction < 0.001). mRS: modified Rankin Scale.
Figure 3. Functional outcome by incorrectly versus correctly guessed treatment allocation by the assessor stratified by actual treatment allocation. Correctly guessed treatment allocations were associated with better mRS scores in the intervention group (cOR: 2.28, 95% CI: 1.50–3.48) and with worse mRS scores in the control group (cOR: 0.47, 95% CI: 0.27–0.83) (pinteraction < 0.001). mRS: modified Rankin Scale.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 2

  1. Drucker AM, 2020, BMJ, 368
  2. Ndounga Diakou LA, 2016, Cochrane Database Syst Rev, 3

Cited by

See all 14

Metadata

Authors
van der Ende, N. A., Roozenbeek, B., Broderick, J. P., Khatri, P., Lingsma, H. F., & Dippel, D. W.
Affiliations
  • Department of Neurology, Erasmus MC University Medical Center, Rotterdam, The Netherlands
  • Erasmus MC (NL)
  • University of Cincinnati (US)
Venue
International Journal of Stroke
Published
2022-10-19
Volume
18
Issue
5
Pages
562-568
ISSN
  • 1747-4930 (ISSN-L)
  • 1747-4949
OpenAlex
W4297489914
Cited by
14
References
18
Citations by year
2026: 6 · 2025: 4 · 2024: 2 · 2023: 2
FWCI
1.48
Type
journal article
Language
en
Open access
Locations
  • International Journal of Stroke (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, cc-by)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, cc-by)
Funders
  • university of cincinnati (U01NS052220)
  • medical university of south carolina (U01NS054630, U01NS077304)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Health Sciences › Medicine › Clinical Neurology › Acute Ischemic Stroke Management
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
probe design, modified Rankin Scale
MeSH terms
Humans, Prospective Studies, Research Design, Treatment Outcome, Outcome Assessment, Health Care, Stroke

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Blinding of outcome assessors and its association with outcome in a randomized open-label stroke trial. https://app.cochat.ai/papers/10.1177/17474930221131706
The paper
van der Ende, N. A., Roozenbeek, B., Broderick, J. P., Khatri, P., Lingsma, H. F., & Dippel, D. W. (2023). Blinding of outcome assessors and its association with outcome in a randomized open-label stroke trial. International Journal of Stroke. https://doi.org/10.1177/17474930221131706

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.