Blinding assessment in clinical trials: A review of statistical methods and a proposal of blinding assessment protocol
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
There is strong consensus in the clinical trial community that blinding is an important issue in randomized controlled trials. At present grossly incomplete reporting of procedures and the use of any assessment for blinding still prevails. The term ‘double-blind’ has almost become a convention without any checks or balances. Also there is a lack of consensus on quantitative procedures for evaluating the success of blinding in the literature. This article reviews statistical methods of blinding assessment along with software options, and discusses some of the most pressing issues surrounding the acquisition, interpretation, and reporting of blinding data. Finally, it proposes a sample blinding assessment protocol to address some of these issues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · cited 1×
“Empirical evidence demonstrates that inadequate and unclear allocation concealment or blinding is associated with biased estimates of treatment effects (38, 40), whereas some meta-analyses reported that blinding was not associated with a treatment effect on hard endpoints (41, 42).”
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Assessment of blinding in clinical trials
Bang, H., Ni, L., & Davis, C. E. (2004) · Controlled Clinical Trials · doi:10.1016/j.cct.2003.10.016 · Cited by 682 · cited 2×
“Moreover, Bang’s BI may enable us to classify a given scenario based on the ‘classification rule of nine blinding scenarios’ (see Table 7) (13, 21, 22).”
BackgroundSelf-citationBalk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478 · cited 1×
“Empirical evidence demonstrates that inadequate and unclear allocation concealment or blinding is associated with biased estimates of treatment effects (38, 40), whereas some meta-analyses reported that blinding was not associated with a treatment effect on hard endpoints (41, 42).”
Reporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389
Fergusson, D. (2004) · BMJ · doi:10.1136/bmj.37952.631667.ee · Cited by 264
Towards a proposal for assessment of blinding success in clinical trials: up-to-date review
Kolahi, J., Bang, H., & Park, J. (2009) · Community Dentistry and Oral Epidemiology · doi:10.1111/j.1600-0528.2009.00494.x · Cited by 137
Self-citationHow “blind” are double-blind studies?
Margraf, J., Ehlers, A., Roth, W. T., Clark, D. B., Sheikh, J., Agras, W. S., & Taylor, C. B. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.184 · Cited by 135
Cited by
A billion-dollar donation: estimating the cost of researchers’ time spent on peer review
Aczel, B., Szaszi, B., & Holcombe, A. O. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00118-2 · Cited by 306
“For example, for manuscripts that report clinical trials, some people could be trained in evaluating the blinding protocol and resulting degree of success of blinding [36], and if they had the opportunity to evaluate that particular portion of many manuscripts, they grow better at it and thus can evaluate more in a sh…”
BackgroundSilberstein, S. D., Mechtler, L. L., Kudrow, D. B., Calhoun, A. H., McClure, C., Saper, J. R., Liebler, E. J., Rubenstein Engel, E., Tepper, S. J., & on Behalf of the ACT1 Study Group (2016) · Headache: The Journal of Head and Face Pain · doi:10.1111/head.12896 · Cited by 263
Chronic migraine headache prevention with noninvasive vagus nerve stimulation: The EVENT study
Silberstein, S. D., Calhoun, A. H., Lipton, R. B., Grosberg, B. M., Cady, R. K., Dorlas, S., Simmons, K. A., Mullin, C., Liebler, E. J., Goadsby, P. J., et al. (2016) · Neurology · doi:10.1212/wnl.0000000000002918 · Cited by 257
Metadata
- Authors
- Bang, H., Flaherty, S. P., Kolahi, J., & Park, J.
- Venue
- Clinical Research and Regulatory Affairs
- Publisher
- Informa UK Limited
- Published
- 2010-04-30
- Volume
- 27
- Issue
- 2
- Pages
- 42-51
- ISSN
- 1060-1333 (ISSN-L)
- 1532-2521
- OpenAlex
- W2078668847
- Cited by
- 164
- References
- 12
- FWCI
- 2.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.