Blinded interpretation of study results can feasibly and effectively diminish interpretation bias
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Controversial and misleading interpretation of data from randomized trials is common. How to avoid misleading interpretation has received little attention. Herein, we describe two applications of an approach that involves blinded interpretation of the results by study investigators. STUDY DESIGN AND SETTINGS: The approach involves developing two interpretations of the results on the basis of a blinded review of the primary outcome data (experimental treatment A compared with control treatment B). One interpretation assumes that A is the experimental intervention and another assumes that A is the control. After agreeing that there will be no further changes, the investigators record their decisions and sign the resulting document. The randomization code is then broken, the correct interpretation chosen, and the manuscript finalized. Review of the document by an external authority before finalization can provide another safeguard against interpretation bias. RESULTS: We found the blinded preparation of a summary of data interpretation described in this article practical, efficient, and useful. CONCLUSIONS: Blinded data interpretation may decrease the frequency of misleading data interpretation. Widespread adoption of blinded data interpretation would be greatly facilitated were it added to the minimum set of recommendations outlining proper conduct of randomized controlled trials (eg, the Consolidated Standards of Reporting Trials statement).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251 · cited 1×
“Although guides to the reporting of randomized trials [15] and protocols for trials [16] are available, these initiatives focus on provision of accurate data, whereas investigators have paid relatively little attentiondand provided even fewer suggestions for safeguardsdto the risk of misleading data interpretation.”
BackgroundAls-Nielsen, B., Chen, W., Gluud, C., & Kjaergard, L. L. (2003) · JAMA · doi:10.1001/jama.290.7.921 · Cited by 746
Effect of interpretive bias on research evidence
Kaptchuk, T. J. (2003) · BMJ · doi:10.1136/bmj.326.7404.1453 · Cited by 222 · cited 1×
“Interpretation of data, a vitally important part of conducting research [1], is never totally objective and is therefore vulnerable to prior convictions, wishful thinking, and conflict of interestdin particular, the influence of commercial funding [2].”
BackgroundBlinding during data analysis and writing of manuscripts
Gøtzsche, P. C. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00263-4 · Cited by 123
Users' guide to detecting misleading claims in clinical research reports
Montori, V. M., Jaeschke, R., Schünemann, H. J., Bhandari, M., Brozek, J. L., Devereaux, P. J., & Guyatt, G. H. (2004) · BMJ · doi:10.1136/bmj.329.7474.1093 · Cited by 106 · cited 1×
“Although guides for detecting bias and guides for consumers of research faced with misleading interpretations are available [4,6], it is often impossible to detect that the data analysis was flawed.”
BackgroundSelf-citation
Cited by
Arthroscopic Partial Meniscectomy versus Sham Surgery for a Degenerative Meniscal Tear
Sihvonen, R., Paavola, M., Malmivaara, A., Itälä, A., Joukainen, A., Nurmi, H., Kalske, J., & Järvinen, T. L. N. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1305189 · Cited by 822
Self-citationA Randomized, Controlled Trial of Total Knee Replacement
Skou, S. T., Roos, E. M., Laursen, M. B., Rathleff, M. S., Arendt-Nielsen, L., Simonsen, O., & Rasmussen, S. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1505467 · Cited by 816
Total Hip Arthroplasty or Hemiarthroplasty for Hip Fracture
The HEALTH Investigators (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1906190 · Cited by 517
A Trial of Wound Irrigation in the Initial Management of Open Fracture Wounds
The FLOW Investigators (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1508502 · Cited by 365
Juul, S., Gluud, C., Simonsen, S., Frandsen, F. W., Kirsch, I., & Jakobsen, J. C. (2021) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111407 · Cited by 135
Metadata
- Authors
- Järvinen, T. L. N., Sihvonen, R., Bhandari, M., Sprague, S., Malmivaara, A., Paavola, M., Schünemann, H. J., & Guyatt, G. H.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2014-07
- Volume
- 67
- Issue
- 7
- Pages
- 769-772
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W1991246128
- Cited by
- 144
- References
- 5
- FWCI
- 8.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Blinded interpretation of study results can feasibly and effectively diminish interpretation bias. https://app.cochat.ai/papers/10.1016/j.jclinepi.2013.11.011
- The paper
- Järvinen, T. L. N., Sihvonen, R., Bhandari, M., Sprague, S., Malmivaara, A., Paavola, M., Schünemann, H. J., & Guyatt, G. H. (2014). Blinded interpretation of study results can feasibly and effectively diminish interpretation bias. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2013.11.011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.