Does blinding of readers affect the results of meta-analyses?
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Meta-analysis of randomised clinical trials is gaining wide acceptance. Because of the potential for bias in any retrospective study, researchers as early as 1987 1 Sacks HS Berrier J Reitman D Acona-Berk VA Chalmers TC Meta-analysis of randomized control trials. N Engl J Med. 1987; 316: 450-455 Crossref PubMed Scopus (1054) Google Scholar have recommended that readers evaluating or extracting data from original papers for a meta-analysis be blinded to information in the paper about the identity of the authors, the institutional affiliations of the authors, the study results (when readers are evaluating the quality of the methods), and even the identity of the treatment and control groups. Although this recommendation has high face validity, no study has yet evaluated whether blinding actually reduces or prevents bias. To resolve this issue, we conducted a study to determine whether meta-analyses conducted with readers blinded to identifying information produce systematically different results than those same meta-analyses conducted with unblinded readers. A more detailed version of this report is published elsewhere. 2 Berlin JA, Miles CG, Crigliano MD, et al. Does blinding of readers affect the results of metaanalyses? Results of a randomized trial. Online J Curr Clin Trials. Document no 205. Google Scholar
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Over the last two decades, empirical evidence has accumulated from studies investigating different sources of bias related to specific SR tasks.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [34]
Citations
Cites
Meta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,250
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Metadata
- Authors
- Berlin, J. A.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Berlin, Jesse A
- ORCID
- Berlin, Jesse A
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 1997-07
- Volume
- 350
- Issue
- 9072
- Pages
- 185-186
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2033238186
- Cited by
- 478
- References
- 1
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 3 · 2022: 4 · 2021: 7 · 2020: 6 · 2019: 6 · 2018: 8 · 2017: 12 · 2016: 14 · 2015: 30 · 2014: 25 · 2013: 20 · 2012: 27
- FWCI
- 16.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 2843 d)
- Locations
- The Lancet (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- Agency for Health Care Policy and Research
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- meta-analysis bias, randomized controlled trials, data extraction
- MeSH terms
- Humans, Research Design, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does blinding of readers affect the results of meta-analyses? https://app.cochat.ai/papers/10.1016/s0140-6736(05)62352-5
- The paper
- Berlin, J. A. (1997). Does blinding of readers affect the results of meta-analyses? The Lancet. https://doi.org/10.1016/s0140-6736(05)62352-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.