The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Effect of Blinding and Unmasking on the Quality of Peer Review: A Randomized Trial
Open accessAbstract
CONTEXT: Little research has been conducted into the quality of peer review and, in particular, the effects of blinding peer reviewers to authors' identities or masking peer reviewers' identities. OBJECTIVE: To determine whether concealing authors' identities from reviewers (blinding) and/or revealing the reviewer's identity to a coreviewer (unmasking) affects the quality of reviews, the time taken to carry out reviews, and the recommendation regarding publication. DESIGN AND SETTING: Randomized trial of 527 consecutive manuscripts submitted to BMJ, which were randomized and each sent to 2 peer reviewers. INTERVENTIONS: Manuscripts were randomized as to whether the reviewers were unmasked, masked, or uninformed that a study was taking place. Two reviewers for each manuscript were randomized to receive either a blinded or an unblinded version. MAIN OUTCOME MEASURES: Mean total quality score, time taken to carry out the review, and recommendation regarding publication. RESULTS: Of the 527 manuscripts entered into the study, 467 (89%) were successfully randomized and followed up. The mean total quality score was 2.87. There was little or no difference in review quality between the masked and unmasked groups (scores of 2.82 and 2.96, respectively) and between the blinded and unblinded groups (scores of 2.87 and 2.90, respectively). There was no apparent Hawthorne effect. There was also no significant difference between groups in the recommendations regarding publication or time taken to review. CONCLUSIONS: Blinding and unmasking made no editorially significant difference to review quality, reviewers' recommendations, or time taken to review. Other considerations should guide decisions as to the form of peer review adopted by a journal, and improvements in the quality of peer review should be sought via other means.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What Makes a Good Reviewer and a Good Review for a General Medical Journal?
Black, N. (1998) · JAMA · doi:10.1001/jama.280.3.231 · Cited by 266
Self-citationThe Effects of Blinding on the Quality of Peer Review: A Randomized Trial
McNutt, R. A. (1990) · JAMA · doi:10.1001/jama.1990.03440100079012 · Cited by 261
Peer review in biomedical publication
Ingelfinger, F. J. (1974) · The American Journal of Medicine · doi:10.1016/0002-9343(74)90635-4 · Cited by 241
Peer review. Crude and understudied, but indispensable
Kassirer, J. P. (1994) · JAMA · doi:10.1001/jama.272.2.96 · Cited by 235
A Difficult Balance: Editorial Peer Review in Medicine
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-11-960_3 · Cited by 212
A Difficult Balance: Editorial Peer Review in Medicine: Review of a Book
Carney, M. J. (1986) · JAMA · doi:10.1001/jama.1986.03380020117036 · Cited by 189
The Effects of Blinding on Acceptance of Research Papers by Peer Review
Fisher, M. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020069019 · Cited by 164
A Citation Analysis of the Impact of Blinded Peer Review
Laband, D. N. (1994) · JAMA · doi:10.1001/jama.1994.03520020073020 · Cited by 114
The decision to publish. Ethical dilemmas
Shapiro, S. (1985) · Journal of Chronic Diseases · doi:10.1016/0021-9681(85)90082-7 · Cited by 25
Peer Review in Medical Journals
Robin, E. D., & Burke, C. M. (1987) · CHEST Journal · doi:10.1378/chest.91.2.252 · Cited by 25
Cited by
McCambridge, J., Witton, J., & Elbourne, D. R. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.08.015 · Cited by 2,748
Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Peer Review: A Flawed Process at the Heart of Science and Journals
Smith, R. (2006) · Journal of the Royal Society of Medicine · doi:10.1177/014107680609900414 · Cited by 880
Self-citationKroeze, W., Werkman, A., & Brug, J. (2006) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm3103_2 · Cited by 570
Double-blind review favours increased representation of female authors
BUDDEN, A., TREGENZA, T., AARSSEN, L., KORICHEVA, J., LEIMU, R., & LORTIE, C. (2008) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2007.07.008 · Cited by 552
Metadata
- Authors
- van Rooyen, S., Godlee, F., Evans, S., Smith, R., & Black, N.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 1998-07-15
- Volume
- 280
- Issue
- 3
- Pages
- 234
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W1972376036
- Cited by
- 280
- References
- 13
- FWCI
- 76.30
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effect of Blinding and Unmasking on the Quality of Peer Review: A Randomized Trial. https://app.cochat.ai/papers/10.1001/jama.280.3.234
- The paper
- van Rooyen, S., Godlee, F., Evans, S., Smith, R., & Black, N. (1998). Effect of Blinding and Unmasking on the Quality of Peer Review: A Randomized Trial. JAMA. https://doi.org/10.1001/jama.280.3.234
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.