The Effects of Blinding on Acceptance of Research Papers by Peer Review
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To study whether reviewers aware of author identity are biased in favor of authors with more previous publications. DESIGN: Randomized controlled trial. SETTING: Editorial office of the Journal of Developmental and Behavioral Pediatrics. PARTICIPANTS: Two "blinded" and two "nonblinded" reviewers assigned to 57 consecutive manuscripts submitted between September 1991 and March 1992. OUTCOME MEASURES: Spearman rank correlation coefficients were used to compare the sum of rating scores of 1 to 5 (1, accept; 5, reject) given by the two blinded reviewers, the two nonblinded reviewers, and the editors to the number of articles published previously by the first and senior authors (as determined from requested curricula vitae). Blinded reviewers were sent a questionnaire asking whether they could determine the identity of the authors, how they knew, and whether they thought binding changed the quality or difficulty of their review. RESULTS: The Wilcoxon Sign Rank Test disclosed no differences between blinded and nonblinded scores. The number of previous articles by the senior author was significantly correlated (P < .01) with blinded scores (r = -.45) and editors' decisions (r = -.45), but not with nonblinded scores; the number of articles by the first author was correlated (P < .05) with editors' decisions (r = -.35) but not with blinded or nonblinded scores. Fifty (46%) of 108 blinded reviewers correctly guessed the identity of the authors, mostly from self-references and knowledge of the work; 86% believed blinding did not change the quality of their review, and 73% believed it did not change the difficulty of performing a review. CONCLUSIONS: Blinded reviewers and editors in this study, but not nonblinded reviewers, gave better scores to authors with more previous articles. These results suggest that blinded reviewers may provide more unbiased reviews and that nonblinded reviewers may be affected by various types of bias.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Double-anonymizing the peer-review process could also help level the playing field for academics from other marginalized groups, giving them a fairer chance to succeed, which, in turn, would promote diverse points of view in journal output and eventually expand the journal peer-reviewer pool to authors coming from such backgrounds (3–5, 19–23).”
From Nobel and novice: Author prominence affects peer review (2022) · cites this paper as [20]
In the citing paper
“Double-anonymizing the peer-review process could also help level the playing field for academics from other marginalized groups, giving them a fairer chance to succeed, which, in turn, would promote diverse points of view in journal output and eventually expand the journal peer-reviewer pool to authors coming from such backgrounds (3–5, 19–23).”
From Nobel and novice: Author prominence affects peer review (2022) · cites this paper as [20]
In the citing paper
“Double-anonymizing the peer-review process could also help level the playing field for academics from other marginalized groups, giving them a fairer chance to succeed, which, in turn, would promote diverse points of view in journal output and eventually expand the journal peer-reviewer pool to authors coming from such backgrounds (3–5, 19–23).”
From Nobel and novice: Author prominence affects peer review (2022) · cites this paper as [20]
Citations
Cites
Biostatistical Analysis (2nd ed.).
Breen, T. J., & Zar, J. H. (1986) · Journal of the American Statistical Association · doi:10.2307/2289268 · Cited by 5,781
Peer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079
Blank, R. M. (2016) · American Economic Review · Cited by 421
The effects of blinding on the quality of peer review. A randomized trial
Mcnutt, R. (1990) · JAMA · doi:10.1001/jama.263.10.1371 · Cited by 216
A Difficult Balance: Editorial Peer Review in Medicine
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-11-960_3 · Cited by 212
Journal Peer Review: The Need for a Research Agenda
Bailar, J. C., & Patterson, K. (1985) · New England Journal of Medicine · doi:10.1056/nejm198503073121023 · Cited by 161
Improving what is published: A model in search of an editor.
Kupfersmid, J. H. (1988) · American Psychologist · doi:10.1037/0003-066x.43.8.635 · Cited by 137
Ceci, S. J., & Peters, D. P. (1984) · American Psychologist · doi:10.1037/0003-066x.39.12.1491 · Cited by 125
Recognition of Authors in Blind Review of Manuscripts
Rosenblatt, A., & Kirk, S. A. (1980) · Journal of Social Service Research · doi:10.1300/j079v03n04_04 · Cited by 86
GENDER FACTORS IN REVIEWER RECOMMENDATIONS FOR MANUSCRIPT PUBLICATION
Lloyd, M. E. (1990) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1990.23-539 · Cited by 85
Cited by
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
“process [6].”
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.2 · Cited by 449
Testing and adjusting for publication bias
Møller, A. P., & Jennions, M. D. (2001) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(01)02235-2 · Cited by 418
Effects of Editorial Peer Review: A Systematic Review
Jefferson, T., Alderson, P., Wager, E., & Davidoff, F. (2002) · JAMA · doi:10.1001/jama.287.21.2784 · Cited by 347
Godlee, F., Gale, C. R., & Martyn, C. N. (1998) · JAMA · doi:10.1001/jama.280.3.237 · Cited by 333
Metadata
- Authors
- Fisher, M.
- Affiliations
- Cornell University (US)
- Corresponding author
- Fisher, Martin
- Venue
- JAMA: The Journal of the American Medical Association
- Publisher
- American Medical Association (AMA)
- Published
- 1994-07-13
- Volume
- 272
- Issue
- 2
- Pages
- 143
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W1987965558
- Cited by
- 164
- References
- 18
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 7 · 2022: 9 · 2021: 9 · 2020: 9 · 2019: 2 · 2018: 4 · 2017: 6 · 2016: 7 · 2015: 7 · 2014: 3 · 2013: 4 · 2012: 3
- FWCI
- 38.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- peer review, blinding, reviewer bias, authorial identity, publishing history, editorial decision-making, manuscript review
- MeSH terms
- Authorship, Humans, Manuscripts as Topic, Periodicals as Topic, Publication Bias, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Effects of Blinding on Acceptance of Research Papers by Peer Review. https://app.cochat.ai/papers/10.1001/jama.1994.03520020069019
- The paper
- Fisher, M. (1994). The Effects of Blinding on Acceptance of Research Papers by Peer Review. JAMA: The Journal of the American Medical Association. https://doi.org/10.1001/jama.1994.03520020069019
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.