Author Perception of Peer Review: Impact of Review Quality and Acceptance on Satisfaction
Abstract
Context To determine author perception of peer review and association between quality of review and author satisfaction. Methods Survey between May 1999 and October 2000 of 897 corresponding authors of manuscripts under consideration by the Annals of Emergency Medicine and had received final editorial decisions during the study period. A total of 576 authors (64%) returned the survey. Using a 5-point Likert scale, the survey assessed differences in satisfaction between authors whose manuscripts were accepted, reviewed and rejected, and rejected without full review. The association of author satisfaction with editor's assessment of review quality, publication decision, author sex, specialty, and publication experience were also assessed. Results Overall mean (SD) satisfaction score, indicated by agreement with "My experience with the review process will make me more likely to submit to Annals in the future," was 3.1 (1.0) and was significantly higher among authors of accepted papers (3.7 [0.9]) than among either group of rejected papers (rejected/reviewed, 2.8 [1.0]; rejected/no review, 3.0 [0.9]; P.05). Authors whose manuscripts were reviewed and rejected were the least satisfied with the time to decision (rejected/reviewed, 3.0 [1.2] vs accepted, 3.7 [1.0] and rejected/no review, 3.9 [0.9]; P Conclusion Contributor satisfaction with peer review was modest. Authors of rejected manuscripts were dissatisfied with the time to decision and communication from the editor. Author sa…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Prior papers [19-23] all find that in authors' evaluations of reviews on their own papers, the reviewer's accept-or-reject decision is highly correlated with the evaluation rating given by the authors.
“The papers [19–23] all find that in authors’ evaluations of reviews on their own papers, the decision of accept or reject given by the reviewer is highly correlated with evaluation rating given by the authors.”
From Peer reviews of peer reviews: A randomized controlled trial and other experiments (2025) · cites this paper as [22]
Cites
Development of the Review Quality Instrument (RQI) for Assessing Peer Reviews of Manuscripts
van Rooyen, S., Black, N., & Godlee, F. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00047-5 · Cited by 177 · cited 1× · see citing works
“As part of the ongoing oversight of the journal’s peer-review process, Annals’ decision editors evaluate each review and assign a single score on a previously validated 1 to 5 scale.(5,6) For the purposes of this study, the quality ratings of the reviews for each manuscript were averaged to create a single Review Qual…”
Reliability of Editors' Subjective Quality Ratings of Peer Reviews of Manuscripts
Callaham, M. L. (1998) · JAMA · doi:10.1001/jama.280.3.229 · Cited by 122 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Authors’ and Editors’ Perspectives on Peer Review Quality in Three Scholarly Nursing Journals
Shattell, M. M., Chinn, P., Thomas, S. P., & Cowling, W. R. (2010) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2009.01331.x · Cited by 59 · see citing works
Biomedical journal speed and efficiency: a cross-sectional pilot survey of author experiences
Wallach, J. D., Egilman, A. C., Gopal, A. D., Swami, N., Krumholz, H. M., & Ross, J. S. (2018) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0045-8 · Cited by 32 · see citing works
Quality Assessment of Reviewers’ Reports Using a Simple Instrument
Landkroon, A. P., Euser, A. M., Veeken, H., Hart, W., & Overbeke, A. J. P. M. (2006) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000231675.74957.48 · Cited by 31 · see citing works
Peer reviews of peer reviews: A randomized controlled trial and other experiments
Goldberg, A., Stelmakh, I., Cho, K., Oh, A., Agarwal, A., Belgrave, D., & Shah, N. B. (2025) · PLOS ONE · doi:10.1371/journal.pone.0320444 · Cited by 18 · see citing works
“The papers [KBY10, KHB13, Pap07, WKWC02, PMM + 21] all find that in authors’ evaluations of reviews on their own papers, the decision of accept or reject given by the reviewer is highly correlated with evaluation rating given by the authors.”
- Authors
- Weber, E. J., Katz, P. P., Waeckerle, J. F., & Callaham, M. L.
- Affiliations
- University of California, San Francisco (US)
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2002-06-05
- Volume
- 287
- Issue
- 21
- Pages
- 2790
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2065203120
- Cited by
- 140
- References
- 2
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 1 · 2023: 2 · 2021: 39 · 2020: 6 · 2019: 5 · 2018: 7 · 2017: 4 · 2016: 5 · 2015: 3 · 2014: 3 · 2013: 6 · 2012: 9
- FWCI
- 33.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Publishing and Scholarly Communication
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- peer review, author satisfaction, manuscript rejection, review quality, editorial communication, emergency medicine publishing
- MeSH terms
- Authorship, Data Collection, Personal Satisfaction, Quality Control, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review