Why do peer reviewers decline to review? A survey
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Background: Peer reviewers are usually unpaid and their efforts not formally acknowledged. Some journals have difficulty finding appropriate reviewers able to complete timely reviews, resulting in publication delay. Objectives and methods: A survey of peer reviewers from five biomedical journals was conducted to determine why reviewers decline to review and their opinions on reviewer incentives. Items were scored on 5-point Likert scales, with low scores indicating low importance or low agreement. Results: 551/890 (62%) reviewers responded. Factors rated most highly in importance for the decision to accept to review a paper included contribution of the paper to subject area (mean 3.67 (standard deviation (SD) 86)), relevance of topic to own work (mean 3.46 (SD 0.99)) and opportunity to learn something new (mean 3.41 (SD 0.96)). The most highly rated factor important in the decision to decline to review was conflict with other workload (mean 4.06 (SD 1.31)). Most respondents agreed that financial incentives would not be effective when time constraints are prohibitive (mean 3.59 (SD 1.01)). However, reviewers agreed that non-financial incentives might encourage reviewers to accept requests to review: free subscription to journal content (mean 3.72 (SD 1.04)), annual acknowledgement on the journal’s website (mean 3.64 (SD 0.90)), more feedback about the outcome of the submission (mean 3.62 (SD 0.88)) and quality of the review (mean 3.60 (SD 0.89), and appointment of reviewers to the journal’s editorial board (mean 3.57 (SD 0.99)). Conclusion: Reviewers are more likely to accept to review a manuscript when it is relevant to their area of interest. Lack of time is the principal factor in the decision to decline. Reviewing should be formally recognised by academic institutions and journals should acknowledge reviewers’ work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effect of Written Feedback by Editors on Quality of Reviews: Two Randomized Trials
Callaham, M. L., Knopp, R. K., & Gallagher, E. J. (2002) · JAMA · doi:10.1001/jama.287.21.2781 · Cited by 76
Cited by
Gender bias in scholarly peer review
Helmer, M., Schottdorf, M., Neef, A., & Battaglia, D. (2017) · eLife · doi:10.7554/elife.21718 · Cited by 380
“(Tite and Schroter, 2007) and it is possible that female scientists spend more time with duties”
BackgroundDuration and quality of the peer review process: the author’s perspective
Huisman, J., & Smits, J. (2017) · Scientometrics · doi:10.1007/s11192-017-2310-5 · Cited by 303
Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals
Hirst, A., & Altman, D. G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035621 · Cited by 200
“Peer reviewers are volunteers and difficult to recruit due to high workloads and competing time pressures”
BackgroundFox, C. W., & Burns, C. S. (2015) · Ecology and Evolution · doi:10.1002/ece3.1480 · Cited by 88
Glonti, K., Cauchi, D., Cobo, E., Boutron, I., Moher, D., & Hren, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1347-0 · Cited by 80
Overburdening of peer reviewers: a multi-stakeholder perspective on causes and effects
Severin, A., & Chataway, J. (2021) · Learned Publishing · doi:10.1002/leap.1392 · Cited by 73
“…overall sustainability of the peer review system (Kovanis et al., 2016) and standardized surveys that gauge overburdening of reviewers as one reason why scholars decline to review (Brannon et al., 2016; Djupe, 2015; Mulligan et al., 2013; Publons, 2018; Tite & Schroter, 2007; Ware, 2008a, 2008b).”
BackgroundGlonti, K., Boutron, I., Moher, D., & Hren, D. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-033421 · Cited by 69
“…of peer reviewers looking into the content of peer-reviewer reports on a large scale to inform meaningful training interventions and to improve existing journal policies and guidelines. twitter Ketevan Glonti @Keti_2012, Isabelle Boutron @BOUTRON1, David Moher @ dmoher and Darko Hren @HrenDarko”
BackgroundFreda, M. C., Kearney, M. H., Baggs, J. G., Broome, M. E., & Dougherty, M. (2009) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2008.08.007 · Cited by 59
Who is afraid of reviewers’ comments? Or, why anything can be published and anything can be cited
Ioannidis, J. P. A., Tatsioni, A., & Karassa, F. B. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2010.02272.x · Cited by 35
Biomedical journal speed and efficiency: a cross-sectional pilot survey of author experiences
Wallach, J. D., Egilman, A. C., Gopal, A. D., Swami, N., Krumholz, H. M., & Ross, J. S. (2018) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0045-8 · Cited by 32
Pranić, S. M., Malički, M., Marušić, S. L., Mehmani, B., & Marušić, A. (2021) · Learned Publishing · doi:10.1002/leap.1344 · Cited by 19
“Additionally, the impact factor of a journal could have played a role in the expectation level of the journal’s reviewers as Tite and Schroter (2007) found that surveyed reviewers highly rated their intention to review for prestigious journals.”
BackgroundPeer review trends in six fisheries science journals
Midway, S. R., Hendee, L., & Daugherty, D. J. (2024) · Research Integrity and Peer Review · doi:10.1186/s41073-024-00146-8 · Cited by 1
Do conspicuous manuscripts experience shorter time in the duration of peer review?
Zhang, G., Shang, F., Xie, W., Guo, Y., Jiang, C., & Wang, X. (2021) · arXiv · doi:10.48550/arxiv.2112.09360 · Cited by 1
Metadata
- Authors
- Tite, L., & Schroter, S.
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 2006-12-20
- Volume
- 61
- Issue
- 1
- Pages
- 9-12
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- OpenAlex
- W2142709701
- Cited by
- 192
- References
- 1
- FWCI
- 15.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.