The DOI matches its Crossref record.
An Incentive Solution to the Peer Review Problem
Open accessAbstract
Every researcher knows the experience: you send a manuscript in for review and it disappears into the ether as you wait, a painfully long time, for the review. As scientists, we want immediate gratification: either accept or reject. This enables us to move on with our work, building on prior findings. Alas, the review process doesn't work this way, and from our perspective, seems to have deteriorated further over the years, even with the improvements that the Internet has brought forward. Some people review quickly, while others do not. And yet, there are no rewards for the swift or punishments for the slackers. We would like to propose a solution based on the logic of incentives to stimulate discussion, while also appreciating the complexities of incentive provisions. As such, we see this letter as an opening card in a game that we hope will help us attain a better equilibrium, one from which an improved system of incentives for refereeing emerges. All journal editors maintain databases of reviewers and, thus, have details of their histories, including when an individual received a manuscript for review, the suggested deadline for review, and the date of the submitted review. Further, all journals have requirements for a timely review. Here's a proposed solution to the problem that some individuals review swiftly and others, extremely slowly. Whenever a reviewer sends in a review, the date is logged, as is common practice. Next to the date the editor enters a positive or negative value that indicates the relative timeliness of the review: negative values for reviews arriving before the deadline, and positive values for those arriving afterwards. Reviewers that turn in their reviews late are punished, whereas those that arrive on time are rewarded. To make the punishments count, and hopefully curtail future transgressions, we recommend the following policy for reviewers who turn in their reviews late: for every day since receipt of the manuscript for review plus the number of days past the deadline, the reviewer's next personal submission to the journal will be held in editorial limbo for twice as long before it is sent for review. To illustrate, consider a reviewer who is given three weeks to review and turns his review in two weeks after the deadline. The total review time for this reviewer is five weeks. The punishment is 10 weeks, meaning that his next submission sits in the editorial office for ten weeks before being sent out for review. Journals reward timely reviewers by sending their manuscripts out for review as soon as they come in, and if accepted, by pushing their papers high up into the publication queue. Several problems immediately suggest themselves, and we address some of these here. First, in the case of multi-authored papers, only the primary corresponding author should trigger a punishment or reward assignment. Second, though we realize that the timely reviewer is only gaining what should be the normal state of affairs, our intuition is that it is the cost to the negligent reviewer that is most important. Given the documented benefits of punishment in a variety of cooperation games, we imagine that this policy might well speed up the review process and curtail the number of slackers. Third, if a given reviewer is the kind of person who rarely gets reviews in on time, he or she could exploit this system by simply refusing to review, or by sending in a less than helpful review, thereby avoiding the costs altogether. To close this loophole, we would add a further cost: for every manuscript that a reviewer refuses to review, we add on a one-week delay to reviewing their own next submission. Thus, if a reviewer rejects two consecutive manuscripts for review, his next submission sits in editorial limbo for two weeks. As for unhelpful reviews, these occur even with the present system, and it is an empirical question as to whether the rates would increase under the proposed review process. If they did, we would propose some minimal criteria for a useful review; anything less would be subject to the same penalty as proposed for opting out of review. For reviewers who opt out or turn in insufficient reviews, the only way to break the cycle of penalties is by providing a substantive review for the journal. Fourth, journals may worry that by implementing this policy, they might lose manuscripts from some of the more interesting scientists, who may happen to be slow reviewers; we fully recognize the distinct possibility that there probably isn't a strong positive correlation between the quality of scientific research and the timeliness of reviews. But given the hierarchies among journals in every field, as well as the diversity of options, we don't expect this to be a significant problem for most journals. For the proposed system to work, the journals must fully commit to this policing policy. Journal editors may sometimes be tempted to violate this policy, in order to clear the man
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Homage to Linnaeus: How many parasites? How many hosts?
Dobson, A., Lafferty, K. D., Kuris, A. M., Hechinger, R. F., & Jetz, W. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803232105 · Cited by 760
DNA damage response and cellular senescence in tissues of aging mice
Wang, C., Jurk, D., Maddick, M., Nelson, G., Martin‐Ruiz, C., & Von Zglinicki, T. (2009) · Aging Cell · doi:10.1111/j.1474-9726.2009.00481.x · Cited by 696
Mucins: A biologically relevant glycan barrier in mucosal protection
Corfield, A. P. (2015) · Biochimica et Biophysica Acta (BBA) - General Subjects · doi:10.1016/j.bbagen.2014.05.003 · Cited by 568
The validation of an active control intervention for Mindfulness Based Stress Reduction (MBSR)
MacCoon, D. G., Imel, Z. E., Rosenkranz, M. A., Sheftel, J. G., Weng, H. Y., Sullivan, J. C., Bonus, K. A., Stoney, C. M., Salomons, T. V., Davidson, R. J., et al. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.10.011 · Cited by 335
Metadata
- Authors
- Hauser, M., & Fehr, E.
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-04-17
- Volume
- 5
- Issue
- 4
- Pages
- e107
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- OpenAlex
- W2143616301
- Cited by
- 175
- References
- 0
- FWCI
- 117.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Incentive Solution to the Peer Review Problem. https://app.cochat.ai/papers/10.1371/journal.pbio.0050107
- The paper
- Hauser, M., & Fehr, E. (2007). An Incentive Solution to the Peer Review Problem. PLoS Biology. https://doi.org/10.1371/journal.pbio.0050107
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.