The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise
Open accessAbstract
The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Development of Open Access Journal Publishing from 1993 to 2009
Laakso, M., Welling, P., Bukvova, H., Nyman, L., Björk, B.-C., & Hedlund, T. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020961 · Cited by 755
Peer review in a changing world: An international study measuring the attitudes of researchers
Mulligan, A., Hall, L., & Raphael, E. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22798 · Cited by 393
Bruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0631-5 · Cited by 218
Self-citationAlberts, B., Hanson, B., & Kelner, K. L. (2008) · Science · doi:10.1126/science.1162115 · Cited by 119
Let’s make peer review scientific
Rennie, D. (2016) · Nature · doi:10.1038/535031a · Cited by 111
Peer review for biomedical publications: we can improve the system
Stahel, P. F., & Moore, E. E. (2014) · BMC Medicine · doi:10.1186/s12916-014-0179-1 · Cited by 103
Modelling the effects of subjective and objective decision making in scientific peer review
Park, I.-U., Peacey, M. W., & Munafò, M. R. (2014) · Nature · doi:10.1038/nature12786 · Cited by 103
Reviewer Fatigue? Why Scholars Decline to Review their Peers’ Work
Breuning, M., Backstrom, J., Brannon, J., Gross, B. I., & Widmeier, M. (2015) · Political Science and Politics · doi:10.1017/s1049096515000827 · Cited by 89
Cited by
Meta-research: Why research on research matters
Ioannidis, J. P. A. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005468 · Cited by 314
A billion-dollar donation: estimating the cost of researchers’ time spent on peer review
Aczel, B., Szaszi, B., & Holcombe, A. O. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00118-2 · Cited by 306
Liang, W., Zhang, Y., Cao, H., Wang, B., Ding, D., Yang, X., Vodrahalli, K., He, S., Smith, D., Yin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.01783 · Cited by 243
The changing forms and expectations of peer review
Horbach, S. P. J. M., & Halffman, W. (. W. (2018) · Research Integrity and Peer Review · doi:10.1186/s41073-018-0051-5 · Cited by 179
Systematic examination of preprint platforms for use in the medical and biomedical sciences setting
Kirkham, J. J., Penfold, N. C., Murphy, F., Boutron, I., Ioannidis, J. P., Polka, J., & Moher, D. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-041849 · Cited by 112
Metadata
- Authors
- Kovanis, M., Porcher, R., Ravaud, P., & Trinquart, L.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-11-10
- Volume
- 11
- Issue
- 11
- Pages
- e0166387
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2551122076
- Cited by
- 241
- References
- 8
- FWCI
- 109.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise. https://app.cochat.ai/papers/10.1371/journal.pone.0166387
- The paper
- Kovanis, M., Porcher, R., Ravaud, P., & Trinquart, L. (2016). The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise. PLOS ONE. https://doi.org/10.1371/journal.pone.0166387
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.