The present and future of peer review: Ideas, interventions, and evidence
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
What is wrong with the peer review system? Is peer review sustainable? Useful? What other models exist? These are central yet contentious questions in today’s academic discourse. This perspective critically discusses alternative models and revisions to the peer review system. The authors highlight possible changes to the peer review system, with the goal of fostering further dialog among the main stakeholders, including producers and consumers of scientific research. Neither our list of identified issues with the peer review system nor our discussed resolutions are complete. A point of agreement is that fair assessment and efficient change would require more comprehensive and rigorous data on the various aspects of the peer review system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bornmann, L., & Mutz, R. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23329 · Cited by 1,576
The oligopoly of academic publishers in the digital era
Larivière, V., Haustein, S., & Mongeon, P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127502 · Cited by 1,240
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Peer Review: A Flawed Process at the Heart of Science and Journals
Smith, R. (2006) · Journal of the Royal Society of Medicine · doi:10.1177/014107680609900414 · Cited by 880
Reviewer bias in single- versus double-blind peer review
Tomkins, A., Zhang, M., & Heavlin, W. D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1707323114 · Cited by 605 · cited 1×
“…identity biases are apparent in some studies but not others For example, the journal Behavioural Ecology transitioned from single - blind to double - blind review and saw a significant increase in the acceptance rate for manuscripts with women first authors ( 32 ), but one review of 145…”
Double-blind review favours increased representation of female authors
BUDDEN, A., TREGENZA, T., AARSSEN, L., KORICHEVA, J., LEIMU, R., & LORTIE, C. (2008) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2007.07.008 · Cited by 552
The prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
Gender bias in scholarly peer review
Helmer, M., Schottdorf, M., Neef, A., & Battaglia, D. (2017) · eLife · doi:10.7554/elife.21718 · Cited by 380
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356 · cited 1×
“In psychological journals, for example, 18% of statistical results were found to be incorrectly reported (16), and the inconsistencies discovered in P - value reporting were demonstrated to affect conclusions once in every eight cases (17 NAN J I I N S ).”
The strain on scientific publishing
Hanson, M. A., Barreiro, P. G., Crosetto, P., & Brockington, D. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00327 · Cited by 345
The strain on scientific publishing
Hanson, M. A., Barreiro, P. G., Crosetto, P., & Brockington, D. (2023) · arXiv · doi:10.48550/arxiv.2309.15884 · Cited by 345
Gender differences in grant peer review: A meta-analysis
BORNMANN, L., MUTZ, R., & DANIEL, H. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2007.03.001 · Cited by 337
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
A billion-dollar donation: estimating the cost of researchers’ time spent on peer review
Aczel, B., Szaszi, B., & Holcombe, A. O. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00118-2 · Cited by 306
Self-citationBornmann, L., Mutz, R., & Daniel, H.-D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014331 · Cited by 290
Effect of Blinded Peer Review on Abstract Acceptance
Ross, J. S., Gross, C. P., Desai, M. M., Hong, Y., Grant, A. O., Daniels, S. R., Hachinski, V. C., Gibbons, R. J., Gardner, T. J., & Krumholz, H. M. (2006) · JAMA · doi:10.1001/jama.295.14.1675 · Cited by 250
COMPare: a prospective cohort study correcting and monitoring 58 misreported trials in real time
Goldacre, B., Drysdale, H., Dale, A., Milosevic, I., Slade, E., Hartley, P., Marston, C., Powell-Smith, A., Heneghan, C., & Mahtani, K. R. (2019) · Trials · doi:10.1186/s13063-019-3173-2 · Cited by 233 · cited 1×
“Many studies highlight poor reporting of research outcomes and details of statistical analyses (18–21) and reported results being irreproducible from the data (22).”
Pineau, J., Vincent-Lamarre, P., Sinha, K., Larivière, V., Beygelzimer, A., d'Alché-Buc, F., Fox, E., & Larochelle, H. (2020) · arXiv · doi:10.48550/arxiv.2003.12206 · Cited by 232 · cited 2×
“Some journals (and leading AI conferences) have added reproducibility checklists as part of the paper submission process, which aims to increase the reliability of research findings, including items related to experimental design, sta - tistical model evaluation, and model calibration ( 48 ).”
Bruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0631-5 · Cited by 218 · cited 2×
“Another systematic review ( 64 ) of 22 randomized trials concluded that the largest improve - ment in manuscript quality (e.g., clarity of the empirical report) was seen with the addition of a statistical reviewer ( 72 , 73 ) It also found that some interventions affected the rejection rate, in…”
The changing forms and expectations of peer review
Horbach, S. P. J. M., & Halffman, W. (. W. (2018) · Research Integrity and Peer Review · doi:10.1186/s41073-018-0051-5 · Cited by 179 · cited 1×
“Lately, issues related to the reproducibility crisis and increased scientific fraud have been partially attributed to poor - quality peer reviews that provide insufficient scrutiny (15).”
The devil is in the details: incomplete reporting in preclinical animal research
Avey, M. T., Moher, D., Sullivan, K. J., Fergusson, D., Griffin, G., Grimshaw, J. M., Hutton, B., Lalu, M. M., Macleod, M., Marshall, J., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166733 · Cited by 130
Hidden concerns of sharing research data by low/middle-income country scientists
Bezuidenhout, L., & Chakauya, E. (2018) · Global Bioethics · doi:10.1080/11287462.2018.1441780 · Cited by 126
Publons' Global State Of Peer Review 2018
Publons (2018) · doi:10.14322/publons.gspr2018 · Cited by 79
the COVID-19 NMA Consortium, Oikonomidi, T., Boutron, I., Pierre, O., Cabanac, G., & Ravaud, P. (2020) · BMC Medicine · doi:10.1186/s12916-020-01880-8 · Cited by 54 · cited 1×
“These changes may reflect the impact of both preprint peer review and journal peer review (if preprints are posted before journal peer review), and they suggest that review makes little difference .”
Dondio, P., Casnici, N., Grimaldo, F., Gilbert, N., & Squazzoni, F. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2019.03.018 · Cited by 48
Speich, B., Mann, E., Schönenberger, C. M., Mellor, K., Griessbach, A. N., Dhiman, P., Gandhi, P., Lohner, S., Agarwal, A., Odutayo, A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.17651 · Cited by 41
Moher, D., & Ravaud, P. (2016) · BMC Medicine · doi:10.1186/s12916-016-0707-2 · Cited by 8
Cited by
Large language models in peer review: challenges and opportunities
Sun, Z. (2025) · Scientometrics · doi:10.1007/s11192-025-05440-w · Cited by 15
Reproducibility failure in biomedical research: problems and solutions
Haven, T. L., & Ioannidis, J. P. A. (2026) · Annual Review of Medicine · doi:10.1146/annurev-med-050124-050859 · Cited by 9
Self-citationErvens, B., Carslaw, K. S., Koop, T., & Pöschl, U. (2025) · EGUsphere · doi:10.5194/egusphere-2025-419 · Cited by 5
Patel, R., Shultz, C., Ollivier, M., & Wascher, D. C. (2026) · The American Journal of Sports Medicine · doi:10.1177/03635465261463006 · Cited by 3
Do Methods Support the Claims? Intra-Paper Verification for Peer Review
Ballakuraya, R. S., Mahyari, A., & Srinivasan, A. (2026) · arXiv · doi:10.48550/arxiv.2607.26066
“This structural imbalance has contributed to reviewer overload, reviewer scarcity, prolonged evaluation cycles, and concerns regarding the consistency and sustainability of peer review [2], [3].”
Metadata
- Authors
- Aczel, B., Barwich, A.-S., Diekman, A. B., Fishbach, A., Goldstone, R. L., Gomez, P., Gundersen, O. E., von Hippel, P. T., Holcombe, A. O., Lewandowsky, S., Nozari, N., Pestilli, F., & Ioannidis, J. P. A.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2025-01-27
- Volume
- 122
- Issue
- 5
- Pages
- e2401232121-e2401232121
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W4406855471
- Cited by
- 87
- References
- 29
- FWCI
- 308.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.