Let’s make peer review scientific
Open accessThe DOI matches its Crossref record; 10 of the 11 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“very little is known about the performance of different review models (Rennie 2016)”
From The ability of different peer review procedures to flag problematic publications (2019) · cites this paper as Rennie 2016
Citations
Cites
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Publication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395
Measuring the effectiveness of scientific gatekeeping
Siler, K., Lee, K., & Bero, L. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418218112 · Cited by 333
Does Masking Author Identity Improve Peer Review Quality?: A Randomized Controlled Trial
Justice, A. C., Cho, M. K., Winker, M. A., Berlin, J. A., Rennie, D., & and the PEER Investigators (1998) · JAMA · doi:10.1001/jama.280.3.240 · Cited by 278
Self-citationJournal Peer Review: The Need for a Research Agenda
Bailar, J. C., & Patterson, K. (1985) · New England Journal of Medicine · doi:10.1056/nejm198503073121023 · Cited by 161
Guarding the Guardians: A Conference on Editorial Peer Review
Rennie, D. (1986) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1986.03380170107031 · Cited by 154
Self-citationReporting Randomized Controlled Trials: An Experiment and a Call for Responses From Readers
Rennie, D. (1995) · JAMA · doi:10.1001/jama.1995.03520370096044 · Cited by 81
Self-citationIs open peer review the fairest system? Yes
Groves, T. (2010) · BMJ · doi:10.1136/bmj.c6424 · Cited by 80
Data exchange standards to support and acknowledge peer‐review activity
Paglione, L., & Lawrence, R. N. (2015) · Learned Publishing · doi:10.1087/20150411 · Cited by 13
Cited by
The limitations to our understanding of peer review
Tennant, J. P., & Ross-Hellauer, T. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00092-1 · Cited by 384
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., et al. (2017) · F1000Research · doi:10.12688/f1000research.12037.1 · Cited by 289
Kovanis, M., Porcher, R., Ravaud, P., & Trinquart, L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166387 · Cited by 241
The state of the art in peer review
Tennant, J. P. (2018) · FEMS Microbiology Letters · doi:10.1093/femsle/fny204 · Cited by 164
“The key to maintaining this momentum will be sustained engagement with the different stakeholders to develop a more holistic framework of peer review, in which risk perception is minimised while the advantages are made much more explicit and evidence-based (Rennie 2016).”
BackgroundPeer Review Bias: A Critical Review
Haffar, S., Bazerbachi, F., & Murad, M. H. (2019) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2018.09.004 · Cited by 163
Metadata
- Authors
- Rennie, D.
- Affiliations
- United States Public Health Service (US)
- Corresponding author
- Rennie, Drummond
- Venue
- Nature
- Published
- 2016-07-05
- Volume
- 535
- Issue
- 7610
- Pages
- 31-33
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2461645408
- Cited by
- 111
- References
- 11
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 8 · 2023: 13 · 2022: 7 · 2021: 11 · 2020: 13 · 2019: 13 · 2018: 10 · 2017: 15 · 2016: 9
- FWCI
- 81.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- peer review, scholarly publishing, research evaluation, scholarly communication
- MeSH terms
- Double-Blind Method, Research Design, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.