Let’s make peer review scientific
Open accessThe DOI matches its Crossref record; 10 of the 11 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“very little is known about the performance of different review models (Rennie 2016)”
From The ability of different peer review procedures to flag problematic publications (2019) · cites this paper as Rennie 2016
Citations
Cites
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Publication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395
Measuring the effectiveness of scientific gatekeeping
Siler, K., Lee, K., & Bero, L. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418218112 · Cited by 333
Does Masking Author Identity Improve Peer Review Quality?: A Randomized Controlled Trial
Justice, A. C., Cho, M. K., Winker, M. A., Berlin, J. A., Rennie, D., & and the PEER Investigators (1998) · JAMA · doi:10.1001/jama.280.3.240 · Cited by 278
Self-citationJournal Peer Review: The Need for a Research Agenda
Bailar, J. C., & Patterson, K. (1985) · New England Journal of Medicine · doi:10.1056/nejm198503073121023 · Cited by 161
Guarding the Guardians: A Conference on Editorial Peer Review
Rennie, D. (1986) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1986.03380170107031 · Cited by 154
Self-citationReporting Randomized Controlled Trials: An Experiment and a Call for Responses From Readers
Rennie, D. (1995) · JAMA · doi:10.1001/jama.1995.03520370096044 · Cited by 81
Self-citationIs open peer review the fairest system? Yes
Groves, T. (2010) · BMJ · doi:10.1136/bmj.c6424 · Cited by 80
Data exchange standards to support and acknowledge peer‐review activity
Paglione, L., & Lawrence, R. N. (2015) · Learned Publishing · doi:10.1087/20150411 · Cited by 13
Cited by
Items 101–110 of 110
Agentia Nationala de Asigurare a Calitatii in Educatie si Cercetare, R. M., & Cuciureanu, G. (2021) · Akademos · doi:10.52673/18570461.21.2-61.01 · Cited by 1
(2023) · Elsevier eBooks · doi:10.1016/b978-0-443-10715-3.16001-9
Guérin, S. M. R., Tarlao, C., & Karabay, A. (2024) · Science Editing · doi:10.6087/kcse.345
Transparency and Accountability Initiatives in Peer Review: Principles and Reform Strategies
(2024) · Advances in medical education, research, and ethics (AMERE) book series · doi:10.4018/979-8-3693-3828-5.ch008
Peer review training: A catalyst for quality Physiotherapy research
Kasi, M., Nair, S. P., Ganvir, S., & Ramanandi, V. H. (2025) · Physiotherapy - The Journal of Indian Association of Physiotherapists · doi:10.4103/pjiap.pjiap_48_25
Bössel, N., Kluge, A., Leising, D., Mischkowski, D., Phan, L. V., Richter, F., Schmitt, M., & Stähl, J. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xj2m6_v2 · Cited by 1
Teaching early-career researchers how to respond to peer reviewers
Kalkhoven, E., & Kluijtmans, M. (2026) · eLife · doi:10.7554/elife.102619
Reducing bias in the evaluation of scientific posters and oral presentations
Carter, T. L., Howell, R. M., Gillispie, E. C., Kailer, E. L., Scott, J. G., Wiley, Z., & Chapman, S. (2026) · Natural sciences education · doi:10.1002/nse2.70064
“These data are typically collected at the grant application or individual journal scale, limiting insight into broader, system-level dynamics of bias (Murray et al., 2016; Rennie, 2016; Tennant & Ross-Hellauer, 2020).”
Generative AI in peer review: evolving policies and regulatory pathways for scientific rigour
Jozaghi, E. (2026) · AI and Ethics · doi:10.1007/s43681-026-01394-8
“Although peer review remains central, it has long been criticized for potential bias, limited transparency, inefficiencies, and variability in manuscript evalua - tion [19, 28, 32, 36 ].”
The Epistemic Disclosure Framework: Preserving Scientific Novelty through Peer Review
Raina, S. K., Kumar, R., & Jha, K. (2026) · Journal of Applied Sciences and Clinical Practice · doi:10.4103/jascp.jascp_49_26
Metadata
- Authors
- Rennie, D.
- Affiliations
- United States Public Health Service (US)
- Corresponding author
- Rennie, Drummond
- Venue
- Nature
- Published
- 2016-07-05
- Volume
- 535
- Issue
- 7610
- Pages
- 31-33
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2461645408
- Cited by
- 111
- References
- 11
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 8 · 2023: 13 · 2022: 7 · 2021: 11 · 2020: 13 · 2019: 13 · 2018: 10 · 2017: 15 · 2016: 9
- FWCI
- 81.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- peer review, scholarly publishing, research evaluation, scholarly communication
- MeSH terms
- Double-Blind Method, Research Design, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.