Let’s make peer review scientific
Open accessThe DOI matches its Crossref record; 10 of the 11 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“very little is known about the performance of different review models (Rennie 2016)”
From The ability of different peer review procedures to flag problematic publications (2019) · cites this paper as Rennie 2016
Citations
Cites
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Publication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395
Measuring the effectiveness of scientific gatekeeping
Siler, K., Lee, K., & Bero, L. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418218112 · Cited by 333
Does Masking Author Identity Improve Peer Review Quality?: A Randomized Controlled Trial
Justice, A. C., Cho, M. K., Winker, M. A., Berlin, J. A., Rennie, D., & and the PEER Investigators (1998) · JAMA · doi:10.1001/jama.280.3.240 · Cited by 278
Self-citationJournal Peer Review: The Need for a Research Agenda
Bailar, J. C., & Patterson, K. (1985) · New England Journal of Medicine · doi:10.1056/nejm198503073121023 · Cited by 161
Guarding the Guardians: A Conference on Editorial Peer Review
Rennie, D. (1986) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1986.03380170107031 · Cited by 154
Self-citationReporting Randomized Controlled Trials: An Experiment and a Call for Responses From Readers
Rennie, D. (1995) · JAMA · doi:10.1001/jama.1995.03520370096044 · Cited by 81
Self-citationIs open peer review the fairest system? Yes
Groves, T. (2010) · BMJ · doi:10.1136/bmj.c6424 · Cited by 80
Data exchange standards to support and acknowledge peer‐review activity
Paglione, L., & Lawrence, R. N. (2015) · Learned Publishing · doi:10.1087/20150411 · Cited by 13
Cited by
The limitations to our understanding of peer review
Tennant, J. P., & Ross-Hellauer, T. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00092-1 · Cited by 384
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., et al. (2017) · F1000Research · doi:10.12688/f1000research.12037.1 · Cited by 289
Kovanis, M., Porcher, R., Ravaud, P., & Trinquart, L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166387 · Cited by 241
The state of the art in peer review
Tennant, J. P. (2018) · FEMS Microbiology Letters · doi:10.1093/femsle/fny204 · Cited by 164
“The key to maintaining this momentum will be sustained engagement with the different stakeholders to develop a more holistic framework of peer review, in which risk perception is minimised while the advantages are made much more explicit and evidence-based (Rennie 2016).”
BackgroundPeer Review Bias: A Critical Review
Haffar, S., Bazerbachi, F., & Murad, M. H. (2019) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2018.09.004 · Cited by 163
Assessment of potential bias in research grant peer review in Canada
Tamblyn, R. M., Girard, N., Qian, C. J., & Hanley, J. A. (2018) · Canadian Medical Association Journal · doi:10.1503/cmaj.170901 · Cited by 157
Langfeldt, L., Nedeva, M., Sörlin, S., & Thomas, D. A. (2020) · Minerva · doi:10.1007/s11024-019-09385-2 · Cited by 148
“…and choice of criteria (and proxies) can have a large impact on resource allocations and impact various local quality notions 5 A comment in Nature, summing up conclusions from the literature, states that “how and whether peer review identifies high-quality science is unknown” (Rennie 2016: 31).”
BackgroundHarris, M., Marti, J., Watt, H., Bhatti, Y., Macinko, J., & Darzi, A. W. (2017) · Health Affairs · doi:10.1377/hlthaff.2017.0773 · Cited by 119
Tools used to assess the quality of peer review reports: A methodological systematic review
Superchi, C., González, J. A., Solà, I., Cobo, E., Hren, D., & Boutron, I. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0688-x · Cited by 128
The ability of different peer review procedures to flag problematic publications
Horbach, S. P. J. M., & Halffman, W. (2019) · Scientometrics · doi:10.1007/s11192-018-2969-2 · Cited by 73
“In fact, while various actors have been calling for ‘evidence-based’ improvements of the peer review system, very little is known about the performance of different review models (Rennie 2016).”
BackgroundHow to improve scientific peer review: four schools of thought
Waltman, L., Kaltenbrunner, W., Pinfield, S., & Woods, H. B. (2023) · Learned Publishing · doi:10.1002/leap.1544 · Cited by 71
“We hope that the different stakeholders will intensify their efforts to study the peer review system (Rennie, 2016; Squazzoni et al., 2020), to experiment with new forms of peer review, and to introduce improved peer review practices and policies.”
BackgroundKovanis, M., Trinquart, L., Ravaud, P., & Porcher, R. (2017) · Scientometrics · doi:10.1007/s11192-017-2375-1 · Cited by 70
“…number of papers submitted for publication, which puts pressure on the system (Bohannon 2013; Hopewell et al. 2014; Arns 2014; Jennings 2006; Mulligan et al. 2013; Nicholas et al. 2015; Rennie 2016; Sense About Science 2012; Siler et al. 2015; Walker and Rocha da Silva 2015b; Kovanis et al. 2016b).”
BackgroundPeer review analyze: A novel benchmark resource for computational analysis of peer reviews
Ghosal, T., Kumar, S., Bharti, P. K., & Ekbal, A. (2022) · PLOS ONE · doi:10.1371/journal.pone.0259238 · Cited by 66
Predatory publishers’ latest scam: bootlegged and rebranded papers
Siler, K., Vincent-Lamarre, P., Sugimoto, C. R., & Larivière, V. (2021) · Nature · doi:10.1038/d41586-021-02906-8 · Cited by 47
Unlock ways to share data on peer review
Squazzoni, F., Ahrweiler, P., Barros, T. F., Bianchi, F., Birukou, A., Blom, H. J. J., Bravo, G., Cowley, S. J., Dignum, V., Dondio, P., et al. (2020) · Nature · doi:10.1038/d41586-020-00500-y · Cited by 55
Fragments of peer review: A quantitative analysis of the literature (1969-2015)
Grimaldo, F., Marušić, A., & Squazzoni, F. (2018) · PLOS ONE · doi:10.1371/journal.pone.0193148 · Cited by 55
Peer Review: A System under Stress
Gropp, R. E., Glisson, S., Gallo, S., & Thompson, L. (2017) · BioScience · doi:10.1093/biosci/bix034 · Cited by 49
Optimizing peer review to minimize the risk of retracting COVID-19-related literature
da Silva, J. A. T., Bornemann‐Cimenti, H., & Tsigaris, P. (2020) · Medicine Health Care and Philosophy · doi:10.1007/s11019-020-09990-z · Cited by 52
Irreproducibility of published bioscience research: Diagnosis, pathogenesis and therapy
Flier, J. S. (2016) · Molecular Metabolism · doi:10.1016/j.molmet.2016.11.006 · Cited by 49
“This could allow us to determine which review and editorial policies actually promote reproducibility and quality of published papers [53].”
BackgroundThree Decades of Peer Review Congresses
Rennie, D., & Flanagin, A. (2018) · JAMA · doi:10.1001/jama.2017.20606 · Cited by 38
Self-citationImproving University Faculty Evaluations via multi-view Knowledge Graph
Lin, Q., Zhu, Y., Lü, H., Shi, K., & Niu, Z. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.11.021 · Cited by 43
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., et al. (2017) · F1000Research · doi:10.12688/f1000research.12037.2 · Cited by 38
Ethics of reviewing scientific publications
Napolitani, F., Petrini, C., & Garattini, S. K. (2016) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2016.12.011 · Cited by 33
Наукометрія та управління науковою діяльністю: вкотре про світове та українське
Мриглод, О. І., & Nazarovets, S. (2019) · Visnik Nacional noi academii nauk Ukrai ni · doi:10.15407/visn2019.09.081 · Cited by 39
Towards theorizing peer review
Hug, S. E. (2022) · Quantitative Science Studies · doi:10.1162/qss_a_00195 · Cited by 38
“…and provide more funding for peer review research (Azoulay & Li, 2020; Bendiscioli, 2019; Bendiscioli et al., 2021; Ioannidis et al., 2019; Lauer & Nakamura, 2015; Lee&Moher, 2017; Rennie, 2016; Severin & Egger, 2021; Squazzoni et al., 2020; Tennant et al., 2017; Tennant & Ross-Hellauer, 2020).”
Risk evaluation in peer review of grant applications
Gallo, S. A., THOMPSON, L. A., Schmaling, K. B., & Glisson, S. R. (2018) · Environment Systems & Decisions · doi:10.1007/s10669-018-9677-6 · Cited by 37
“In fact, only recently has there been a widespread call for a more robust and complete evidence base upon which to drive policy regarding the peer review of grant applications (Lauer and Nakamura 2015; Bohannon 2013; Rennie 2016).”
BackgroundSuperchi, C., Hren, D., Blanco, D., Rius, R., Recchioni, A., Boutron, I., & González, J. A. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035604 · Cited by 35
Connecting Chemistry to Social Justice in a Seminar Course for Chemistry Majors
Gerdon, A. E. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c01043 · Cited by 28
Wolfram, D., Wang, P., & Abuzahra, F. (2021) · Research Evaluation · doi:10.1093/reseval/rvab005 · Cited by 31
Challenges and Controversies in Peer Review
Kusumoto, F. M., Bittl, J. A., Creager, M. A., Dauerman, H. L., Lala, A., McDermott, M. M., Turco, J. V., Taqueti, V. R., & Fuster, V. (2023) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2023.08.056 · Cited by 41
Ioannidis, J. P. A., Berkwits, M., Flanagin, A., & Bloom, T. (2023) · JAMA · doi:10.1001/jama.2023.17607 · Cited by 25
Glonti, K., & Hren, D. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020568 · Cited by 28
The Participation and Motivations of Grant Peer Reviewers: A Comprehensive Survey
Gallo, S. A., THOMPSON, L. A., Schmaling, K. B., & Glisson, S. R. (2019) · Science and Engineering Ethics · doi:10.1007/s11948-019-00123-1 · Cited by 21
“While there has been a steady increase in data-driven literature on grant peer review in recent years, there are still many key operational parameters that have yet to be characterized (Rennie 2016).”
BackgroundPeer Review in a General Medical Research Journal Before and During the COVID-19 Pandemic
Perlis, R. H., Kendall-Taylor, J., Hart, K. L., Ganguli, I., Berlin, J. A., Bradley, S. M., Haneuse, S., Inouye, S. K., Jacobs, E. A., Morris, A. M., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.53296 · Cited by 19
Triple-blind review as a solution to gender bias in academic publishing, a theoretical approach
Conklin, M., & Singh, S. (2022) · Studies in Higher Education · doi:10.1080/03075079.2022.2081681 · Cited by 20
“The publication of false data (Rennie 2016) .”
BackgroundThe effectiveness of peer review in identifying issues leading to retractions
Zheng, X. M., Chen, J., Tollas, A., & Ni, C. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101423 · Cited by 23
Bolek, M., Bolek, C., Shopovski, J., & Marolov, D. (2022) · Accountability in Research · doi:10.1080/08989621.2022.2030719 · Cited by 17
“We agree with the statement that any research on the topic that can improve the peer review process should be considered as highly important (Rennie 2016).”
BackgroundOpen Peer Review in Scientific Publishing: A Web Mining Study of PeerJ Authors and Reviewers
Wang, P., You, S., Rath, M., & Wolfram, D. (2016) · Journal of Data and Information Science · doi:10.20309/jdis.201625 · Cited by 22
The analysis of living systems can generate both knowledge and illusions
Jose, A. M. (2020) · eLife · doi:10.7554/elife.56354 · Cited by 14
“Experiments are underway on the process of peer review (Rennie, 2016; Rodgers, 2017; Polka et al., 2018), with a number of journals opting to publish all exchanges between authors and reviewers to improve transparency (see, for example, Nature, 2020).”
BackgroundA large scale randomized controlled trial on herding in peer-review discussions
Stelmakh, I., Rastogi, C., Shah, N. B., Singh, A., & Daumé, H. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287443 · Cited by 30
Scholarly publishing depends on peer reviewers
reviewers, P. P. 2. P., & Fernandez-Llimos, F. (2018) · Pharmacy Practice · doi:10.18549/pharmpract.2018.01.1236 · Cited by 15
Using the peer review process to educate and empower emerging nurse scholars
Trotter, T. L. (2020) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2020.10.009 · Cited by 16
Wu, W., Xi, H., & Zhang, C. (2024) · Scientometrics · doi:10.1007/s11192-024-05070-8 · Cited by 12
“Currently, many pioneers have already opened up their peer review content, such as OpenReview [8] and others.”
Li, P.-S., Thomas, D. C., & Saunders, R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143481 · Cited by 11
Zhang, G., Wang, L., Xie, W., Shang, F., Xia, X., Jiang, C., & Wang, X. (2021) · Aslib Journal of Information Management · doi:10.1108/ajim-06-2021-0172 · Cited by 14
Higher expertise, pedagogic rights and the post-truth society
Hordern, J. (2019) · Teaching in Higher Education · doi:10.1080/13562517.2018.1532957 · Cited by 12
“The various criticisms of bias in peer review, and instances of the variable or inconsistent scrutiny of new knowledge claims (Rennie 2016), suggests that disciplinary ‘health’ can vary.”
BackgroundReviewing Manuscripts: A Systematic Approach
Sucato, G. S., & Holland-Hall, C. M. (2018) · Journal of Pediatric and Adolescent Gynecology · doi:10.1016/j.jpag.2018.06.005 · Cited by 11
Jones, C. W., Adams, A., Misemer, B. S., Weaver, M. A., Schroter, S., Khan, H., Margolis, B., Schriger, D. L., & Platts-Mills, T. F. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-066624 · Cited by 10
Improving Scientific Judgments in Law and Government: A Field Experiment of Patent Peer Review
Ho, D. E., & Ouellette, L. L. (2020) · Journal of Empirical Legal Studies · doi:10.1111/jels.12249 · Cited by 12
“Whether peer review functions as intended even within scientific domains remains empirically unclear (Bornmann, 2011; Cole et al., 1981; Jeffer- son et al. 2002; Li & Agha 2015; Smith 2006; Rennie 2016; Bohannon 2013).”
BackgroundWho is the author: genuine, honorary, ghost, gold, and fake authors?
Picano, E. (2024) · Exploration of Cardiology · doi:10.37349/ec.2024.00024 · Cited by 12
Peer Review – the future is here
Papatriantafyllou, M. (2017) · FEBS Letters · doi:10.1002/1873-3468.12792 · Cited by 9
“6 Rennie D (2016) Let’s make peer review scientific.”
How to peer review and revise manuscripts submitted for publication in academic nursing journals
Kottner, J., & Norman, I. J. (2016) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2016.09.011 · Cited by 9
Squazzoni, F., Bravo, G., Dondio, P., Farjam, M., Marušić, A., Mehmani, B., Willis, M., Birukou, A., & Grimaldo, F. (2020) · doi:10.31235/osf.io/gh4rv · Cited by 9
A harm reduction approach to improving peer review by acknowledging its imperfections
Cooke, S. J., Young, N., Peiman, K. S., Roche, D. G., Clements, J. C., Kadykalo, A. N., Provencher, J. F., Raghavan, R., DeRosa, M. C., Lennox, R. J., et al. (2024) · FACETS · doi:10.1139/facets-2024-0102 · Cited by 12
“However, despite researcher confidence in the peer review process, its effectiveness is dif-ficult to assess (Jefferson et al. 2002; Bruce et al. 2016; Rennie 2016; Helmer et al. 2017; Lee and Moher 2017; Squazzoni et al. 2020; Squazzoni et al. 2021; Garcia-Costa et al. 2022) and the sheer number of…”
Peer reviewers’ conflicts of interest in biomedical research: scoping review
Korfitsen, C. B., Nejstgaard, C. H., Hróbjartsson, A., Boutron, I., Bero, L. A., & Lundh, A. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-112967 · Cited by 10
Open Peer Review in the Era of Open Science: A Pilot Study of Researchers' Perceptions
Rath, M., & Wang, P. (2017) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl.2017.7991608 · Cited by 12
Taking advantage of unexpected WebCONSORT results
Cobo, E., & González, J. A. (2016) · BMC Medicine · doi:10.1186/s12916-016-0758-4 · Cited by 7
“In order to assess what goes wrong along the research pipeline, the clinical scientific community, led by JAMA and BMJ, organises the quadrennial Congress on Peer Review in Biomedical Publication, which is devoted to improving the quality of biomedical literature [8, 9].”
BackgroundModel of environmental management science based on circular economy theory
Cheng, Y., & Ji-chao, X. (2021) · Ecological Chemistry and Engineering S · doi:10.2478/eces-2021-0034 · Cited by 9
Horbach, S. P. J. M., Hepkema, W. M., & Halffman, W. (2020) · Learned Publishing · doi:10.1002/leap.1312 · Cited by 7
“Several actors have therefore urged for more research on review formats, acknowledging that a lack of data is one of the main barriers to such research (Rennie, 2016; Squazzoni et al., 2020).”
BackgroundBharti, P. K., Agarwal, M., & Ekbal, A. (2024) · Scientometrics · doi:10.1007/s11192-024-04938-z · Cited by 6
“As a result, scientomet-ric researchers have taken an interest in studying various aspects of the peer review process, such as its effectiveness, reliability, and potential biases (Siler et al., 2015; Jubb, 2016; Rennie, 2016; Seeber & Bacchelli, 2017).”
Rastogi, C., Stelmakh, I., Beygelzimer, A., Dauphin, Y., Liang, P., Vaughan, J. W., Xue, Z., Daumé, H., Pierson, E., & Shah, N. B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300710 · Cited by 17
“However, a number of studies have documented low agreement among reviewers [1–7], and researchers often lament various problems with peer review [8–10].”
A Blockchain Cloud Computing Middleware for Academic Manuscript Submission
Gazis, A., Anagnostakis, G., Kourmpetis, S., & Katsiri, E. (2022) · WSEAS TRANSACTIONS ON BUSINESS AND ECONOMICS · doi:10.37394/23207.2022.19.51 · Cited by 7
“In this study, we have examined a recent bibliography regarding the pros and cons of the peer-review part of a system and its limitations [7],”
MethodQuality standards and training are important in the peer review process, but what about engagement?
Jordan, P. J. (2020) · Industrial and Organizational Psychology · doi:10.1017/iop.2020.10 · Cited by 6
“…at a time when many researchers and some editors are claiming the peer review process is broken with observations of the impact of human frailties (Rennie, 2016), that the peer review system is unsustainable (Kovanis, Porcher, Ravaud, & Trinquart, 2016), and that the system exploits academics…”
BackgroundGuardia, C. M. A., Kane, E. E., Tebo, A. G., Sanders, A. A. W. M., Kaya, D., & Grogan, K. E. (2023) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2023.0124 · Cited by 5
“Peer review programs are most well-known from their use in manuscripts (Rennie 2016, Tennant et al. 2017, Tennant & Ross-Hellauer 2020, but see Haffer et al. 2019, Murray et al. 2018) and grant application review (Azoulay & Li 2020, Demicheli et al. 2007, Marsh et al. 2009 but see Lauer &…”
BackgroundIMPROVING THE QUALITY OF PEER REVIEW: GGA INSTRUCTIONS FOR REVIEWERS
Junior, U. E. P. J. D. M. F., & Wachholz, P. A. (2019) · Geriatrics Gerontology and Aging · doi:10.5327/z2447-211520191900066 · Cited by 5
Bössel, N., Kluge, A., Leising, D., Mischkowski, D., Phan, L. V., Richter, F., Schmitt, M., & Stähl, J. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bza29 · Cited by 6
Increasing engagement in peer review
Keating, N. L., & Mohile, S. G. (2019) · Journal of Geriatric Oncology · doi:10.1016/j.jgo.2019.03.004 · Cited by 5
Peer review and scientific publication at a crossroads
Ioannidis, J. P. A., Berkwits, M., Flanagin, A., & Bloom, T. (2023) · BMJ · doi:10.1136/bmj.p1992 · Cited by 4
Assessment of variables that influence agreement between reviewers for Foot & Ankle International
Kwon, J. Y., Gonzalez, T. A., Miller, C. P., Cook, S. P., Briceño, J., Velasco, B., & Thordarson, D. B. (2019) · Foot and Ankle Surgery · doi:10.1016/j.fas.2019.07.007 · Cited by 4
Peer review: A good but flawed system?
Carter, B. (2017) · Journal of Child Health Care · doi:10.1177/1367493517727320 · Cited by 4
“However, rigorous studies are needed to determine the advantages and disadvantages of these different peer review systems (Rennie, 2016).”
How to: improve peer review skills for CMI
Scudeller, L., & Friedman, J. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.06.028 · Cited by 4
Editorial: From judge to jury: the potential for crowd reviewing
Ateş, M. A., Luzzini, D., Meehan, J., & Suurmond, R. (2022) · Journal of Purchasing and Supply Management · doi:10.1016/j.pursup.2022.100770 · Cited by 4
Kang, Y., Zhang, C., Sun, Z., & Li, Y. (2025) · Journal of Informetrics · doi:10.1016/j.joi.2025.101709 · Cited by 5
Are reviewer scores consistent with citations?
Xie, W., Jia, P., Zhang, G., & Wang, X. (2024) · Scientometrics · doi:10.1007/s11192-024-05103-2 · Cited by 15
“…Bac-chelli, 2017; Shatz, 2004), such as inadequate review, slow process, rejection of innovative results, lack of trust between reviewers and authors, and unfair assessing based on personal interests and preferences (Fletcher, 1994; Gillespie Jr et al., 1985; Jubb, 2016; Lloyd, 1990; Rennie, 2016).”
Wang, P., Hoyt, J., Pöschl, U., Wolfram, D., Ingwersen, P., Smith, R. W., & Bates, M. J. (2016) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2016.14505301001 · Cited by 5
Should a scientist be prevented from publishing in a journal for which he works?
Charlier, P., Deo, S., & Brun, L. V. C. (2017) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2017.03.008 · Cited by 3
In Peer (Artificial Intelligence) Review We Trust
Misraï, V., TAILLE, A. D. L., & Morgan Rouprêt, A. (2019) · European Urology · doi:10.1016/j.eururo.2019.04.011 · Cited by 3
Manuscript Rejection on the Pretext of “Limited Space”: An Ethical and Economic Dilemma
Javed, F., Ahmed, Z. U., Correa, F. O. B., & Almas, K. (2026) · Journal of Bioethical Inquiry · doi:10.1007/s11673-025-10537-1 · Cited by 2
Kleiner, G. B., Rybachuk, M., & Ushakov, D. V. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-29862-3_6 · Cited by 2
Internet Dilettantes' Crowd-Based Peer Review: An Exercise in Mediocrity
Ott, D. E. (2017) · JSLS Journal of the Society of Laparoscopic & Robotic Surgeons · doi:10.4293/jsls.2017.00069 · Cited by 2
The Participation and Motivations of Grant Peer Reviewers: A Comprehensive SurveyPreprint
Gallo, S. A., Thompson, L. A., Schmaling, K. B., & Glisson, S. R. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/479816 · Cited by 2
Journalology: The Study of the Dissemination of Academic Knowledge
Norris, T. (2021) · Brock Education Journal · doi:10.26522/brocked.v30i2.921 · Cited by 2
The power of peer networking for improving STEM faculty job applications: a successful pilot programPreprint
Guardia, C. M. A., Kane, E. E., Tebo, A. G., Sanders, A. A. W. M., Kaya, D., & Grogan, K. E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.10.16.464662 · Cited by 2
Cuevas, C. D. L. (2026) · Research Integrity and Peer Review · doi:10.1186/s41073-026-00200-7 · Cited by 2
Shinbrot, T. (2017) · Physics Today · doi:10.1063/pt.3.3711 · Cited by 1
Publishing as Pedagogy: Reflections on Innovating in the Ivory Tower
Halcomb-Smith, L., Crump, A., & Sarkar, M. (2020) · Advances in higher education and professional development book series · doi:10.4018/978-1-7998-2943-0.ch004 · Cited by 1
Rates of editor‐authored manuscripts among urology journals using blinded or non‐blinded review
Flanary, J. T., Rengel, Z., Sathianathen, N. J., Lane, R., Jarosek, S. L., Barkve, N., & Weight, C. (2023) · Learned Publishing · doi:10.1002/leap.1517 · Cited by 2
“And despite a bureaucratic burden of blinding (Rennie, 2016), it is often unsuccessful (Bruce et al., 2016; Justice et al., 1998; McNutt et al., 1990; Working Double-Blind, 2008).”
BackgroundArora, H., Shinde, K., & Ghosal, T. (2023) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl57899.2023.00015 · Cited by 2
“We outperform the standard base-[5] ,biased [49] and inconsistent[27, 46] which has led researchers to argue over its reliability[9] and quality[43].”
BackgroundInfluentialRemembering Drummond Rennie—Champion of Integrity in Science and Scientific Publication
Flanagin, A., Godlee, F., Goodman, S. N., Gunsalus, C. K., Ioannidis, J. P. A., & Knoll, E. (2025) · JAMA · doi:10.1001/jama.2025.18924 · Cited by 1
Peer review at EuroIntervention – a rough guide and an expression of thanks
Byrne, R. A. (2016) · EuroIntervention · doi:10.4244/eijv12i10a196 · Cited by 1
Open peer review in the era of open science: a pilot study of researchers' perceptions
Manasa, R., & Wang, P. (2017) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.5555/3200334.3200391 · Cited by 1
Prilog raspravi o vrednovanju znanstvenog leksikografskog rada / Vida Vukoja
Vukoja, V. (2017) · Filologija časopis Razreda za filološke znanosti Hrvatske akademije znanosti i umjetnosti · doi:10.21857/yrvgqtkx59 · Cited by 1
The Quality is Mightier than the Duration: High Quality of Peer Review Makes Journal Attractive
Ebara, T. (2021) · The Japanese Journal of Ergonomics · doi:10.5100/jje.57.1 · Cited by 2
Shah, N. B. (2021) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl52503.2021.00075 · Cited by 1
The “new realities” of peer review
Yates, B. J. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00058.2017 · Cited by 1
“In addition, the strategies used for peer review should be scrutinized scientifically (Rennie 2016), and new standards should be promulgated to improve the process.”
MethodPeer Review in Scientific Scholarship
Lowe, N. K. (2017) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1016/j.jogn.2017.10.002 · Cited by 1
Diabetes Care in 2019—Who, Why, What, and How?
Riddle, M. C. (2019) · Diabetes Care · doi:10.2337/dci18-0059 · Cited by 1
Liang, W., Mahowald, K., Raymond, J. L., Krishna, V., Smith, D. S., Jurafsky, D. S., McFarland, D. A., & Zou, J. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.04.522708 · Cited by 1
“However, the scientific peer review process is often seen as opaque and inconsistent to authors (Rennie, 2016).”
BackgroundDrummond Rennie's Views on Peer Review: Make it Scientific
Snozek, C. L. H. (2016) · Clinical Chemistry · doi:10.1373/clinchem.2016.264077
Metadata
- Authors
- Rennie, D.
- Affiliations
- United States Public Health Service (US)
- Corresponding author
- Rennie, Drummond
- Venue
- Nature
- Published
- 2016-07-05
- Volume
- 535
- Issue
- 7610
- Pages
- 31-33
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2461645408
- Cited by
- 111
- References
- 11
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 8 · 2023: 13 · 2022: 7 · 2021: 11 · 2020: 13 · 2019: 13 · 2018: 10 · 2017: 15 · 2016: 9
- FWCI
- 81.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- peer review, scholarly publishing, research evaluation, scholarly communication
- MeSH terms
- Double-Blind Method, Research Design, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.