A multi-disciplinary perspective on emergent and future innovations in peer review
Open accessThe DOI matches its Crossref record; 240 of the 240 references it cites were found in a registry or an index.
Abstract
Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of Web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform current models while avoiding as many of the biases of existing systems as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that, at least partially, resolves many of the technical and social issues associated with peer review, and can potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Bitcoin: A Peer-to-Peer Electronic Cash System
Wright, C. S. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.3440802 · Cited by 13,922
Zhang, Q., Wang, C., Zheng, M., Li, Y., Li, J., Zhang, L., Shang, X., & Yan, C. (2015) · Cerebrovascular Diseases · doi:10.1159/000369778 · Cited by 11,533
Bitcoin: A Peer-to-Peer Electronic Cash System
Squarepants, S. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.3977007 · Cited by 11,148
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
The Effect of Word of Mouth on Sales: Online Book Reviews
Chevalier, J. A., & Mayzlin, D. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.3.345 · Cited by 6,003
(1968) · PubMed · Cited by 4,803
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Dong, Y., Hao, L., Shi, Z., Wang, G., Zhang, Z., & Han, C. (2013) · Urologia Internationalis · doi:10.1159/000351405 · Cited by 4,540
The Sociology of Science: Theoretical and Empirical Investigations
Kaplan, N., Merton, R. K., & Storer, N. W. (1974) · Technology and Culture · doi:10.2307/3102264 · Cited by 4,005
(2015) · Cited by 3,471
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.Com1
Mudambi, S. M., & Schuff, D. (2010) · MIS Quarterly · doi:10.2307/20721420 · Cited by 2,490
8 Social Hierarchy: The Self‐Reinforcing Nature of Power and Status
Magee, J. C., & Galinsky, A. D. (2008) · Academy of Management Annals · doi:10.5465/19416520802211628 · Cited by 2,385
Where Is Current Research on Blockchain Technology?—A Systematic Review
Yli-Huumo, J., Ko, D., Choi, S., Park, S., & Smolander, K. (2016) · PLOS ONE · doi:10.1371/journal.pone.0163477 · Cited by 2,317 · cited 1×
“This system is decentralized, distributed, immutable, and transparent (Nakamoto, 2008; Antonopoulos, 2014; Yli-Huumo et al., 2016).”
Bornmann, L., & Mutz, R. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23329 · Cited by 1,576
THE SOCIOLOGY OF SCIENCE:: Theoretical and Empirical Investigations
Merton, R. Κ., & Storer, N. W. (2017) · Cited by 1,462
The oligopoly of academic publishers in the digital era
Larivière, V., Haustein, S., & Mongeon, P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127502 · Cited by 1,240
Peer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Larsen, P. O., & von Ins, M. (2010) · Scientometrics · doi:10.1007/s11192-010-0202-z · Cited by 964
Peer Review: A Flawed Process at the Heart of Science and Journals
Smith, R. (2006) · Journal of the Royal Society of Medicine · doi:10.1177/014107680609900414 · Cited by 880
Mastering Bitcoin: Unlocking Digital Crypto-Currencies
Antonopoulos, A. M. (2014) · Cited by 865
How Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798
Zuckerman, H., & Merton, R. K. (1971) · Minerva · doi:10.1007/bf01553188 · Cited by 789
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716
Statistical Problems in the Reporting of Clinical Trials
Pocock, S. J., Hughes, M. D., & Lee, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198708133170706 · Cited by 662
Reviewer bias in single- versus double-blind peer review
Tomkins, A., Zhang, M., & Heavlin, W. D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1707323114 · Cited by 605
The Academic Caste System: Prestige Hierarchies in PhD Exchange Networks
Burris, V. (2004) · American Sociological Review · doi:10.1177/000312240406900205 · Cited by 570
The Academic, Economic and Societal Impacts of Open Access: An Evidence-Based Review
Tennant, J. P., Waldner, F., Jacques, D. C., Masuzzo, P., Collister, L. B., & Hartgerink, C. H. J. (2016) · F1000Research · doi:10.12688/f1000research.8460.3 · Cited by 560
Self-citationDouble-blind review favours increased representation of female authors
BUDDEN, A., TREGENZA, T., AARSSEN, L., KORICHEVA, J., LEIMU, R., & LORTIE, C. (2008) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2007.07.008 · Cited by 552
How citation distortions create unfounded authority: analysis of a citation network
Greenberg, S. A. (2009) · BMJ · doi:10.1136/bmj.b2680 · Cited by 499
Scientific publishing in developing countries: Challenges for the future
Salager-Meyer, F. (2008) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2008.03.009 · Cited by 456
The history of the peer-review process
Spier, R. (2002) · Trends in Biotechnology · doi:10.1016/s0167-7799(02)01985-6 · Cited by 445
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
The Philosophical Basis of Peer Review and the Suppression of Innovation
Horrobin, D. F. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100162024 · Cited by 436
Blank, R. M. (2016) · American Economic Review · Cited by 421
Why has the number of scientific retractions increased?
Steen, R. G., Casadevall, A., & Fang, F. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068397 · Cited by 415
van Rooyen, S., Godlee, F., Evans, S., Black, N., & Smith, R. (1999) · BMJ · doi:10.1136/bmj.318.7175.23 · Cited by 415
Peer review in a changing world: An international study measuring the attitudes of researchers
Mulligan, A., Hall, L., & Raphael, E. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22798 · Cited by 393
Gender bias in scholarly peer review
Helmer, M., Schottdorf, M., Neef, A., & Battaglia, D. (2017) · eLife · doi:10.7554/elife.21718 · Cited by 380
Scientometrics 2.0: New metrics of scholarly impact on the social Web
Priem, J., & Hemminger, B. H. (2010) · First Monday · doi:10.5210/fm.v15i7.2874 · Cited by 375
What Makes a Helpful Review? A Study of Customer Reviews on Amazon.comPreprint
Mudambi, S. M., & Schuff, D. (2010) · SSRN Electronic Journal · Cited by 356
Peer Review in 18th-Century Scientific Journalism
Kronick, D. A. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100021002 · Cited by 350
The Evolution of Editorial Peer Review
Burnham, J. C. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100023003 · Cited by 344
Gøtzsche, P. C. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90017-2 · Cited by 339
Godlee, F., Gale, C. R., & Martyn, C. N. (1998) · JAMA · doi:10.1001/jama.280.3.237 · Cited by 333
Measuring the effectiveness of scientific gatekeeping
Siler, K., Lee, K., & Bero, L. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1418218112 · Cited by 333
Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine
Goodman, S. N., Berlin, J., Fletcher, S. W., & Fletcher, R. H. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-1-199407010-00003 · Cited by 324
US and Non-US Submissions: An Analysis of Reviewer Bias
Link, A. M. (1998) · JAMA · doi:10.1001/jama.280.3.246 · Cited by 318
Editorial peer review for improving the quality of reports of biomedical studies
Jefferson, T., Rudin, M., Brodney Folse, S., & Davidoff, F. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000016.pub3 · Cited by 312
The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review
Morey, R. D., Chambers, C. D., Etchells, P. J., Harris, C. R., Hoekstra, R., Lakens, D., Lewandowsky, S., Morey, C. C., Newman, D. P., Schönbrodt, F. D., et al. (2016) · Royal Society Open Science · doi:10.1098/rsos.150547 · Cited by 284
Effect of Blinding and Unmasking on the Quality of Peer Review: A Randomized Trial
van Rooyen, S., Godlee, F., Evans, S., Smith, R., & Black, N. (1998) · JAMA · doi:10.1001/jama.280.3.234 · Cited by 280
Does Masking Author Identity Improve Peer Review Quality?: A Randomized Controlled Trial
Justice, A. C., Cho, M. K., Winker, M. A., Berlin, J. A., Rennie, D., & and the PEER Investigators (1998) · JAMA · doi:10.1001/jama.280.3.240 · Cited by 278
Smith, A. M., Katz, D. S., Niemeyer, K. E., & FORCE11 Software Citation Working Group (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.86 · Cited by 276
Self-citationEffects of training on quality of peer review: randomised controlled trial
Schroter, S., Black, N., Evans, S., Carpenter, J., Godlee, F., & Smith, R. (2004) · BMJ · doi:10.1136/bmj.38023.700775.ae · Cited by 268
Journals invite too few women to referee
Lerback, J., & Hanson, B. (2017) · Nature · doi:10.1038/541455a · Cited by 268
“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
Self-citationPeer review for journals: Evidence on quality control, fairness, and innovation
Armstrong, J. S. (1997) · Science and Engineering Ethics · doi:10.1007/s11948-997-0017-3 · Cited by 262
The Effects of Blinding on the Quality of Peer Review: A Randomized Trial
McNutt, R. A. (1990) · JAMA · doi:10.1001/jama.1990.03440100079012 · Cited by 261
Open peer review: a randomised controlled trial
Walsh, E., Rooney, M., Appleby, L., & Wilkinson, G. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.176.1.47 · Cited by 261 · cited 1×
“Other research found that signed reviews were more polite in tone, of higher quality, and more likely to ultimately recommend acceptance (Walsh et al., 2000).”
BackgroundEffect of Blinded Peer Review on Abstract Acceptance
Ross, J. S., Gross, C. P., Desai, M. M., Hong, Y., Grant, A. O., Daniels, S. R., Hachinski, V. C., Gibbons, R. J., Gardner, T. J., & Krumholz, H. M. (2006) · JAMA · doi:10.1001/jama.295.14.1675 · Cited by 250
Article-Level Metrics and the Evolution of Scientific Impact
Neylon, C., & Wu, S. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000242 · Cited by 244
Self-citationMeasuring article quality in wikipedia: models and evaluation
Hu, M., Lim, E.-P., Sun, A., Lauw, H. W., & Vuong, B.-Q. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321476 · Cited by 242
Kovanis, M., Porcher, R., Ravaud, P., & Trinquart, L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166387 · Cited by 241
Web technologies for environmental Big Data
Vitolo, C., Elkhatib, Y., Reusser, D., Macleod, C. J. A., & Buytaert, W. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.10.007 · Cited by 235
Self-citationWhat is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.1 · Cited by 232
Self-citationMeasuring the quality of editorial peer review.
Jefferson, T. (2002) · JAMA · doi:10.1001/jama.287.21.2786 · Cited by 230
Habitat and Habitus: Boxed-in versus Box-Breaking Research
Alvesson, M., & Sandberg, J. (2014) · Organization Studies · doi:10.1177/0170840614530916 · Cited by 227
Bruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0631-5 · Cited by 218
Fyfe, A., Coate, K., Curry, S., Lawson, S., Moxham, N., & Røstvik, C. M. (2017) · Edinburgh Napier Research Repository (Edinburgh Napier University) · doi:10.5281/zenodo.546100 · Cited by 215
D. Chambers, C., 1 Cardiff University Brain Research Imaging Centre, S. O. P., Feredoes, E., D. Muthukumaraswamy, S., & J. Etchells, P. (2014) · AIMS Neuroscience · doi:10.3934/neuroscience.2014.1.4 · Cited by 213
Network Structure of Social Coding in GitHub
Thung, F., Bissyande, T. F., Lo, D., & Jiang, L. (2013) · 2013 17th European Conference on Software Maintenance and Reengineering · doi:10.1109/csmr.2013.41 · Cited by 210
Begel, A., Bosch, J., & Storey, M.-A. (2013) · IEEE Software · doi:10.1109/ms.2013.13 · Cited by 197
From Book Censorship to Academic Peer Review
Biagioli, M. (2002) · Emergences: Journal for the Study of Media & Composite Cultures · doi:10.1080/1045722022000003435 · Cited by 197
Peer Review for Journals as it Stands Today—Part 1
CAMPANARIO, J. M. (1998) · Science Communication · doi:10.1177/1075547098019003002 · Cited by 195
Single-blind vs Double-blind Peer Review in the Setting of Author Prestige
Okike, K., Hug, K. T., Kocher, M. S., & Leopold, S. S. (2016) · JAMA · doi:10.1001/jama.2016.11014 · Cited by 192
Emerging trends in peer review—a survey
Walker, R., & Rocha da Silva, P. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00169 · Cited by 190
Adoption and use of Web 2.0 in scholarly communications
Procter, R., Williams, R., Stewart, J., Poschen, M., Snee, H., Voss, A., & Asgari-Targhi, M. (2010) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2010.0155 · Cited by 190
The Manuscript Review Process: The Proper Roles of Authors, Referees, and Editors
Bedeian, A. G. (2003) · Journal of Management Inquiry · doi:10.1177/1056492603258974 · Cited by 179
Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?
Davis, P. M., & Fromerth, M. J. (2007) · Scientometrics · doi:10.1007/s11192-007-1661-8 · Cited by 174
Peer review: Troubled from the start
Csiszar, A. (2016) · Nature · doi:10.1038/532306a · Cited by 172
Making Reviewers Visible: Openness, Accountability, and Credit
Godlee, F. (2002) · JAMA · doi:10.1001/jama.287.21.2762 · Cited by 167
Wicherts, J. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147913 · Cited by 165
The effect of “open access” on citation impact: An analysis of ArXiv's condensed matter section
Moed, H. F. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20663 · Cited by 164
Peer-Review Fraud — Hacking the Scientific Publication Process
Haug, C. J. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1512330 · Cited by 163
van Rooyen, S., Delamothe, T., & Evans, S. J. W. (2010) · BMJ · doi:10.1136/bmj.c5729 · Cited by 162
Priem, J. (2013) · Nature · doi:10.1038/495437a · Cited by 159
Salager‐Meyer, F. (2013) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2013.11.003 · Cited by 157
Gender bias in the refereeing process?
Tregenza, T. (2002) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(02)02545-4 · Cited by 156
Schroter, S. (2006) · JAMA · doi:10.1001/jama.295.3.314 · Cited by 147
Winners and Losers in the Global Research Village
Ginsparg, P. (1997) · The Serials Librarian · doi:10.1300/j123v30n03_13 · Cited by 142
Baxt, W. G., Waeckerle, J. F., Berlin, J. A., & Callaham, M. L. (1998) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(98)70006-x · Cited by 141
Rewarding reviewers – sense or sensibility? A Wiley study explained
Warne, V. (2016) · Learned Publishing · doi:10.1002/leap.1002 · Cited by 138
Defining and Characterizing Open Peer Review: A Review of the Literature
Ford, E. (2013) · Journal of Scholarly Publishing · doi:10.3138/jsp.44-4-001 · Cited by 136
Classical peer review: an empty gun
Smith, R. (2010) · Breast Cancer Research · doi:10.1186/bcr2742 · Cited by 134
Pair programming productivity: Novice–novice vs. expert–expert
Lui, K. M., & Chan, K. C. C. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.04.010 · Cited by 133
Fitzpatrick, K. (2011) · New York University Press eBooks · doi:10.18574/nyu/9780814728970.001.0001 · Cited by 133
Peer Review for Journals as it Stands Today—Part 2
CAMPANARIO, J. M. (1998) · Science Communication · doi:10.1177/1075547098019004002 · Cited by 132
The deconstructed journal — a new model for academic publishing
Smith, J. W. T. (1999) · Learned Publishing · doi:10.1087/09531519950145896 · Cited by 128
Protocols.io: Virtual Communities for Protocol Development and Discussion
Teytelman, L., Stoliartchouk, A., Kindler, L. J., & Hurwitz, B. L. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002538 · Cited by 118
Open textbook adoption and use: implications for teachers and learners
Petrides, L. A., Jimes, C., Middleton‐Detzner, C., Walling, J., & Weiss, S. (2011) · Open Learning The Journal of Open Distance and e-Learning · doi:10.1080/02680513.2011.538563 · Cited by 117
arXiv E‐prints and the journal of record: An analysis of roles and relationships
Larivière, V., Sugimoto, C. R., Macaluso, B., Milojević, S., Cronin, B., & Thelwall, M. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23044 · Cited by 115
The effects of blinding on the quality of peer review. A randomized trial.
McNutt, R. A., Evans, A. T., Fletcher, R. H., & Fletcher, S. W. (1990) · PubMed · Cited by 113
Let’s make peer review scientific
Rennie, D. (2016) · Nature · doi:10.1038/535031a · Cited by 111
Fox, C. W., Albert, A. Y. K., & Vines, T. H. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0027-x · Cited by 109
A Survey of Scholarly Journals Using Open Journal Systems
Edgar, B. D., & Willinsky, J. M. (2010) · Scholarly and Research Communication · doi:10.22230/src.2010v1n2a24 · Cited by 108
Guardians of Science: Fairness and Reliability of Peer Review
Daniel, H., & Russey, W. E. (1994) · Medical Entomology and Zoology · Cited by 107
van Assen, M. A. L. M., van Aert, R. C. M., Nuijten, M. B., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084896 · Cited by 107
Pöschl, U. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00033 · Cited by 105
Open-Access Mega-Journals: A Bibliometric Profile
Wakeling, S., Willett, P., Creaser, C., Fry, J., Pinfield, S., & Spezi, V. (2016) · PLoS ONE · doi:10.1371/journal.pone.0165359 · Cited by 103
Ware, M. (2008) · Information Services & Use · doi:10.3233/isu-2008-0568 · Cited by 102
BioStar: An Online Question & Answer Resource for the Bioinformatics Community
Parnell, L. D., Lindenbaum, P., Shameer, K., Dall'Olio, G. M., Swan, D. C., Jensen, L. J., Cockell, S. J., Pedersen, B. S., Mangan, M. E., Miller, C. A., et al. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002216 · Cited by 99
Academic perceptions of higher education assessment processes in neoliberal academia
Raaper, R. (2015) · Critical Studies in Education · doi:10.1080/17508487.2015.1019901 · Cited by 99
Wikipedia and academic peer review: Wikipedia as a recognised medium for scholarly publication?
Black, E. W. (2008) · Online Information Review · doi:10.1108/14684520810865994 · Cited by 97
Peer Review: Recent Experience and Future Directions
Ware, M. (2011) · New Review of Information Networking · doi:10.1080/13614576.2011.566812 · Cited by 94
An algorithm to determine peer-reviewers
Rodriguez, M. A., & Bollen, J. (2008) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1458082.1458127 · Cited by 93
Hasty, R. T., Garbalosa, R. C., Barbato, V. A., Valdes, P. J., Powers, D. W., Hernandez, E., John, J. S., Suciu, G., Qureshi, F., Popa-Radu, M., et al. (2014) · Journal of Osteopathic Medicine · doi:10.7556/jaoa.2014.035 · Cited by 91
Reviewer Fatigue? Why Scholars Decline to Review their Peers’ Work
Breuning, M., Backstrom, J., Brannon, J., Gross, B. I., & Widmeier, M. (2015) · Political Science and Politics · doi:10.1017/s1049096515000827 · Cited by 89
Does double-blind review benefit female authors?
Webb, T. J., O’Hara, R. B., & Freckleton, R. P. (2008) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.03.003 · Cited by 88
Blinding in peer review: the preferences of reviewers for nursing journals
Baggs, J. G., Broome, M. E., Dougherty, M. C., Freda, M. C., & Kearney, M. H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2008.04816.x · Cited by 86
Signs of epistemic disruption: Transformations in the knowledge system of the academic journal
Cope, W. W., & Kalantzis, M. (2009) · First Monday · doi:10.5210/fm.v14i4.2309 · Cited by 86
GENDER FACTORS IN REVIEWER RECOMMENDATIONS FOR MANUSCRIPT PUBLICATION
Lloyd, M. E. (1990) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1990.23-539 · Cited by 85
Pierie, J.-P. E., Walvoort, H. C., & Overbeke, A. J. P. (1996) · The Lancet · doi:10.1016/s0140-6736(96)05016-7 · Cited by 84
Peer review: The experience and views of early career researchers
Bravo, B. R., Nicholas, D., Herman, E., Boukacem‐Zeghmouri, C., Watkinson, A., Xu, J., Abrizah, A., & Świgoń, M. (2017) · Learned Publishing · doi:10.1002/leap.1111 · Cited by 84
Decoupling the scholarly journal
Priem, J., & Hemminger, B. M. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00019 · Cited by 82
Peer review: The current landscape and future trends
Jubb, M. (2016) · Learned Publishing · doi:10.1002/leap.1008 · Cited by 81
Core competencies for scientific editors of biomedical journals: consensus statement
Moher, D., Galipeau, J., Alam, S., Barbour, V., Bartolomeos, K., Baskin, P., Bell-Syer, S., Cobey, K. D., Chan, L., Clark, J., et al. (2017) · BMC Medicine · doi:10.1186/s12916-017-0927-0 · Cited by 81
Can editors save peer review from peer reviewers?
D’Andrea, R., & O’Dwyer, J. P. (2017) · PLOS ONE · doi:10.1371/journal.pone.0186111 · Cited by 80
Science Is Shaped by Wikipedia: Evidence from a Randomized Control TrialPreprint
Thompson, N., & Hanley, D. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3039505 · Cited by 80
Reviewers' perceptions of the peer review process for a medical education journal
Snell, L. S., & Spencer, J. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.02026.x · Cited by 79
Collaborative problem solving: a study of MathOverflow
Tausczik, Y. R., Kittur, A., & Kraut, R. E. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531690 · Cited by 78
From Manuscript Evaluation to Article Valuation: The Changing Technologies of Journal Peer Review
Pontille, D., & Torny, D. (2015) · Human Studies · doi:10.1007/s10746-014-9335-z · Cited by 78
Peer Review and Scholarly Originality: Let 1,000 Flowers Bloom, but Don’t Step on Any
Siler, K., & Strang, D. (2016) · Science Technology & Human Values · doi:10.1177/0162243916656919 · Cited by 77
Patel, J. (2014) · BMC Medicine · doi:10.1186/s12916-014-0128-z · Cited by 75 · cited 1×
“These have built on the concept of deconstructed journals (Smith, 1999), which decouple peer-review from publishing (Hettyey et al., 2012; Stemmle and Collier, 2013; Vines, 2015b; Patel, 2014).”
BackgroundKnowledge sharing in wiki communities: an empirical study
Wang, W., & Wei, Z. (2011) · Online Information Review · doi:10.1108/14684521111176516 · Cited by 73
Snodgrass, R. T. (2007) · ACM Transactions on Database Systems · doi:10.1145/1206049.1206050 · Cited by 72
Use of double‐blind peer review to increase author diversity
Darling, E. S. (2014) · Conservation Biology · doi:10.1111/cobi.12333 · Cited by 71
Benda, W. G. G., & Engels, T. (2010) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2010.03.003 · Cited by 71
Promote scientific integrity via journal peer review data
Lee, C. J., & Moher, D. (2017) · Science · doi:10.1126/science.aan4141 · Cited by 71
Does single blind peer review hinder newcomers?
Seeber, M., & Bacchelli, A. (2017) · Scientometrics · doi:10.1007/s11192-017-2264-7 · Cited by 70
Kovanis, M., Trinquart, L., Ravaud, P., & Porcher, R. (2017) · Scientometrics · doi:10.1007/s11192-017-2375-1 · Cited by 70
Strategies and guidelines for scholarly publishing of biodiversity data
Penev, L., Mietchen, D., Chavan, V., Hagedorn, G., Smith, V., Shotton, D. M., Tuama, É. Ó., Senderov, V., Georgiev, T., Стоев, П., et al. (2017) · Research Ideas and Outcomes · doi:10.3897/rio.3.e12431 · Cited by 68
Self-citationAttitudes of referees in a multidisciplinary journal: An empirical analysis
Casnici, N., Grimaldo, F., Gilbert, N., & Squazzoni, F. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23665 · Cited by 65
Double-blind reviewing at EvoLang 11 reveals gender bias
Roberts, S. G., & Verhoef, T. (2016) · Journal of Language Evolution · doi:10.1093/jole/lzw009 · Cited by 65
Chauvin, A., Ravaud, P., Baron, G., Barnes, C., & Boutron, I. (2015) · BMC Medicine · doi:10.1186/s12916-015-0395-3 · Cited by 62
Credibility, peer review, and Nature , 1945–1990
Baldwin, M. (2015) · Notes and Records: the Royal Society Journal of the History of Science · doi:10.1098/rsnr.2015.0029 · Cited by 62
Galipeau, J., Moher, D., Campbell, C., Hendry, P., Cameron, D. W., Palepu, A., & Hébert, P. C. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.09.024 · Cited by 61
Effectiveness of anonymization in double-blind review
Goues, C. L., Brun, Y., Apel, S., Berger, E., Khurshid, S., & Smaragdakis, Y. (2018) · Communications of the ACM · doi:10.1145/3208157 · Cited by 56
The Evolution of Wikipedia’s Norm Network
Heaberlin, B., & DeDeo, S. (2016) · Future Internet · doi:10.3390/fi8020014 · Cited by 54
How should novelty be valued in science?
Cohen, B. A. (2017) · eLife · doi:10.7554/elife.28699 · Cited by 52
Scientific Misconduct and Editorial and Peer Review Processes
Fox, M. F. (1994) · The Journal of Higher Education · doi:10.1080/00221546.1994.11778502 · Cited by 51
Publishing: Journals could share peer-review data
Squazzoni, F., Grimaldo, F., & Marušić, A. (2017) · Nature · doi:10.1038/546352a · Cited by 50
Closed versus open reviewing of journal manuscripts: how far do comments differ in language use?
Bornmann, L., Wolf, M., & Daniel, H.-D. (2012) · Scientometrics · doi:10.1007/s11192-011-0569-5 · Cited by 49
Reliability of reviewers' ratings when using public peer review: a case study
BORNMANN, L., & DANIEL, H. ‐. (2010) · Learned Publishing · doi:10.1087/20100207 · Cited by 49
Peer Review: Publication’s Gold Standard
Mayden, K. D. (2012) · Journal of the Advanced Practitioner in Oncology · doi:10.6004/jadpro.2012.3.2.8 · Cited by 49
Peer Review: A System under Stress
Gropp, R. E., Glisson, S., Gallo, S., & Thompson, L. (2017) · BioScience · doi:10.1093/biosci/bix034 · Cited by 49
An emerging consensus for open evaluation: 18 visions for the future of scientific publishing
Kriegeskorte, N., Walther, A., & Deca, D. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00094 · Cited by 48
Peer‐to‐peer Review and the Future of Scholarly Authority
Fitzpatrick, K. (2009) · Social Epistemology · doi:10.1080/02691728.2010.498929 · Cited by 46
Federal research impact assessment: Axioms, approaches, applications
Kostoff, R. N. (1995) · Scientometrics · doi:10.1007/bf02020420 · Cited by 45
The case of #arseniclife: Blogs and Twitter in informal peer review
Yeo, S. K., Liang, X., Brossard, D., Rose, K. M., Korzekwa, K., Scheufele, D. A., & Xenos, M. A. (2016) · Public Understanding of Science · doi:10.1177/0963662516649806 · Cited by 44
A community’s perspective on the status and future of peer review in software engineering
Prechelt, L., Graziotin, D., & Méndez, D. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.10.019 · Cited by 44
Self-citationThe myopia of crowds: Cognitive load and collective evaluation of answers on Stack Exchange
Burghardt, K., Alsina, E. F., Girvan, M., Rand, W. M., & Lerman, K. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173610 · Cited by 43
Baldwin, M. (2017) · Physics Today · doi:10.1063/pt.3.3463 · Cited by 43
Peer Review Anew: Three Principles and a Case Study in Postpublication Quality Assurance
Kelty, C., Burrus, C. S., & Baraniuk, R. G. (2008) · Proceedings of the IEEE · doi:10.1109/jproc.2008.921613 · Cited by 42
Squazzoni, F., Brezis, E., & Marušić, A. (2017) · Scientometrics · doi:10.1007/s11192-017-2518-4 · Cited by 42
Blatt, M. R. (2015) · PLANT PHYSIOLOGY · doi:10.1104/pp.15.01443 · Cited by 40
The Evolution of Wikipedia’s Norm Network
Heaberlin, B., & DeDeo, S. (2016) · RePEc: Research Papers in Economics · Cited by 36
Oldenburg, H. (1665) · Philosophical Transactions of the Royal Society of London · doi:10.1098/rstl.1665.0001 · Cited by 36
Journal review and gender equality: a critical comment on Budden et al.
Whittaker, R. J. (2008) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.06.003 · Cited by 35
The effect of masking manuscripts for the peer-review process of an ophthalmic journal
Isenberg, S. J., Sanchez, E., & Zafran, K. C. (2009) · British Journal of Ophthalmology · doi:10.1136/bjo.2008.151886 · Cited by 35
Cooperation between Referees and Authors Increases Peer Review Accuracy
Leek, J. T., Taub, M. A., & Pineda, F. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026895 · Cited by 35
Crowd-based peer review can be good and fast
List, B. (2017) · Nature · doi:10.1038/546009a · Cited by 35
Haider, J., & Åström, F. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23669 · Cited by 34
Author Perception of Peer Review
Gibson, M., Spong, C. Y., Simonsen, S. E., Martin, S., & Scott, J. R. (2008) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e31818425d4 · Cited by 34
Extending ArXiv.org to Achieve Open Peer Review and Publishing
Boldt, A. (2010) · Journal of Scholarly Publishing · doi:10.1353/scp.2011.0001 · Cited by 33
Editorial behaviors in peer review
Wang, W. W., Kong, X., Zhang, J., Chen, Z., Xia, F., & Wang, X. (2016) · SpringerPlus · doi:10.1186/s40064-016-2601-y · Cited by 33
Dappert, A., Farquhar, A., Rachael Kotarski, A., & Hewlett, K. (2017) · Data Science Journal · doi:10.5334/dsj-2017-028 · Cited by 33
Promoting reproducibility with registered reports
(2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0034 · Cited by 33
Engaging Digital Scholarship: Thoughts on Evaluating Multimedia Scholarship
Anderson, S., & McPherson, T. (2011) · Profession · doi:10.1632/prof.2011.2011.1.136 · Cited by 32
Margalida, A., & Colomer, M. À. (2016) · PeerJ · doi:10.7717/peerj.1670 · Cited by 31
Bornmann, L., & Daniel, H. (2010) · CHIMIA International Journal for Chemistry · doi:10.2533/chimia.2010.72 · Cited by 29
the Blind Shall See! the Question of Anonyminity in Journal Peer Review
Pontille, D., & Torny, D. (2014) · Scholars' Bank (University of Oregon) · doi:10.7264/n3542kvw · Cited by 29
Topic Pages: PLoS Computational Biology Meets Wikipedia
Wodak, S. J., Mietchen, D., Collings, A., Russell, R. B., & Bourne, P. E. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002446 · Cited by 28
Self-citationAcademic opinions of Wikipedia and Open Access publishing
Xiao, L., & Askin, N. (2014) · Online Information Review · doi:10.1108/oir-04-2013-0062 · Cited by 28
Albert, A., GOW, J. L., Cobra, A., & Vines, T. (2016) · Research Integrity and Peer Review · doi:10.1186/s41073-016-0022-7 · Cited by 28
Shifting Power Relations and the Ethics of Journal Peer Review
Lipworth, W. L., & Kerridge, I. (2010) · Social Epistemology · doi:10.1080/02691728.2010.534567 · Cited by 27
Yarkoni, T. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00072 · Cited by 27
A Three-Decade History of the Duration of Peer Review
Lyman, R. L. (2013) · Journal of Scholarly Publishing · doi:10.3138/jsp.44.3.001 · Cited by 26
The Five Stars of Online Journal Articles - a Framework for Article Evaluation
Shotton, D. M. (2012) · D-Lib Magazine · doi:10.1045/january2012-shotton · Cited by 26
Learning from open source software projects to improve scientific review
Ghosh, S. S., Klein, A., Avants, B., & Millman, K. J. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00018 · Cited by 26
Ernst, E., & Kienbacher, T. (1991) · Nature · doi:10.1038/352560b0 · Cited by 26
Badges of Friendship: Social Influence and Badge Acquisition on Stack Overflow
Halavais, A., Kwon, K. H., Havener, S., & Striker, J. (2014) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2014.206 · Cited by 25
Utilizing peer interactions to promote learning through a web-based peer assessment system
Li, L., Steckelberg, A. L., & Srinivasan, S. (2009) · Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie · doi:10.21432/t21c7r · Cited by 25
Chambers, C., Forstmann, B. U., & Pruszynski, J. A. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13519 · Cited by 25
Referees’ Attitudes toward Open Peer Review and Electronic Transmission of Papers
Melero, R., & López‐Santoveña, F. (2001) · Food Science and Technology International · doi:10.1106/0mxd-ym6f-3lm6-g9eb · Cited by 24
Open and transparent: the review process of the Semantic Web journal
Janowicz, K., & Hitzler, P. (2012) · Learned Publishing · doi:10.1087/20120107 · Cited by 24
Research works printed but not linked: 53
- D Adam, 2010, Climate scientists hit out at ‘sloppy’ melting glaciers error., The Guardian.
- 2017, arXiv monthly submission rates
- M Baldwin, 2017b, What it was like to be peer reviewed in the 1860s., Phys Today., 10.1063/PT.5.9098 · doi:10.1063/pt.5.9098
- N Belojevic, 2014, Peer review personas, J Electron Publishing., 17, 10.3998/3336451.0017.304 · doi:10.3998/3336451.0017.304
- R Bernstein, 2015, Updated: Sexist peer review elicits furious twitter response, PLOS apology., Science., 10.1126/science.aab2568 · doi:10.1126/science.aab2568
- B Brembs, 2015, The cost of the rejection-resubmission cycle., The Winnower., 10.15200/winn.142497.72083 · doi:10.15200/winn.142497.72083
- B Carlisle, 2014, Proof of prespecified endpoints in medical research with the bitcoin blockchain., The Grey Literature.
- D Crotty, 2009, How meaningful are user ratings? (this article = 4.5 stars!)., The Scholarly Kitchen.
- P Davis, 2017, Wither portable peer review., The Scholarly Kitchen.
- V Dhillon, 2016, From bench to bedside: Enabling reproducible commercial science via blockchain., Bitcoin Magazine.
- M Eisen, 2011, Peer review is f***ed up – let’s fix it
- T Farley, 2011, Hypothes.is reaches funding goal., James Randi Educational Foundation Swift Blog.
- K Fitzpatrick, 2011a, Peer review, judgment, and reading., Profession., 196-201, 10.1632/prof.2011.2011.1.196 · doi:10.1632/prof.2011.2011.1.196
- P Frishauf, 2009, Reputation systems: a new vision for publishing and peer review., J Particip Med., 1, e13a
- A Fyfe, 2015, Journals, learned societies and money: Philosophical Transactions, ca. 1750–1900., Notes Rec R Soc Lond., 69, 277-299, 10.1098/rsnr.2015.0032 · doi:10.1098/rsnr.2015.0032
- M Gashler, 2008, GPeerReview - a tool for making digital-signatures using data mining., KDnuggets.
- E Gibney, 2016, Toolbox: Low-cost journals piggyback on arXiv., Nature., 530, 117-118, 10.1038/530117a · doi:10.1038/530117a
- K Graf, 2014, Fetisch peer review., Archivalia.
- S Greaves, 2006, Overview: Nature’s peer review trial., Nature., 10.1038/nature05535 · doi:10.1038/nature05535
- S Gupta, 2016, How has publishing changed in the last twenty years?, Notes and Records: the Royal Society Journal of the History of Science., 70, 391-392, 10.1098/rsnr.2016.0035 · doi:10.1098/rsnr.2016.0035
- D Harley, 2010, Affordable and open textbooks: An exploratory study of faculty attitudes., Calif J Politics Policy., 2, 10.5070/P2D60T · doi:10.5070/p2d60t
- J Hukkinen, 2017, Peer review has its shortcomings, but AI is a risky fix., Wired.
- E Katsh, 2015, What we know and need to know about online dispute resolution., SCL Rev., 67, 329
- A Kosner, 2012, GitHub is the next big social network, powered by what you do, not who you know., Forbes.
- D Lee, 2015, The new Reddit journal of science., IMM-press Magazine.
- D Luzi, 2000, Trends and evolution in the development of grey literature: a review., International Journal on Grey Literature., 1, 106-117, 10.1108/14666180010345537 · doi:10.1108/14666180010345537
- P Maharg, 2007, Black box, pandora’s box or virtual toolbox? an experiment in a journal’s transparent peer review on the web., International Review of Law Computers & Technology., 21, 109-128, 10.1080/13600860701492104 · doi:10.1080/13600860701492104
- A Manten, 1980, Development of european scientific journal publishing before 1850., Development of science publishing in Europe., 1-22
- M Marra, 2017, Arxiv-based commenting resources by and for astrophysicists and physicists: An initial survey., Expanding Perspectives on Open Science: Communities, Cultures and Diversity in Concepts and Practices., 100-117, 10.3233/978-1-61499-769-6-100 · doi:10.3233/978-1-61499-769-6-100
- N McCormack, 2009, Peer review and legal publishing: What law librarians need to know about open, single-blind, and double-blind reviewing., Law Libr J., 101, 59
- G McKiernan, 2003, Alternative peer review: Quality management for 21st century scholarship.
- N Moxham, 2016, A pre-history of ‘peer review’: refereeing and editorial selection at the royal society., Hist J.
- A Mulligan, 2008, Quality, certification and peer review., Inf Serv Use., 28, 197-214, 10.3233/ISU-2008-0582 · doi:10.3233/isu-2008-0582
- T Murphy, 2014, Perceptions of the UK’s research excellence framework 2014: a media analysis., Journal of Higher Education Policy and Management., 36, 603-615, 10.1080/1360080X.2014.957890 · DOI
- 2010, Response required., Nature., 468, 867, 10.1038/468867a · doi:10.1038/468867a
- S Owens, 2014, The world’s largest 2-way dialogue between scientists and the public., Sci Am.
- A Pallavi Sudhir, 2015, PhysicsOverflow: A postgraduate-level physics Q&A site and open peer review system., Asia Pac Phys Newslett., 4, 53-55, 10.1142/S2251158X15000193 · doi:10.1142/s2251158x15000193
- J Perkel, 2015, Annotating the scholarly web., Nature., 528, 153-4, 10.1038/528153a · doi:10.1038/528153a
- S Pinfield, 2016, Mega-journals: the future, a stepping stone to it or a leap into the abyss?, Times Higher Education.
- A Plume, 2014, Publish or perish? The rise of the fractional author., Research Trends., 38
- G Pullum, 1984, Stalking the perfect journal., Natural language & linguistic theory., 2, 261-267
- 2016, Analysis of 7 million Amazon reviews: customers who receive free or discounted item much more likely to write positive review
- M Rodriguez, 2006, The convergence of digital libraries and the peer-review process., J Inform Sci., 32, 149-159, 10.1177/0165551506062327 · DOI
- N Ross, 2016, Onboarding at rOpenSci: A year in reviews., rOpenSci Blog.
- Q Schiermeier, 2017, 'You never said my peer review was confidential' - scientist challenges publisher., Nature., 541, 446, 10.1038/nature.2017.21342 · doi:10.1038/nature.2017.21342
- S Shuttleworth, 2016, Science periodicals in the nineteenth and twenty-first centuries., Notes Rec R Soc J Hist Sci., 70, 297-304, 10.1098/rsnr.2016.0026 · doi:10.1098/rsnr.2016.0026
- D Singh Chawla, 2016, Here’s why more than 50,000 psychology studies are about to have PubPeer entries., Retraction Watch.
- D Stanton, 2007, Report of the MLA task force on evaluating scholarship for tenure and promotion., Profession., 9-71, 10.1632/prof.2007.2007.1.9 · doi:10.1632/prof.2007.2007.1.9
- K Torpey, 2015, Astroblocks puts proofs of scientific discoveries on the bitcoin blockchain., Inside Bitcoins.
- T Vines, 2015a, Molecular Ecology’s best reviewers 2015., The Molecular Ecologist.
- T Vines, 2015b, The core inefficiency of peer review and a potential solution., Limnology and Oceanography Bulletin., 24, 36-38, 10.1002/lob.10022 · doi:10.1002/lob.10022
- M Weicher, 2008, Peer review and secrecy in the “information age”., Proc Am Soc Inform Sci Tech., 45, 1-12, 10.1002/meet.2008.14504503155 · DOI
- N Zamiska, 2006, Nature cancels public reviews of scientific papers., Wall Str J.
Cited by
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.2 · Cited by 449
Self-citationThe limitations to our understanding of peer review
Tennant, J. P., & Ross-Hellauer, T. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00092-1 · Cited by 384
Self-citationThe evaluation of scholarship in academic promotion and tenure processes: Past, present, and future
Schimanski, L. A., & Alperin, J. P. (2018) · F1000Research · doi:10.12688/f1000research.16493.1 · Cited by 342
Checco, A., Bracciale, L., Loreti, P., Pinfield, S., & Bianchi, G. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00703-8 · Cited by 286
“A wide range of alternative peer review processes, systems and online solutions (from Reddit-like voting systems to block-chain models) are explored by Tennant et al. (2017).”
BackgroundThe effect of publishing peer review reports on referee behavior in five scholarly journals
Bravo, G., Grimaldo, F., López-Iñesta, E., Mehmani, B., & Squazzoni, F. (2019) · Nature Communications · doi:10.1038/s41467-018-08250-2 · Cited by 273
Metadata
- Authors
- Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., Masuzzo, P., Caravaggi, A., Berg, D. R., Niemeyer, K. E., Ross-Hellauer, T., Mannheimer, S., Rigling, L., Katz, D. S., Greshake Tzovaras, B., Pacheco-Mendoza, J., Fatima, N., Poblet, M., Isaakidis, M., Irawan, D. E., Renaut, S., Madan, C. R., Matthias, L., Nørgaard Kjær, J., O'Donnell, D. P., Neylon, C., Kearns, S., Selvaraju, M., & Colomb, J.
- Venue
- F1000Research
- Publisher
- F1000 Research Ltd
- Published
- 2017-07-20
- Volume
- 6
- Pages
- 1151
- ISSN
- 2046-1402 (ISSN-L)
- OpenAlex
- W4245802241
- Cited by
- 289
- References
- 240
- FWCI
- 126.94
- Type
- journal article
- Language
- en
- Update notices
- Open access
- gold
- Funders
- Horizon 2020 (643410, H2020-EINFRA-2014-1)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.