Defining and Characterizing Open Peer Review: A Review of the Literature
Open accessThe DOI matches its Crossref record.
Abstract
Changes in scholarly publishing have resulted in a move toward openness. To this end, new, open models of peer review are emerging. While the scholarly literature has examined and discussed open peer review, no established definition of it exists, nor are there uniform implementations of open peer review processes. This article examines the literature discussing open peer review, identifies common open peer review definitions, and describes eight common characteristics of open peer review: signed review, disclosed review, editor-mediated review, transparent review, crowd-sourced review, pre-publication review, synchronous review, and post-publication review. This article further discusses benefits and challenges to the scholarly publishing community posed by open peer review and concludes that open peer review can and should exist within the current scholarly publishing paradigm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Scholarly use of social media and altmetrics: A review of the literature
Sugimoto, C. R., Work, S., Larivière, V., & Haustein, S. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23833 · Cited by 569
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.2 · Cited by 449
Science-related populism: Conceptualizing populist demands toward science
Mede, N. G., & Schäfer, M. S. (2020) · Public Understanding of Science · doi:10.1177/0963662520924259 · Cited by 399
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., et al. (2017) · F1000Research · doi:10.12688/f1000research.12037.1 · Cited by 289
Checco, A., Bracciale, L., Loreti, P., Pinfield, S., & Bianchi, G. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00703-8 · Cited by 286
“Most notably, open peer review is being more widely introduced as an alternative paradigm of interaction between authors and reviewers (Ford, 2013; Ross-Hellauer, 2017).”
BackgroundWhat is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.1 · Cited by 232
“Open identity peer review, also known as signed peer review (Ford, 2013; Nobarany & Booth, 2015) and “unblinded review” (Monsen & Horn, 2007), is review where authors and reviewers are aware of each other’s identities.”
BackgroundInfluentialOpen peer review: promoting transparency in open science
Wolfram, D., Wang, P., Hembree, A., & Park, H. (2020) · Scientometrics · doi:10.1007/s11192-020-03488-4 · Cited by 167
Overburdening of peer reviewers: a multi-stakeholder perspective on causes and effects
Severin, A., & Chataway, J. (2021) · Learned Publishing · doi:10.1002/leap.1392 · Cited by 73
Analysis of the Potentials of Blockchain for the Governance of Global Digital Commons
Rozas, D., Tenorio-Fornés, A., & Hassan, S. (2021) · Frontiers in Blockchain · doi:10.3389/fbloc.2021.577680 · Cited by 45
MOPRD: A multidisciplinary open peer review dataset
Lin, J., Song, J., Zhou, Z., Chen, Y., & Shi, X. (2022) · arXiv · doi:10.48550/arxiv.2212.04972 · Cited by 11
“Open peer review unfreezes access to a large amount of peer review data, unlocking great opportunities for com-puter-aid peer review and further in the realization of automated scholarly paper review (ASPR) [23].”
Background
Metadata
- Authors
- Ford, E.
- Venue
- Journal of Scholarly Publishing
- Published
- 2013-07
- Volume
- 44
- Issue
- 4
- Pages
- 311-326
- ISSN
- 1198-9742 (ISSN-L)
- 1710-1166
- OpenAlex
- W2079772095
- Cited by
- 136
- References
- 0
- FWCI
- 34.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.