Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 449

The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.

What is open peer review? A systematic review

Open access
Ross-Hellauer, Tony·2017·F1000Research

Abstract

Background : “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.12688/f1000research.11369.2

Cites

73 of 73 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Show all 73 references

Research works printed but not linked: 7

  1. T Bloom, 2017, Referee Report For: What is open peer review? A systematic review [version 1; referees: 1 approved, 3 approved with reservations]., F1000Res., 6, 588, 10.5256/f1000research.12273.r22301 · doi:10.5256/f1000research.12273.r22301
  2. D Chubin, 1990, Peerless Science: Peer Review and US Science Policy.
  3. 2016, About | The EMBO Journal [WWW Document]
  4. K Fitzpatrick, 2012, Open Review, A Study of Contexts and Practices
  5. S Kaplan, 2015, Major Publisher Retracts 64 Scientific Papers in Fake Peer Review Outbreak.
  6. M Ware, Peer Review: Benefits, Perceptions and Alternatives, 2008
  7. M Ware, 2016, Peer Review Survey 2015

Cited by

See all 449

Metadata

Authors
Ross-Hellauer, T.
Venue
F1000Research
Published
2017-08-31
Volume
6
Pages
588
ISSN
2046-1402 (ISSN-L)
OpenAlex
W2609499779
Cited by
449
References
73
FWCI
9.62
Type
journal article
Language
en
Open access
gold
Funders
European Commission (643410)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: What is open peer review? A systematic review. https://app.cochat.ai/papers/10.12688/f1000research.11369.2
The paper
Ross-Hellauer, T. (2017). What is open peer review? A systematic review. F1000Research. https://doi.org/10.12688/f1000research.11369.2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.