Journal editors’ perspectives on the roles and tasks of peer reviewers in biomedical journals: a qualitative study
Open accessThe DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index.
Abstract
Objective: Peer reviewers of biomedical journals are expected to perform a large number of roles and tasks, some of which are seemingly contradictory or demonstrate incongruities between the respective positions of peer reviewers and journal editors. Our aim was to explore the perspectives, expectations and understanding of the roles and tasks of peer reviewers of journal editors from general and specialty biomedical journals. Design: Qualitative study. Setting: Worldwide. Participants: 56 journal editors from biomedical journals, most of whom were editors-in-chief (n=39), male (n=40) and worked part-time (n=50) at journals from 22 different publishers. Methods: Semistructured interviews with journal editors were conducted. Recruitment was based on purposive maximum variation sampling. Data were analysed thematically following the methodology by Braun and Clarke. Results: Journal editors’ understanding of the roles and partly of tasks of peer reviewers are profoundly shaped by each journal’s unique context and characteristics, including financial and human resources and journal reputation or prestige. There was a broad agreement among journal editors on expected technical tasks of peer reviewers related to scientific aspects, but there were different expectations in the level of depth. We also found that most journal editors support the perspective that authorship experience is key to high-quality reviews, while formal training in peer reviewing is not. Conclusion: These journal editors’ accounts reveal issues of a social nature within the peer-review process related to missed opportunities for journal editors to engage with peer reviewers to clarify the expected roles and tasks. Further research is needed on actual performance of peer reviewers looking into the content of peer-reviewer reports to inform meaningful training interventions, journal policies and guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The depth of evaluation that editors expect from reviewers also varied, and was associated with some journal features, such as having professional or invited editors [17].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509
Qualitative research and evaluation methods
Patton, M. Q. (1980) · Cited by 35,733
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
S., N. L. (2017) · doi:10.1177/1609406917733847 · Cited by 14,051
Sample size in qualitative research
Sandelowski, M. (1995) · Research in Nursing & Health · doi:10.1002/nur.4770180211 · Cited by 4,372 · cited 1×
“Of these, the majority were male editors- in-chief who were based in 21 different countries.”
BackgroundLee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000 · cited 1×
“…of peer reviewers looking into the content of peer-reviewer reports on a large scale to inform meaningful training interventions and to improve existing journal policies and guidelines. twitter Ketevan Glonti @Keti_2012, Isabelle Boutron @BOUTRON1, David Moher @ dmoher and Darko Hren @HrenDarko”
BackgroundAssessing scientists for hiring, promotion, and tenure
Moher, D., Naudet, F., Cristea, I. A., Miedema, F., Ioannidis, J. P. A., & Goodman, S. N. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2004089 · Cited by 462
Self-citationWhat Makes a Good Reviewer and a Good Review for a General Medical Journal?
Black, N. (1998) · JAMA · doi:10.1001/jama.280.3.231 · Cited by 266
Cited by
Carneiro, C. F. D., Queiroz, V. G. S., Moulin, T. C., Carvalho, C. A. M., Haas, C. B., Rayêe, D., Henshall, D. E., De-Souza, E. A., Amorim, F. E., Boos, F. Z., et al. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00101-3 · Cited by 146
Overburdening of peer reviewers: a multi-stakeholder perspective on causes and effects
Severin, A., & Chataway, J. (2021) · Learned Publishing · doi:10.1002/leap.1392 · Cited by 73
Purposes of peer review: A qualitative study of stakeholder expectations and perceptions
Severin, A., & Chataway, J. (2020) · Learned Publishing · doi:10.1002/leap.1336 · Cited by 49
“…assessing the suitability of a manuscript for a particular journal (Mulligan et al., 2013; VanTassell et al., 1992), providing a decision-making tool for editors (Glonti et al., 2019), and providing of a seal of accreditation or approval for published contents (Nicholas et al., 2015; Ware, 2008a).”
BackgroundMethodInfluentialKnowledge and motivations of training in peer review: An international cross-sectional survey
Willis, J. V., Ramos, J., Cobey, K. D., Ng, J. Y., Khan, H., Albert, M. A., Alayche, M., & Moher, D. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287660 · Cited by 30
Self-citationCarneiro, C. F. D., Queiroz, V. G. S., Moulin, T. C., de Carvalho, C. A. M., Haas, C. B., Rayêe, D., Henshall, D. E., De‐Souza, E. A., Amorim, F. E., Boos, F. Z., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/581892 · Cited by 28
Metadata
- Authors
- Glonti, K., Boutron, I., Moher, D., & Hren, D.
- Affiliations
- Inserm (FR)
- Ottawa Hospital Research Institute (CA)
- University of Split (HR)
- Corresponding author
- Glonti, Ketevan
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2019-11
- Volume
- 9
- Issue
- 11
- Pages
- e033421
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC6886905
- OpenAlex
- W2989988376
- Cited by
- 69
- References
- 36
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 11 · 2023: 12 · 2022: 9 · 2021: 12 · 2020: 11 · 2019: 1
- FWCI
- 38.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HAL (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- H2020 Marie Skłodowska-Curie Actions (676207)
- Topics
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- peer review, journal editors, biomedical journals, peer review training, journal reputation, peer review policy
- MeSH terms
- Humans, Periodicals as Topic, Professional Competence, Guidelines as Topic, Peer Review, Research, Editorial Policies, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Journal editors’ perspectives on the roles and tasks of peer reviewers in biomedical journals: a qualitative study. https://app.cochat.ai/papers/10.1136/bmjopen-2019-033421
- The paper
- Glonti, K., Boutron, I., Moher, D., & Hren, D. (2019). Journal editors’ perspectives on the roles and tasks of peer reviewers in biomedical journals: a qualitative study. BMJ Open. https://doi.org/10.1136/bmjopen-2019-033421
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.