The Effectiveness of the Peer Review Process: Inter‐Referee Agreement and Predictive Validity of Manuscript Refereeing at Angewandte Chemie
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Refereeing the referees: The peer review process of Angewandte Chemie has been examined according to the criteria of reliability (agreement between referees) and predictive validity (correlation between publication decision and citation frequency of the reviewed work). Despite the dramatic increase in submitted manuscripts and significant decline in acceptance rate, the results show the unwavering quality of the peer review at Angewandte Chemie.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Real Science: What it Is and What it Means
Ziman, J. (2000) · doi:10.1017/cbo9780511541391 · Cited by 760
Comparing alternatives to the web of science for coverage of the social sciences’ literature
Norris, M., & Oppenheim, C. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.12.001 · Cited by 733
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
Peer Review for Journals as it Stands Today—Part 2
CAMPANARIO, J. M. (1998) · Science Communication · doi:10.1177/1075547098019004002 · Cited by 132
Assassins and zealots: variations in peer review. Special report.
Siegelman, S. S. (1991) · Radiology · doi:10.1148/radiology.178.3.1994394 · Cited by 92
Peer review in the funding of research in higher education: The Australian experience
Jayasinghe, U. W., Marsh, H. W., & Bond, N. (2001) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737023004343 · Cited by 58
Cited by
Lee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Bornmann, L. (2011) · Annual Review of Information Science and Technology · doi:10.1002/aris.2011.1440450112 · Cited by 567
Self-citationBoudreau, K. J., Guinan, E. C., Lakhani, K. R., & Riedl, C. (2016) · Management Science · doi:10.1287/mnsc.2015.2285 · Cited by 481
Bornmann, L., Mutz, R., & Daniel, H.-D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014331 · Cited by 290
“In the end, we had 48 studies [16–65] (two studies reported their findings in two papers).”
BackgroundSelf-citationMarsh, H. W., Bornmann, L., Mutz, R., Daniel, H.-D., & O’Mara, A. (2009) · Review of Educational Research · doi:10.3102/0034654309334143 · Cited by 174
The luck of the referee draw: the effect of exchanging reviews
BORNMANN, L., & DANIEL, H. (2009) · Learned Publishing · doi:10.1087/2009207 · Cited by 51
Self-citationClosed versus open reviewing of journal manuscripts: how far do comments differ in language use?
Bornmann, L., Wolf, M., & Daniel, H.-D. (2012) · Scientometrics · doi:10.1007/s11192-011-0569-5 · Cited by 49
“A detailed description of the manuscript review process at AC-IE can be found in Bornmann et al. (2010c). Database for the present study For the investigation of peer review at ACP we had data for 1,111 manuscripts that went through the complete ACP selection process in the years 2001–2006. These manuscripts reached o…”
BackgroundSelf-citation
Metadata
- Authors
- Bornmann, L., & Daniel, H.
- Venue
- Angewandte Chemie International Edition
- Publisher
- Wiley
- Published
- 2008-09-03
- Volume
- 47
- Issue
- 38
- Pages
- 7173-7178
- ISSN
- 1433-7851 (ISSN-L)
- 1521-3773
- OpenAlex
- W2043241540
- Cited by
- 70
- References
- 6
- FWCI
- 54.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.