The DOI matches its Crossref record.
Peer reviews and bibliometric indicators: a comparative study at a Norwegian university
Abstract
This study investigates the relationship between bibliometric indicators and the outcomes of peer reviews. Based on a case study of research groups at the University of Bergen, Norway, we examine how various bibliometric indicators correlate with evaluation ratings given by expert committees. The analysis shows positive but relatively weak correlations for all the selected indicators. Particular attention is devoted to the reasons for the discrepancies. We find that shortcomings of the peers' assessments, of the bibliometric indicators, as well as lack of comparability, can explain why the correlation was not stronger.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
What do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607
Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019) · Sage Open · doi:10.1177/2158244019829575 · Cited by 1,257
Self-citationMeho, L. I., & Yang, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20677 · Cited by 974
Informetrics at the beginning of the 21st century—A review
Bar-Ilan, J. (2008) · Journal of Informetrics · doi:10.1016/j.joi.2007.11.001 · Cited by 466
The rise and rise of citation analysis
Meho, L. I. (2007) · Physics World · doi:10.1088/2058-7058/20/1/33 · Cited by 371
Citation Analysis: A Comparison of Google Scholar, Scopus, and Web of Science
Yang, K., & Meho, L. I. (2006) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504301185 · Cited by 260
Revisiting the Scientometric Conceptualization of Impact and Its Measurement
Abramo, G. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.05.001 · Cited by 80
Baccini, A., & De Nicolao, G. (2016) · Scientometrics · doi:10.1007/s11192-016-1929-y · Cited by 68
“…et al. 2003); or the analysis of the correlation between peer ratings assigned to individual researchers or research groups, and bibliometric indicators calculated for these same researchers or groups (van Raan 2006; Lovegrove and Johnson 2008; Koenig 1983; Rinia et al. 1998; Aksnes and Taxt 2004).”
BackgroundPeer Review versus Bibliometrics: Which Method Better Predicts the Scholarly Impact of Publications?
Abramo, G., D’Angelo, C. A., & Reale, E. (2019) · Scientometrics · doi:10.1007/s11192-019-03184-y · Cited by 50
“…2015; ANVUR, 2013; Bornmann & Leydesdorff, 2013; Allen, Jones, Dolby, Lynn, & Walport, 2009; Reale, Barbara, & Costantini, 2007; van Raan, 2006; Aksnes & Taxt 2004; Oppenheim & Norris 2003; Rinia, van Leeuwen, van Vuren, & van Raan, 1998; Oppenheim, 1997), individual researchers (Vieira &…”
BackgroundGuilt by association: How scientific misconduct harms prior collaborators
Hussinger, K., & Pellens, M. (2019) · Research Policy · doi:10.1016/j.respol.2018.01.012 · Cited by 49
Haddawy, P., Hassan, S.-U., Asghar, A., & Amin, S. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2015.12.005 · Cited by 45
Metadata
- Authors
- Aksnes, D. W., & Taxt, R. E.
- Venue
- Research Evaluation
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-04-01
- Volume
- 13
- Issue
- 1
- Pages
- 33-41
- ISSN
- 0958-2029 (ISSN-L)
- 1471-5449
- OpenAlex
- W2032160096
- Cited by
- 177
- References
- 0
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.