The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Field-normalized citation impact indicators and the choice of an appropriate counting method
Abstract
Bibliometric studies often rely on field-normalized citation impact indicators in order to make comparisons between scientific fields. We discuss the connection between field normalization and the choice of a counting method for handling publications with multiple co-authors. Our focus is on the choice between full counting and fractional counting. Based on an extensive theoretical and empirical analysis, we argue that properly field-normalized results cannot be obtained when full counting is used. Fractional counting does provide results that are properly field normalized. We therefore recommend the use of fractional counting in bibliometric studies that require field normalization, especially in studies at the level of countries and research organizations. We also compare different variants of fractional counting. In general, it seems best to use either the author-level or the address-level variant of fractional counting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
The Increasing Dominance of Teams in Production of Knowledge
Wuchty, S., Jones, B. F., & Uzzi, B. (2007) · Science · doi:10.1126/science.1136099 · Cited by 3,615
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Self-citationCitation Analysis in Research Evaluation
(2005) · Information Science and Knowledge Management · doi:10.1007/1-4020-3714-7 · Cited by 1,309
Multi-University Research Teams: Shifting Impact, Geography, and Stratification in Science
Jones, B. F., Wuchty, S., & Uzzi, B. (2008) · Science · doi:10.1126/science.1158357 · Cited by 812
Team size matters: Collaboration and scientific impact since 1900
Larivière, V., Gingras, Y., Sugimoto, C. R., & Tsou, A. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23266 · Cited by 484
Mapping world scientific collaboration: Authors, institutions, and countries
Gazni, A., Sugimoto, C. R., & Didegah, F. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21688 · Cited by 452
The Leiden ranking 2011/2012: Data collection, indicators, and interpretation
Waltman, L., Calero‐Medina, C., Kosten, J., Noyons, E. C. M., Tijssen, R. J. W., van Eck, N. J., van Leeuwen, T. N., van Raan, A. F. J., Visser, M. S., & Wouters, P. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22708 · Cited by 444
Self-citationTowards a new crown indicator: Some theoretical considerations
Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. J. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2010.08.001 · Cited by 424
Self-citationThe effect of scholar collaboration on impact and quality of academic papers
Franceschet, M., & Costantini, A. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.06.003 · Cited by 288
Production and Citation Measures in the Sociology of Science: The Problem of Multiple Authorship
Lindsey, D. (1980) · Social Studies of Science · doi:10.1177/030631278001000202 · Cited by 285
Lifting the crown—citation z-score
Lundberg, J. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.09.007 · Cited by 274
Nicolaisen, J. (2007) · Annual Review of Information Science and Technology · doi:10.1002/aris.2007.1440410120 · Cited by 273
van Eck, N. J., Waltman, L., van Raan, A. F. J., Klautz, R. J. M., & Peul, W. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062395 · Cited by 237
Self-citationA modification of the h-index: The hm-index accounts for multi-authored manuscripts
Schreiber, M. (2008) · Journal of Informetrics · doi:10.1016/j.joi.2008.05.001 · Cited by 232
The research guarantors of scientific papers and the output counting: a promising new approach
Moya-Anegón, F., Guerrero-Bote, V. P., Bornmann, L., & Moed, H. F. (2013) · Scientometrics · doi:10.1007/s11192-013-1046-0 · Cited by 212
An empirical analysis of the use of alphabetical authorship in scientific publishing
Waltman, L. (2012) · Journal of Informetrics · doi:10.1016/j.joi.2012.07.008 · Cited by 179
Self-citationMathematical theory of the h‐ and g‐index in case of fractional counting of authorship
Egghe, L. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20845 · Cited by 173
Hagen, N. T. (2008) · PLoS ONE · doi:10.1371/journal.pone.0004021 · Cited by 171
Leydesdorff, L., & Opthof, T. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21371 · Cited by 160
To share the fame in a fair way, h m modifies h for multi-authored manuscripts
Schreiber, M. (2008) · New Journal of Physics · doi:10.1088/1367-2630/10/4/040201 · Cited by 154
On the calculation of percentile‐based bibliometric indicators
Waltman, L., & Schreiber, M. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22775 · Cited by 143
Self-citationLeydesdorff, L., & Bornmann, L. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23408 · Cited by 129
Aksnes, D. W., Schneider, J. W., & Gunnarsson, M. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.08.002 · Cited by 125
On the calculation of percentile-based bibliometric indicators
Waltman, L. R., & Schreiber, M. (2012) · Leiden Repository (Leiden University) · Cited by 116
Self-citationWhat is in a name? Credit assignment practices in different disciplines
Frandsen, T. F., & Nicolaisen, J. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.06.010 · Cited by 103
Comparisons of results of publication counting using different methods
Gauffriau, M., Larsen, P. O., Maye, I., Roulin-Perriard, A., & von Ins, M. (2008) · Scientometrics · doi:10.1007/s11192-007-1934-2 · Cited by 101
Counting methods are decisive for rankings based on publication and citation studies
Gauffriau, M., & Larsen, P. O. (2005) · Scientometrics · doi:10.1007/s11192-005-0239-6 · Cited by 101
Publication, cooperation and productivity measures in scientific research
Gauffriau, M., Larsen, P. O., Maye, I., Roulin-Perriard, A., & von Ins, M. (2007) · Scientometrics · doi:10.1007/s11192-007-1800-2 · Cited by 95
Huang, M., Lin, C., & Chen, D. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21625 · Cited by 77
The influences of counting methods on university rankings based on paper count and citation count
Lin, C., Huang, M., & Chen, D. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.03.007 · Cited by 76
Price, D. J. D. (1981) · Science · doi:10.1126/science.212.4498.986-a · Cited by 76
Albarrán, P., Crespo, J. A., Ortuño-Ortı́n, I., & Ruiz‐Castillo, J. (2010) · Scientometrics · doi:10.1007/s11192-010-0223-7 · Cited by 67
A case study of the modified Hirsch index hm accounting for multiple coauthors
Schreiber, M. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21057 · Cited by 60
Bornmann, L., Anegón, F. D. M., & Mutz, R. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22923 · Cited by 52
Gossypol: Effect on Testosterone
Dym, M. (1981) · Science · doi:10.1126/science.212.4498.986-b · Cited by 51
Sub-field normalization in the multiplicative case: Average-based citation indicators
Herranz, N., & Ruiz‐Castillo, J. (2012) · Journal of Informetrics · doi:10.1016/j.joi.2012.02.006 · Cited by 26
Perianes‐Rodríguez, A., & Ruiz‐Castillo, J. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.10.002 · Cited by 19
Sub-field normalization in the multiplicative case: High- and low-impact citation indicators
Herranz, N., & Ruiz‐Castillo, J. (2012) · Research Evaluation · doi:10.1093/reseval/rvs006 · Cited by 18
A review of the literature on citation impact indicatorsPreprint
Waltman, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.02099 · Cited by 10
Self-citation
Cited by
Constructing bibliometric networks: A comparison between full and fractional counting
Perianes-Rodriguez, A., Waltman, L., & van Eck, N. J. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.10.006 · Cited by 1,416
Self-citationA review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Self-citationParmentola, A., Petrillo, A., Tutore, I., & De Felice, F. (2022) · Business Strategy and the Environment · doi:10.1002/bse.2882 · Cited by 429
The effect of Russian University Excellence Initiative on publications and collaboration patterns
Matveeva, N., Sterligov, I., & Yudkevich, M. (2021) · Journal of Informetrics · doi:10.1016/j.joi.2020.101110 · Cited by 82
Omaña-Guzmán, I., Rosas-Diaz, M., Martínez-López, Y. E., Perez-Navarro, L. M., Diaz-Badillo, A., Alanis, A., Bustamante, A., Castillo-Ruiz, O., del Toro-Cisneros, N., Esquivel-Hernandez, D. A., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03744-x · Cited by 18
Metadata
- Authors
- Waltman, L., & van Eck, N. J.
- Venue
- Journal of Informetrics
- Publisher
- Elsevier BV
- Published
- 2015-10
- Volume
- 9
- Issue
- 4
- Pages
- 872-894
- ISSN
- 1751-1577 (ISSN-L)
- OpenAlex
- W1949140393
- Cited by
- 284
- References
- 40
- FWCI
- 17.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.