The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
The inconsistency of the h‐index
Abstract
The h‐index is a popular bibliometric indicator for assessing individual scientists. We criticize the h‐index from a theoretical point of view. We argue that for the purpose of measuring the overall scientific impact of a scientist (or some other unit of analysis), the h‐index behaves in a counterintuitive way. In certain cases, the mechanism used by the h‐index to aggregate publication and citation statistics into a single number leads to inconsistencies in the way in which scientists are ranked. Our conclusion is that the h‐index cannot be considered an appropriate indicator of a scientist's overall scientific impact. Based on recent theoretical insights, we discuss what kind of indicators can be used as an alternative to the h‐index. We pay special attention to the highly cited publications indicator. This indicator has a lot in common with the h‐index, but unlike the h‐index it does not produce inconsistent rankings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Theory and practise of the g-index
Egghe, L. (2006) · Scientometrics · doi:10.1007/s11192-006-0144-7 · Cited by 2,354
Does the h index have predictive power?
Hirsch, J. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0707962104 · Cited by 973
Alonso, S., Cabrerizo, F. J., Herrera-Viedma, E., & Herrera, F. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.04.001 · Cited by 848
What do we know about the h index?
Bornmann, L., & Daniel, H. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20609 · Cited by 669
A Hirsch-type index for journals
Braun, T., Glänzel, W., & Schubert, A. (2006) · Scientometrics · doi:10.1007/s11192-006-0147-4 · Cited by 661
van Raan, A. F. J. (2006) · Scientometrics · doi:10.1556/scient.67.2006.3.10 · Cited by 619
COSTAS, R., & BORDONS, M. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2007.02.001 · Cited by 494
Towards a new crown indicator: Some theoretical considerations
Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. J. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2010.08.001 · Cited by 424
Self-citationHirsch, J. E. (2010) · Scientometrics · doi:10.1007/s11192-010-0193-9 · Cited by 414
The Measurement of Intellectual Influence
Palacios-Huerta, I., & Volij, O. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00519.x · Cited by 328
Glänzel, W. (2006) · Scientometrics · doi:10.1007/s11192-006-0102-4 · Cited by 314
An informetric model for the Hirsch-index
Egghe, L., & Rousseau, R. (2006) · Scientometrics · doi:10.1007/s11192-006-0143-8 · Cited by 303
Bornmann, L., Mutz, R., Hug, S. E., & Daniel, H.-D. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.01.006 · Cited by 290
Lehmann, S., Jackson, A. D., & Lautrup, B. E. (2006) · Nature · doi:10.1038/4441003a · Cited by 277
Lifting the crown—citation z-score
Lundberg, J. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.09.007 · Cited by 274
The Hirsch index and related impact measures
Egghe, L. (2010) · Annual Review of Information Science and Technology · doi:10.1002/aris.2010.1440440109 · Cited by 256
Tijssen, R. J. W., Visser, M. S., & van Leeuwen, T. N. (2002) · Scientometrics · doi:10.1023/a:1016082432660 · Cited by 251
A modification of the h-index: The hm-index accounts for multi-authored manuscripts
Schreiber, M. (2008) · Journal of Informetrics · doi:10.1016/j.joi.2008.05.001 · Cited by 232
Generalizing the h- and g-indices
van Eck, N. J., & Waltman, L. (2008) · RePub (Erasmus University Rotterdam) · Cited by 166
Self-citationAn axiomatic characterization of the Hirsch-index
Woeginger, G. J. (2008) · Mathematical Social Sciences · doi:10.1016/j.mathsocsci.2008.03.001 · Cited by 143
Hirsch's h-index: A stochastic model
Burrell, Q. L. (2006) · Journal of Informetrics · doi:10.1016/j.joi.2006.07.001 · Cited by 138
Mathematical theory of the h‐ and g‐index in case of fractional counting of authorship
Egghe, L. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20845 · Cited by 137
The w‐index: A measure to assess scientific impact by focusing on widely cited papers
Wu, Q. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21276 · Cited by 120
The h‐index: a broad review of a new bibliometric indicator
Norris, M. W., & Oppenheim, C. (2010) · Journal of Documentation · doi:10.1108/00220411011066790 · Cited by 114
Marchant, T. (2009) · Scientometrics · doi:10.1007/s11192-008-2075-y · Cited by 106
A quantitative analysis of indicators of scientific performance
Lehmann, S., Jackson, A. D., & Lautrup, B. E. (2008) · Scientometrics · doi:10.1007/s11192-007-1868-8 · Cited by 104
Bibliometric rankings of journals based on Impact Factors: An axiomatic approach
Bouyssou, D., & Marchant, T. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.09.001 · Cited by 83
The significance of the number of highly cited papers as an indicator of scientific prolificacy
Plomp, R. (1990) · Scientometrics · doi:10.1007/bf02095346 · Cited by 72
Score‐based bibliometric rankings of authors
Marchant, T. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21059 · Cited by 59
On measuring scholarly influence by citations
Ravallion, M. D., & Wagstaff, A. R. (2011) · Scientometrics · doi:10.1007/s11192-011-0375-0 · Cited by 54
The highly cited papers of professors as an indicator of a research group's scientific performance
Plomp, R. (1994) · Scientometrics · doi:10.1007/bf02033446 · Cited by 54
How Does the Market Use Citation Data? The Hirsch Index in Economics
Ellison, G. (2010) · National Bureau of Economic Research · doi:10.3386/w16419 · Cited by 48
The diffusion of H-related literature
Zhang, L., Thijs, B., & Glänzel, W. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.05.004 · Cited by 41
The relation between Eigenfactor, audience factor, and influence weight
Waltman, L., & van Eck, N. J. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21354 · Cited by 39
Self-citationThe measurement of low- and high-impact in citation distributions: Technical results
Albarrán, P., Ortuño-Ortı́n, I., & Ruiz‐Castillo, J. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.08.002 · Cited by 38
Cited by
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Self-citationBibliometrics: methods for studying academic publishing
Ninkov, A., Frank, J. R., & Maggio, L. A. (2021) · Perspectives on Medical Education · doi:10.1007/s40037-021-00695-4 · Cited by 1,048
Gender-Heterogeneous Working Groups Produce Higher Quality Science
Campbell, L. G., Mehtani, S., Dozier, M. E., & Rinehart, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079147 · Cited by 387
A standardized citation metrics author database annotated for scientific field
Ioannidis, J. P. A., Baas, J., Klavans, R., & Boyack, K. W. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000384 · Cited by 356
Hou, J., Yang, X., & Chen, C. (2018) · Scientometrics · doi:10.1007/s11192-018-2695-9 · Cited by 368
Metadata
- Authors
- Waltman, L., & van Eck, N. J.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2011-10-31
- Volume
- 63
- Issue
- 2
- Pages
- 406-415
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2130247873
- Cited by
- 332
- References
- 36
- FWCI
- 22.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.