The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
A Principal Component Analysis of 39 Scientific Impact Measures
Open accessAbstract
BACKGROUND: The impact of scientific publications has traditionally been expressed in terms of citation counts. However, scientific activity has moved online over the past decade. To better capture scientific impact in the digital era, a variety of new impact measures has been proposed on the basis of social network analysis and usage log data. Here we investigate how these new measures relate to each other, and how accurately and completely they express scientific impact. METHODOLOGY: We performed a principal component analysis of the rankings produced by 39 existing and proposed measures of scholarly impact that were calculated on the basis of both citation and usage log data. CONCLUSIONS: Our results indicate that the notion of scientific impact is a multi-dimensional construct that can not be adequately measured by any single indicator, although some measures are more suitable than others. The commonly used citation Impact Factor is not positioned at the core of this construct, but at its periphery, and should thus be used with caution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
The Proceedings of the National Academy of Sciences
Richards, J. W. (1915) · Science · doi:10.1126/science.42.1074.161 · Cited by 13,983
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Jolliffe, I. T. (1986) · Springer Series in Statistics · doi:10.1007/978-1-4757-1904-8 · Cited by 8,273
(2017) · The SAGE Encyclopedia of Communication Research Methods · doi:10.4135/9781483381411.n575 · Cited by 6,008
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Theory and practise of the g-index
Egghe, L. (2006) · Scientometrics · doi:10.1007/s11192-006-0144-7 · Cited by 2,354
Journal of the American Society for Information Science and Technology
(2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/(issn)1532-2890 · Cited by 1,164
Journal impact factor: a brief review.
Garfield, E. (1999) · Europe PMC (PubMed Central) · Cited by 888
Journal of the American Society for Information Science
(1984) · Journal of the American Society for Information Science · doi:10.1002/asi.4630350221 · Cited by 768
A Hirsch-type index for journals
Braun, T., Glänzel, W., & Schubert, A. (2006) · Scientometrics · doi:10.1007/s11192-006-0147-4 · Cited by 661
Betweenness centrality as an indicator of the interdisciplinarity of scientific journals
Leydesdorff, L. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20614 · Cited by 612
Pinski, G., & Narin, F. (1976) · Information Processing & Management · doi:10.1016/0306-4573(76)90048-0 · Cited by 597
The R- and AR-indices: Complementing the h-index
Jin, B., Liang, L., Rousseau, R., & Egghe, L. (2007) · Chinese Science Bulletin · doi:10.1007/s11434-007-0145-9 · Cited by 558
Social Network Analysis: Concepts, Methodology, and Directions for the 1990s
GALASKIEWICZ, J., & WASSERMAN, S. (1993) · Sociological Methods & Research · doi:10.1177/0049124193022001001 · Cited by 538
Finding scientific gems with Google’s PageRank algorithm
Chen, P., Xie, H., Maslov, S., & Redner, S. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.06.001 · Cited by 483
Using information scent to model user information needs and actions and the Web
Chi, E. H., Pirolli, P., Chen, K., & Pitkow, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365325 · Cited by 418
Earlier Web usage statistics as predictors of later citation impact
Brody, T., Harnad, S., & Carr, L. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20373 · Cited by 402
Bollen, J., Rodriquez, M. A., & Van de Sompel, H. (2006) · Scientometrics · doi:10.1007/s11192-006-0176-z · Cited by 401
Self-citationEditors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373
Bordons, M., Fernández, M. T., & Gómez, I. (2002) · Scientometrics · doi:10.1023/a:1014800407876 · Cited by 302
Sense and nonsense about the impact factor
Opthof, T. (1997) · Cardiovascular Research · doi:10.1016/s0008-6363(96)00215-5 · Cited by 286
Information Processing and Management
(1984) · Journal of Information Processing and Management · doi:10.1241/johokanri.27.603 · Cited by 275
Toward alternative metrics of journal impact: A comparison of download and citation data
Bollen, J., Van de Sompel, H., Smith, J. A., & Luce, R. (2005) · Information Processing & Management · doi:10.1016/j.ipm.2005.03.024 · Cited by 210
Self-citationClickstream Data Yields High-Resolution Maps of Science
Bollen, J., Van de Sompel, H., Hagberg, A., Bettencourt, L., Chute, R., Rodriguez, M. A., & Balakireva, L. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004803 · Cited by 208
Self-citationA Hirsch-type index for journals [1]
Braun, T., Glänzel, W., & Schubert, A. P. (2005) · Lirias · Cited by 145
Usage impact factor: The effects of sample characteristics on usage‐based impact metrics
Bollen, J., & Herbert Van De Sompel, A. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20746 · Cited by 99
Self-citationVisualization of the citation impact environments of scientific journals: An online mapping exercise
Loet Leydesdorff, A. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20406 · Cited by 81
Median and percentile impact factors: A set of new indicators
Rousseau, R. (2005) · Scientometrics · doi:10.1007/s11192-005-0223-1 · Cited by 65
Refining dermatology journal impact factors using PageRank
Dellavalle, R. P., Schilling, L. M., Rodriguez, M. A., Herbert Van De Sompel, A., & Bollen, J. (2007) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2007.03.005 · Cited by 57
Self-citationISI's impact factor as misnomer: A proposed new measure to assess journal impact
Harter, S. P., & Nisonger, T. E. (1997) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199712)48:12<1146::aid-asi9>3.3.co;2-# · Cited by 46
Reading factor: a new bibliometric criterion for managing digital libraries.
Darmoni, S. J., Roussel, F., Bénichou, J., Thirion, B., & Pinhas, N. (2002) · Europe PMC (PubMed Central) · Cited by 46
ISI's impact factor as misnomer: A proposed new measure to assess journal impact
Harter, S. P., & Nisonger, T. E. (1997) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199712)48:12<1146::aid-asi9>3.0.co;2-u · Cited by 39
Mathematical relations between impact factors and average number of citations
Egghe, L. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90026-x · Cited by 32
Shepherd, P. (2007) · Serials The Journal for the Serials Community · doi:10.1629/20117 · Cited by 32
Cited by
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
A new approach to the metric of journals’ scientific prestige: The SJR indicator
González-Pereira, B., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.03.002 · Cited by 859
Michael Hall, C. (2011) · Tourism Management · doi:10.1016/j.tourman.2010.07.001 · Cited by 634
Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research
Gargouri, Y., Hajjem, C., Larivière, V., Gingras, Y., Carr, L., Brody, T., & Harnad, S. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013636 · Cited by 602
Hutchins, B. I., Yuan, X., Anderson, J. M., & Santangelo, G. M. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002541 · Cited by 500
Metadata
- Authors
- Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2009-06-29
- Volume
- 4
- Issue
- 6
- Pages
- e6022
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2168201538
- Cited by
- 572
- References
- 36
- FWCI
- 49.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.