The use and misuse of journal metrics and other citation indicators
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This article reviews the nature and use of the journal impact factor and other common bibliometric measures for assessing research in the sciences and social sciences based on data compiled by Thomson Reuters. Journal impact factors are frequently misused to assess the influence of individual papers and authors, but such uses were never intended. Thomson Reuters also employs other measures of journal influence, which are contrasted with the impact factor. Finally, the author comments on the proper use of citation data in general, often as a supplement to peer review. This review may help government policymakers, university administrators, and individual researchers become better acquainted with the potential benefits and limitations of bibliometrics in the evaluation of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 7×
“In August 2008, in the pages of the Journal of the American Society for Information Science and Technology, Henry Small of Thomson Reuters and Michel Zitt described a new approach to field normalization of the impact factor which they called the " audience factor.”
MethodInfluentialThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · cited 2×
“Such usage was never intended, and for all this time and in countless articles, essays, and speeches, Garfield has warned against employing the impact factor for the evaluation of individual articles and scientists (Garfield 1996; Garfield 1999; Garfield 2006).”
BackgroundWhy the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Theory and practise of the g-index
Egghe, L. (2006) · Scientometrics · doi:10.1007/s11192-006-0144-7 · Cited by 2,354
Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334
Meho, L. I., & Yang, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20677 · Cited by 974
Journal impact measures in bibliometric research
Glänzel, W., & Moed, H. F. (2002) · Scientometrics · doi:10.1023/a:1014848323806 · Cited by 558
Validating research performance metrics against peer rankings
Harnad, S. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00088 · Cited by 96 · cited 2×
“…bibliometricians themselves have a challenge: to do much more research to gauge these different measures against some standards for accuracy and acceptance, which means against the opinion of field experts and policymakers, to test superiority (Butler 2008; Harnad 2008; Zitt and Bassecoulard 2008).”
Background
Cited by
Bibliometrics: Tracking Research Impact by Selecting the Appropriate Metrics
Agarwal, A., Durairajanayagam, D., Tatagari, S., Esteves, S., Harlev, A., Henkel, R., Roychoudhury, S., Homa, S., Puchalt, N., Ramasamy, R., et al. (2016) · Asian Journal of Andrology · doi:10.4103/1008-682x.171582 · Cited by 639
Michael Hall, C. (2011) · Tourism Management · doi:10.1016/j.tourman.2010.07.001 · Cited by 634
The science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 410
Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
Waltman, L., & Traag, V. A. (2021) · F1000Research · doi:10.12688/f1000research.23418.2 · Cited by 97
Peer Review versus Bibliometrics: Which Method Better Predicts the Scholarly Impact of Publications?
Abramo, G., D’Angelo, C. A., & Reale, E. (2019) · Scientometrics · doi:10.1007/s11192-019-03184-y · Cited by 50
“It has however been shown that, while negative citations may occur, these are actually rare and do not disrupt large-scale analyses (Pendlebury 2009).”
BackgroundInfluential
Metadata
- Authors
- Pendlebury, D. A.
- Venue
- Archivum Immunologiae et Therapiae Experimentalis
- Publisher
- Walter de Gruyter GmbH
- Published
- 2009-02
- Volume
- 57
- Issue
- 1
- Pages
- 1-11
- ISSN
- 0004-069X (ISSN-L)
- 1661-4917
- OpenAlex
- W1987191136
- Cited by
- 227
- References
- 9
- FWCI
- 19.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The use and misuse of journal metrics and other citation indicators. https://app.cochat.ai/papers/10.1007/s00005-009-0008-y
- The paper
- Pendlebury, D. A. (2009). The use and misuse of journal metrics and other citation indicators. Archivum Immunologiae et Therapiae Experimentalis. https://doi.org/10.1007/s00005-009-0008-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.