The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
The weakening relationship between the impact factor and papers' citations in the digital age
Open accessAbstract
Historically, papers have been physically bound to the journal in which they were published; but in the digital age papers are available individually, no longer tied to their respective journals. Hence, papers now can be read and cited based on their own merits, independently of the journal's physical availability, reputation, or impact factor (IF). We compare the strength of the relationship between journals' IFs and the actual citations received by their respective papers from 1902 to 2009. Throughout most of the 20th century, papers' citation rates were increasingly linked to their respective journals' IFs. However, since 1990, the advent of the digital age, the relation between IFs and paper citations has been weakening. This began first in physics, a field that was quick to make the transition into the electronic domain. Furthermore, since 1990 the overall proportion of highly cited papers coming from highly cited journals has been decreasing and, of these highly cited papers, the proportion not coming from highly cited journals has been increasing. Should this pattern continue, it might bring an end to the use of the IF as a way to evaluate the quality of journals, papers, and researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Measuring Contextual Citation Impact of Scientific Journals
Moed, H. F. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.01.002 · Cited by 628
Characteristics of highly cited papers
Aksnes, D. W. (2003) · Research Evaluation · doi:10.3152/147154403781776645 · Cited by 491
History of the journal impact factor: Contingencies and consequences
Archambault, É., & Larivière, V. (2009) · Scientometrics · doi:10.1007/s11192-007-2036-x · Cited by 325
Self-citationRossner, M., Van Epps, H., & Hill, E. (2007) · The Journal of Experimental Medicine · doi:10.1084/jem.20072544 · Cited by 279
Lifting the crown—citation z-score
Lundberg, J. (2007) · Journal of Informetrics · doi:10.1016/j.joi.2006.09.007 · Cited by 274
Rossner, M., Van Epps, H., & Hill, E. (2007) · The Journal of Cell Biology · doi:10.1083/jcb.200711140 · Cited by 248
Improving the accuracy of institute for scientific information's journal impact factors
Moed, H. F., & Van Leeuwen, T. N. (1995) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199507)46:6<461::aid-asi5>3.0.co;2-g · Cited by 231
The impact factor's Matthew Effect: A natural experiment in bibliometrics
Larivière, V., & Gingras, Y. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21232 · Cited by 230
Self-citationThe Eigenfactor MetricsTM: A Network Approach to Assessing Scholarly Journals
West, J. D., Bergstrom, T. C., & Bergstrom, C. T. (2010) · College & Research Libraries · doi:10.5860/0710236 · Cited by 179
Cited by
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907
Self-citationThe past, present and future of Registered Reports
Chambers, C. D., & Tzavella, L. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01193-7 · Cited by 499
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Collaborating with People Like Me: Ethnic Coauthorship within the United States
Freeman, R. B., & Huang, W. (2015) · Journal of Labor Economics · doi:10.1086/678973 · Cited by 326
Metadata
- Authors
- Lozano, G. A., Larivière, V., & Gingras, Y.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2012-10-08
- Volume
- 63
- Issue
- 11
- Pages
- 2140-2145
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2071195592
- Cited by
- 291
- References
- 16
- FWCI
- 35.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The weakening relationship between the impact factor and papers' citations in the digital age. https://app.cochat.ai/papers/10.1002/asi.22731
- The paper
- Lozano, G. A., Larivière, V., & Gingras, Y. (2012). The weakening relationship between the impact factor and papers' citations in the digital age. Journal of the American Society for Information Science and Technology. https://doi.org/10.1002/asi.22731
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.