A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations
Open accessThe DOI matches its Crossref record; 16 of the 18 references it cites were found in a registry or an index.
Abstract
Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Such recently questioned incentives like recognition for publishing in high-impact-factor journals resulted in journals artificially inflating their impact factor through various means of inflating self-citations (108).”
From Issues with data and analyses: Errors, underlying themes, and potential solutions (2018) · cites this paper as [108]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828
Self-citationCoercive Citation in Academic Publishing
Wilhite, A. W., & Fong, E. A. (2012) · Science · doi:10.1126/science.1212540 · Cited by 433
Editors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373
Impact factor: outdated artefact or stepping-stone to journal certification?
Vanclay, J. K. (2012) · Scientometrics · doi:10.1007/s11192-011-0561-0 · Cited by 370
The top-ten in journal impact factor manipulation
Falagas, M. E., & Alexiou, V. G. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0024-5 · Cited by 250
Moed, H. F., & van Leeuwen, T. N. (1996) · Nature · doi:10.1038/381186a0 · Cited by 226
Journal accused of manipulating impact factor
Smith, R. W. (1997) · BMJ · doi:10.1136/bmj.314.7079.461d · Cited by 151
Brazilian citation scheme outed
Noorden, R. V. (2013) · Nature · doi:10.1038/500510a · Cited by 133
Editors’ JIF-boosting stratagems – Which are appropriate and which not?
Martin, B. R. (2016) · Research Policy · doi:10.1016/j.respol.2015.09.001 · Cited by 128
Cited by
The Journal Impact Factor: A Brief History, Critique, and Discussion of Adverse Effects
Larivière, V., & Sugimoto, C. R. (2019) · Springer Handbooks · doi:10.1007/978-3-030-02511-3_1 · Cited by 243
Oviedo-García, M. Á. (2021) · Research Evaluation · doi:10.1093/reseval/rvab020 · Cited by 170
Measuring Science: Basic Principles and Application of Advanced Bibliometrics
van Raan, A. (2019) · Springer Handbooks · doi:10.1007/978-3-030-02511-3_10 · Cited by 161
Issues with data and analyses: Errors, underlying themes, and potential solutions
Brown, A. W., Kaiser, K. A., & Allison, D. B. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708279115 · Cited by 157
How much is too much? The difference between research influence and self-citation excess
Szomszor, M., Pendlebury, D., & Adams, J. (2020) · Scientometrics · doi:10.1007/s11192-020-03417-5 · Cited by 144
Metadata
- Authors
- Chorus, C., & Waltman, L.
- Affiliations
- Delft University of Technology (NL)
- Leiden University (NL)
- Corresponding author
- Chorus, Caspar
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-08-25
- Volume
- 11
- Issue
- 8
- Pages
- e0161021
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4999059
- OpenAlex
- W2516374594
- Cited by
- 92
- References
- 18
- Citations by year
- 2026: 8 · 2025: 4 · 2024: 7 · 2023: 7 · 2022: 8 · 2021: 13 · 2020: 13 · 2019: 15 · 2018: 10 · 2017: 7
- FWCI
- 9.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Leiden Repository (Leiden University) (submittedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Universiteit Leiden
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- journal self-citation, impact factor, citation inflation, journal evaluation, journal rankings, citation analysis, scientific journals
- MeSH terms
- Malpractice, Publishing, Research Design, Science, Bibliometrics, Biomedical Research, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations. https://app.cochat.ai/papers/10.1371/journal.pone.0161021
- The paper
- Chorus, C., & Waltman, L. (2016). A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations. PLOS ONE. https://doi.org/10.1371/journal.pone.0161021
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.