The DOI matches its Crossref record; 185 of the 185 references it cites were found in a registry or an index.
Impact factor: outdated artefact or stepping-stone to journal certification?
Open accessAbstract
A review of Garfield’s journal impact factor and its specific implementation as the Thomson Reuters impact factor reveals several weaknesses in this commonly-used indicator of journal standing. Key limitations include the mismatch between citing and cited documents, the deceptive display of three decimals that belies the real precision, and the absence of confidence intervals. These are minor issues that are easily amended and should be corrected, but more substantive improvements are needed. There are indications that the scientific community seeks and needs better certification of journal procedures to improve the quality of published science. Comprehensive certification of editorial and review procedures could help ensure adequate procedures to detect duplicate and fraudulent submissions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
Chen, C. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20317 · Cited by 6,433
Science mapping software tools: Review, analysis, and cooperative study among tools
Cobo, M. J., López-Herrera, A. G., Herrera-Viedma, E., & Herrera, F. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21525 · Cited by 3,242
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 3×
“…citations received divided by the potential number of cited documents variants of this index, it is appropriate to re compromises made in the 1970s (Garfield 1972), and to more advanced computational capability available today. index, reflecting how both the numerator and the numerator of this…”
BackgroundThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
(2022) · Singapore Medical Journal · doi:10.11622/smedj · Cited by 1,730
CURRENT RESEARCH IN SOCIAL PSYCHOLOGY
Markovsky, B. (1996) · Cited by 994
Journal impact factor: a brief review.
Garfield, E. (1999) · Europe PMC (PubMed Central) · Cited by 755
Callaham, M. (2002) · JAMA · doi:10.1001/jama.287.21.2847 · Cited by 644
Cited by
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
A Review of Theory and Practice in Scientometrics
Mingers, J., & Leydesdorff, L. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.04.002 · Cited by 1,002
Bibliometrics: Tracking Research Impact by Selecting the Appropriate Metrics
Agarwal, A., Durairajanayagam, D., Tatagari, S., Esteves, S., Harlev, A., Henkel, R., Roychoudhury, S., Homa, S., Puchalt, N., Ramasamy, R., et al. (2016) · Asian Journal of Andrology · doi:10.4103/1008-682x.171582 · Cited by 639
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Metadata
- Authors
- Vanclay, J. K.
- Venue
- Scientometrics
- Published
- 2011-11-24
- Volume
- 92
- Issue
- 2
- Pages
- 211-238
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W1986219263
- Cited by
- 370
- References
- 185
- FWCI
- 40.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact factor: outdated artefact or stepping-stone to journal certification? https://app.cochat.ai/papers/10.1007/s11192-011-0561-0
- The paper
- Vanclay, J. K. (2012). Impact factor: outdated artefact or stepping-stone to journal certification? Scientometrics. https://doi.org/10.1007/s11192-011-0561-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.