Should highly cited items be excluded in impact factor calculation? The effect of review articles on journal impact factor
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Values of mean-based indicators can be highly distorted by the presence of a few highly cited publications.
“the values of mean-based indicators can be highly distorted by the presence of few highly cited publications [44,45,221,224,277-279].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [278]
Cites
Sheldrick, G. M. (2007) · Acta Crystallographica Section A Foundations of Crystallography · doi:10.1107/s0108767307043930 · Cited by 87,861 · see citing works
Hallmarks of Cancer: The Next Generation
Hanahan, D., & Weinberg, R. A. (2011) · Cell · doi:10.1016/j.cell.2011.02.013 · Cited by 66,590 · see citing works
GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
Abbott, B. P., Abbott, R., Abbott, T. D., Acernese, F., Ackley, K., Adams, C., Adams, T., Addesso, P., Adhikari, R. X., Adya, V. B., et al. (2017) · Physical Review Letters · doi:10.1103/physrevlett.119.161101 · Cited by 9,483 · see citing works
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · see citing works
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 1× · see citing works
“Vol.:(0123456789) 1 3 Keywords Review articles · Impact factor · Highly cited articles Introduction The journal impact factor1 was first developed to help librarians select quality journals (Garfield 1972, 2006).”
BackgroundThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · see citing works
GW170104: Observation of a 50-Solar-Mass Binary Black Hole Coalescence at Redshift 0.2
Abbott, B. P., Abbott, R., Abbott, T. D., Acernese, F., Ackley, K., Adams, C., Adams, T., Addesso, P., Adhikari, R. X., Adya, V. B., et al. (2017) · Physical Review Letters · doi:10.1103/physrevlett.118.221101 · Cited by 2,495 · see citing works
GW170814: A Three-Detector Observation of Gravitational Waves from a Binary Black Hole Coalescence.
Abbott, B., Abbott, R., Abbott, T., Acernese, F., Ackley, K., Adams, C., Adams, T., Addesso, P., Adhikari, R., Adya, V., et al. (2017) · Physical Review Letters · doi:10.1103/physrevlett.119.141101 · Cited by 1,820 · see citing works
Results from a Search for Dark Matter in the Complete LUX Exposure
Akerib, D. S., Alsum, S., Araújo, H. M., et al. (2017) · Physical Review Letters · doi:10.1103/physrevlett.118.021303 · Cited by 1,564 · see citing works
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356 · see citing works
The top-ten in journal impact factor manipulation
Falagas, M. E., & Alexiou, V. G. (2008) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-008-0024-5 · Cited by 251 · see citing works
Reviewers are blinkered by bibliometrics
Stephan, P. E., Veugelers, R., & Wang, J. (2017) · Nature · doi:10.1038/544411a · Cited by 189 · see citing works
Editors’ JIF-boosting stratagems – Which are appropriate and which not?
Martin, B. R. (2016) · Research Policy · doi:10.1016/j.respol.2015.09.001 · Cited by 128 · see citing works
Paulus, F. M., Cruz, N., & Krach, S. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01487 · Cited by 101 · see citing works
The probability of publishing in first-quartile journals
Liu, W., Hu, G., & Gu, M. (2015) · Scientometrics · doi:10.1007/s11192-015-1821-1 · Cited by 73 · see citing works
Lei, L., & Yan, S. (2016) · Scientometrics · doi:10.1007/s11192-016-2036-9 · Cited by 60 · see citing works
Self-citationMetrics: journal's impact factor skewed by a single paper
Dimitrov, J. D., Kaveri, S. V., & Bayry, J. (2010) · Nature · doi:10.1038/466179b · Cited by 48 · see citing works
Critical Rationalism and the Search for Standard (Field-Normalized) Indicators in Bibliometrics
Bornmann, L., & Marx, W. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.05.002 · Cited by 41 · see citing works
The Science Review Article: An Opportune Genre in the Construction of Science
Noguchi, J. (2006) · Cited by 25 · see citing works
The science review article : an opportune genre in the construction of science
野口, ジ. (2006) · Medical Entomology and Zoology · Cited by 24 · see citing works
Reliability-based citation impact factor and the manipulation of impact factor
Yu, G., Yang, D., & Wang, L. (2009) · Scientometrics · doi:10.1007/s11192-009-0083-1 · Cited by 23 · see citing works
Bibliometric Analysis as a Tool in Journal Evaluation
Rashid, H. F. (1991) · The Serials Librarian · doi:10.1300/j123v20n02_05 · Cited by 22 · see citing works
Detecting impact factor manipulation with data mining techniques
Yang, D., Li, X., Sun, X., & Wan, J. (2016) · Scientometrics · doi:10.1007/s11192-016-2144-6 · Cited by 19 · see citing works
A journal's impact factor is influenced by changes in publication delays of citing journals
Shi, D., Rousseau, R., Yang, L., & Li, J. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23706 · Cited by 18 · see citing works
Liu, W., Liu, F., Zuo, C., & Zhu, J. (2018) · Learned Publishing · doi:10.1002/leap.1156 · Cited by 15 · see citing works
An automatic recognition method of journal impact factor manipulation
Yu, G., Yang, D., & He, H. (2011) · Journal of Information Science · doi:10.1177/0165551511400954 · Cited by 13 · see citing works
When science meets cluttered writing: adjectives and adverbs in academia revisited
Lei, L. (2016) · Scientometrics · doi:10.1007/s11192-016-1896-3 · Cited by 12 · see citing works
Self-citationAmiri, M., & Michel, M. C. (2018) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-018-1529-x · Cited by 11 · see citing works
Foo, J. Y. A. (2013) · Accountability in Research · doi:10.1080/08989621.2013.767124 · Cited by 8 · see citing works
Deceiving the research community through manipulation of the impact factor
Krauskopf, E. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22905 · Cited by 6 · see citing works
Is it Suitable for a Journal to Bid for Publishing a Review That is Likely to be Highly Cited?
Liu, W., Zhu, J., Zuo, C., & Wang, H. (2018) · Science and Engineering Ethics · doi:10.1007/s11948-017-0016-y · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
Butarbutar, Z. T., Handayani, P. W., Suryono, R. R., & Wibowo, W. S. (2023) · Cogent Business & Management · doi:10.1080/23311975.2023.2264001 · Cited by 42 · see citing works
- Authors
- Lei, L., & Sun, Y.
- Affiliations
- Huazhong University of Science and Technology (CN)
- Corresponding author
- Sun, Yunmei
- ORCID
- Venue
- Scientometrics
- Published
- 2020-01-20
- Volume
- 122
- Issue
- 3
- Pages
- 1697-1706
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W3001281321
- Cited by
- 43
- References
- 31
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 5 · 2023: 10 · 2022: 3 · 2021: 12 · 2020: 5
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Scientometrics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- This work was supported by the National Social Science Fund of China (17BYY097)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- journal impact factor, highly cited papers, citation counts, research evaluation, physics journals, nature, cells, bibliometric analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
