The DOI matches its Crossref record, with a small difference in title or year.
Beat it, impact factor! Publishing elite turns against controversial metric
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, today, JIF is often misused due to a misinterpretation of its meaning, as it has become a standard tool in virtually all evaluation practices at all levels, usually without proper considerations of the rationale for its use [2,44,222,224-227].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [226]
In the citing paper
“in 2016, the American Society of Microbiology (ASM) declared that JIFs will no longer be posted to the ASM journal websites or used in advertising [226].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [226]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Still being checked.
Research works printed but not linked: 1
- Lariviere, V. et al. Preprint at http://biorxiv.org/content/early/2016/07/05/062109 (2016).
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696
Edwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688
Over-optimization of academic publishing metrics: observing Goodhart's Law in action
Fire, M., & Guestrin, C. (2019) · GigaScience · doi:10.1093/gigascience/giz053 · Cited by 351
Dechartres, A., Trinquart, L., Atal, I., Moher, D., Dickersin, K., Boutron, I., Perrodeau, E., Altman, D. G., & Ravaud, P. (2017) · BMJ · doi:10.1136/bmj.j2490 · Cited by 171
Goyanes, M., & Demeter, M. (2020) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699020904169 · Cited by 107
CiteScore: A Cite for Sore Eyes, or a Valuable, Transparent Metric?
Teixeira da Silva, J. A., & Memon, A. R. (2017) · Scientometrics · doi:10.1007/s11192-017-2250-0 · Cited by 106
How to avoid borrowed plumes in academia
Osterloh, M., & Frey, B. S. (2019) · Research Policy · doi:10.1016/j.respol.2019.103831 · Cited by 113
Paulus, F. M., Cruz, N., & Krach, S. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01487 · Cited by 101
Grančay, M., Vveinhardt, J., & Šumilo, Ē. (2017) · Scientometrics · doi:10.1007/s11192-017-2332-z · Cited by 88
Fan, D., Zhu, C., Timming, A., Su, Y.-Y., Huang, X.-L., & Lu, Y. (2020) · International journal of human resources management · doi:10.1080/09585192.2019.1657167 · Cited by 67
Villaseñor-Almaraz, M., Islas-Serrano, J., Murata, C., & Roldán-Valadez, E. (2019) · La radiologia medica · doi:10.1007/s11547-019-00996-z · Cited by 65
The Pricing of Open Access Journals: Diverse Niches and Sources of Value in Academic Publishing
Siler, K., & Frenken, K. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00016 · Cited by 64
CiteScore Metrics: Creating Journal Metrics from the Scopus Citation Index
James, C., Colledge, L., Meester, W., Azoulay, N., & Plume, A. (2019) · Learned Publishing · doi:10.1002/leap.1246 · Cited by 63
Increasing the Impact of Materials in and beyond Bio-Nano Science
Björnmalm, M., Faria, M., & Caruso, F. (2016) · Journal of the American Chemical Society · doi:10.1021/jacs.6b08673 · Cited by 63
The Matthew effect of a journal's ranking
Drivas, K., & Kremmydas, D. (2020) · Research Policy · doi:10.1016/j.respol.2020.103951 · Cited by 60
The Leadership Quarterly: State of the journal
Antonakis, J., Banks, G. C., Bastardoz, N., Cole, M. S., Day, D. V., Eagly, A. H., Epitropaki, O., Foti, R. J., Gardner, W. L., Haslam, S. A., et al. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2019.01.001 · Cited by 58
Requiem for impact factors and high publication charges
Triggle, C. R., MacDonald, R. S., Triggle, D. J., & Grierson, D. S. (2021) · Accountability in Research · doi:10.1080/08989621.2021.1909481 · Cited by 53
Scholarly impact assessment: a survey of citation weighting solutions
Cai, L., Tian, J., Liu, J., Bai, X., Lee, I., Kong, X., & Xia, F. (2018) · Scientometrics · doi:10.1007/s11192-018-2973-6 · Cited by 50
Evaluating Research and Researchers by the Journal Impact Factor: Is It Better than Coin Flipping?
Brito, R., & Rodríguez-Navarro, A. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2019.01.009 · Cited by 47
Donthu, N., Lim, W. M., Kumar, S., & Pattnaik, D. (2022) · Journal of Advertising · doi:10.1080/00913367.2021.2006100 · Cited by 46
Brown, T., & Gutman, S. A. (2018) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2018.1473489 · Cited by 41
Roldán-Valadez, E., Orbe-Arteaga, U., & Ríos, C. (2018) · La radiologia medica · doi:10.1007/s11547-018-0870-y · Cited by 40
Marsili, L., Bo, M. D., Berti, F., & Toffoli, G. (2021) · Pharmaceutics · doi:10.3390/pharmaceutics13111876 · Cited by 39
The Journal Impact Factor: Moving Toward an Alternative and Combined Scientometric Approach
Gasparyan, A. Y., Nurmashev, B., Yessirkepov, M., Udovik, E. E., Baryshnikov, A. A., & Kitas, G. D. (2017) · Journal of Korean Medical Science · doi:10.3346/jkms.2017.32.2.173 · Cited by 44
Sebo, P., Fournier, J., Ragot, C., Gorioux, P.-H., Herrmann, F. R., & Maisonneuve, H. (2019) · Scientometrics · doi:10.1007/s11192-019-03061-8 · Cited by 38
Does the Financial Times FT50 journal list select the best management and economics journals?
Fassin, Y. (2021) · Scientometrics · doi:10.1007/s11192-021-03988-x · Cited by 38
Braithwaite, J., Herkes, J., Churruca, K., Long, J. C., Pomare, C., Boyling, C., Bierbaum, M., Clay‐Williams, R., Rapport, F., Shih, P., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025320 · Cited by 38
The ethics of peer and editorial requests for self-citation of their work and journal
da Silva, J. A. T. (2016) · Medical Journal Armed Forces India · doi:10.1016/j.mjafi.2016.11.008 · Cited by 36
Xie, Y., Wu, Q., & Li, X. (2019) · Scientometrics · doi:10.1007/s11192-019-03177-x · Cited by 36
Article-level assessment of influence and translation in biomedical research
Santangelo, G. M. (2017) · Molecular Biology of the Cell · doi:10.1091/mbc.e16-01-0037 · Cited by 35
Reverse the Curse of the Top-5
Kaplan, R. S. (2019) · Accounting Horizons · doi:10.2308/acch-10663 · Cited by 34
Cortés-Sánchez, J. D. (2020) · European Research on Management and Business Economics · doi:10.1016/j.iedeen.2019.12.003 · Cited by 31
Research Initiatives in Accounting Education: Research Relevance and Research Productivity
Moon, J. S., & Wood, D. A. (2020) · Issues in Accounting Education · doi:10.2308/issues-2020-012 · Cited by 31
Global Trends of Usage of Chlorophyll Fluorescence and Projections for the Next Decade
Zavafer, A., Labeeuw, L., & Mancilla, C. (2020) · Plant Phenomics · doi:10.34133/2020/6293145 · Cited by 30
Haley, U. C. V., Cooper, C. L., Hoffman, A. J., Pitsis, T. S., & Greenberg, D. N. (2022) · Academy of Management Learning and Education · doi:10.5465/amle.2022.0327 · Cited by 30
Clarivate Analytics: Continued Omnia vanitas Impact Factor Culture
da Silva, J. A. T., & Bernès, S. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9873-7 · Cited by 29
ORBAY, K., Miranda, R., & ORBAY, M. (2020) · Participatory Educational Research · doi:10.17275/per.20.26.7.2 · Cited by 32
Scientific Literature and Evaluation Metrics: Impact Factor, Usage Metrics, and Altmetrics
Kavic, M. S., & Satava, R. M. (2021) · JSLS Journal of the Society of Laparoscopic & Robotic Surgeons · doi:10.4293/jsls.2021.00010 · Cited by 28
The Journal Impact Factor of Orthopaedic Journals Does not Predict Individual Paper Citation Rate
Bozzo, A., Oitment, C. T. A., Evaniew, N., & Ghert, M. A. (2017) · JAAOS Global Research and Reviews · doi:10.5435/jaaosglobal-d-17-00007 · Cited by 28
The Journal Impact Factor is under attack – use the CAPCI factor instead
Diamandis, E. P. (2017) · BMC Medicine · doi:10.1186/s12916-016-0773-5 · Cited by 27
Free editors and peers: squeezing the lemon dry
da Silva, J. A. T., & Katavić, V. (2016) · Ethics & bioethics · doi:10.1515/ebce-2016-0011 · Cited by 32
The Journal Impact Factor Should Not Be Discarded
Bornmann, L., & Pudovkin, A. I. (2017) · Journal of Korean Medical Science · doi:10.3346/jkms.2017.32.2.180 · Cited by 24
Bonnevie, T., Repel, A., Gravier, F.-E., Ladner, J., Sibert, L., Muir, J.-F., Cuvelier, A., & Fischer, M.-O. (2023) · Scientometrics · doi:10.1007/s11192-023-04675-9 · Cited by 20
“Although largely discussed (Callaway, 2016), this metric is associated with research quality (Lee et al., 2002) and is also used to rank journals.”
BackgroundChou, P., Yeh, Y.-T., Kan, W., Chien, T., & Kuo, S. (2021) · European journal of medical research · doi:10.1186/s40001-021-00494-x · Cited by 22
Leng, G., & Leng, R. (2020) · The MIT Press eBooks · doi:10.7551/mitpress/12228.001.0001 · Cited by 25
From Gutenberg to Open Science: An Unfulfilled Odyssey
Triggle, C. R., & Triggle, D. J. (2016) · Drug Development Research · doi:10.1002/ddr.21369 · Cited by 22
Rice, D. B., Raffoul, H., Ioannidis, J. P. A., & Moher, D. (2021) · FACETS · doi:10.1139/facets-2020-0044 · Cited by 20
Abramo, G., D’Angelo, C. A., & Di Costa, F. (2023) · Scientometrics · doi:10.1007/s11192-022-04622-0 · Cited by 21
Nascimento, D. P., Gonzalez, G. Z., Araújo, A. C., & Costa, L. O. P. (2019) · European Spine Journal · doi:10.1007/s00586-019-06206-8 · Cited by 21
Top economics universities and research institutions in Vietnam: evidence from the SSHPA dataset
Vuong, Q., Bui, A.-T., Ho, M., Pham, T.-H., Vu, T.-H., Pham, H., Hoang, A.-D., Ho, M.-T., & La, V.-P. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e06273 · Cited by 21
Role of low‐impact‐factor journals in conservation implementation
Choi, J. J., Gaskins, L. C., Morton, J. P., Bingham, J. A., Blawas, A. M., Hayes, C. D., Hoyt, C., Halpin, P. N., & Silliman, B. R. (2024) · Conservation Biology · doi:10.1111/cobi.14391 · Cited by 20
Post-normal institutional identities: Quality assurance, reflexivity and ethos of care
Pereira, Â. G., & Saltelli, A. (2017) · Futures · doi:10.1016/j.futures.2016.11.009 · Cited by 22
Sharing, collaborating, and building trust: How Open Science advances language testing
Winke, P. M. (2024) · Language Testing · doi:10.1177/02655322231211159 · Cited by 18
Rethinking the Journal Impact Factor and Publishing in the Digital Age.
Nestor, M. S., Fischer, D. L., Arnold, D., Berman, B., & Rosso, J. Q. D. (2020) · PubMed · Cited by 19
Ianoş, I., & Petrişor, A.-I. (2020) · Publications · doi:10.3390/publications8030036 · Cited by 19
Publication and Citation Patterns in the Social Sciences and Humanities: A National Perspective
Pajić, D., Jevremov, T., & Škorić, M. (2019) · The Canadian Journal of Sociology · doi:10.29173/cjs29214 · Cited by 18
Orbay, M., Karamustafaoğlu, O., & Miranda, R. (2021) · Education for Information · doi:10.3233/efi-200442 · Cited by 20
Evaluating the evolution and impact of wood vinegar research: A bibliometric study
Mhamdi, R. (2023) · Journal of Analytical and Applied Pyrolysis · doi:10.1016/j.jaap.2023.106190 · Cited by 18
Chemical engineering research synergies across scientific categories
Patience, G. S., Patience, C. A., & Bertrand, F. (2018) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.23165 · Cited by 18
The emerging landscape of scientific publishing
Fiala, C., & Diamandis, E. P. (2017) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2017.04.009 · Cited by 18
Taatjes, D. J., & Roth, J. (2017) · Histochemistry and Cell Biology · doi:10.1007/s00418-017-1541-0 · Cited by 19
Tolsgaard, M. G., Kulasegaram, K. M., Woods, N. N., Brydges, R., Ringsted, C. V., & Dyre, L. (2020) · Medical Education · doi:10.1111/medu.14373 · Cited by 17
Occupational therapy publications by Australian authors: A bibliometric analysis
Brown, T., Gutman, S. A., & Ho, Y. (2018) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12453 · Cited by 17
Bales, S. E., Hubbard, D. E., vanDuinkerken, W., Sare, L., & Olivarez, J. (2019) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2019.02.005 · Cited by 17
The democratization of scientific publishing
Fiala, C., & Diamandis, E. P. (2019) · BMC Medicine · doi:10.1186/s12916-019-1249-1 · Cited by 16
Suárez, J. D. A., Salazar, F., García, J. A. C., Díaz, M. A., Sarmiento, H. J., Andrew, J., Cooper, C., Gendron, Y., Acosta, L. C., Rivera, D. S. M., et al. (2020) · Contaduría Universidad de Antioquia · doi:10.17533/udea.rc.n77a05 · Cited by 16
Impact factor: An assessment tool for journals or for scientists?
Slim, K., Dupré, A., & Roy, B. L. (2017) · Anaesthesia Critical Care & Pain Medicine · doi:10.1016/j.accpm.2017.06.004 · Cited by 16
Levels of evidence and journal impact factor in oral and maxillofacial surgery: a 15-year follow-up
Nabil, S., & Samman, N. (2020) · International Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.ijom.2020.11.021 · Cited by 15
Poff, D. C., & Ginley, D. S. (2020) · Springer eBooks · doi:10.1007/978-3-030-16759-2_61 · Cited by 14
Spitale, G. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e04426 · Cited by 14
Mihaljević, H., & Santamaría, L. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00090 · Cited by 13
Is Bauman’s “liquid modernity” influencing the way we are doing science?
MATTIAZZI, A. R., & Petroff, M. V. (2021) · The Journal of General Physiology · doi:10.1085/jgp.202012803 · Cited by 17
Helgeson, S. A., Johnson, P. W., Gopikrishnan, N., Koirala, T., Franco, P. M., Carter, R. E., Quicksall, Z., & Burger, C. D. (2025) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2024.08.029 · Cited by 11
Williams, M. J., Mullane, K., & Curtis, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00005-7 · Cited by 10
Hanna, C. R., Boyd, K., & Jones, R. J. (2021) · Health Research Policy and Systems · doi:10.1186/s12961-020-00658-x · Cited by 13
Publish or Perish? Publish and Perish? Global Neurosurgery in the COVID-19 Pandemic Era
Andrews, R. J. (2020) · World Neurosurgery · doi:10.1016/j.wneu.2020.09.018 · Cited by 11
Pislyakov, V. V. (2022) · Journal of Informetrics · doi:10.1016/j.joi.2022.101322 · Cited by 10
The Importance of Having a Balanced Rating Index for Ranking Academic Journals
Okumuş, F., Zhao, X., van Niekerk, M., & Law, R. (2017) · Journal of Hospitality & Tourism Research · doi:10.1177/1096348017709499 · Cited by 10
Lyu, P., & Wolfram, D. (2018) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2018.14505501035 · Cited by 10
Cover Effects on Citations Uncovered: Evidence from Nature
Battiston, P., Sacco, P. L., & Stanca, L. M. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2022.101293 · Cited by 9
A Fine Balance: How Authors Strategize Around Journal Submission
Ginsburg, S., Lynch, M., & Walsh, C. M. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002265 · Cited by 9
Metrics and Rankings: Myths and Fallacies
Manolopoulos, Y., & Katsaros, D. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-57135-5_19 · Cited by 9
Jang, H. (2021) · Science Editing · doi:10.6087/kcse.225 · Cited by 10
WIREs Climate Change 2018: An editorial essay
Hulme, M. (2017) · Wiley Interdisciplinary Reviews Climate Change · doi:10.1002/wcc.503 · Cited by 8
Assessing the Publication Records of Accounting Faculty Successfully Tenured and Promoted
Burton, H. A., Sevin, S., & Watson, M. W. (2023) · Journal of Accounting Education · doi:10.1016/j.jaccedu.2023.100841 · Cited by 8
Kools, F. R. W., Fox, C. M., Prakken, B. J., & van Rijen, H. V. M. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1109297 · Cited by 10
Our Study is Published, But the Journey is Not Finished!
Pourret, O., Suzuki, K., & Takahashi, Y. (2020) · Elements · doi:10.2138/gselements.16.4.229 · Cited by 8
More Transparency is Needed When Citing h-Indexes, Journal Impact Factors and CiteScores
Kendall, G. (2024) · Publishing Research Quarterly · doi:10.1007/s12109-024-09983-3 · Cited by 7
Huang, T.-Y., & Yang, L. (2022) · Scientometrics · doi:10.1007/s11192-022-04372-z · Cited by 8
Kazimirchik, L. V., Polikhina, N. A., & Борисовна, Т. И. (2019) · Science Editor and Publisher · doi:10.24069/2542-0267-2019-3-4-151-168 · Cited by 7
Reider, B. J. (2017) · The American Journal of Sports Medicine · doi:10.1177/0363546517721707 · Cited by 7
Anicker, F. (2022) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2022-0020 · Cited by 6
Γώγογλου, Α., Sidiropoulos, A., Katsaros, D., & Manolopoulos, Y. (2017) · Scientometrics · doi:10.1007/s11192-017-2285-2 · Cited by 6
Pillar Universities in Russia: Bibliometrics of ‘the second best’
Lisitskaya, T., Taranov, P. M., Ugnich, E. A., & Pislyakov, V. V. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01645-4 · Cited by 5
Fairness in scientific publishing
Matthews, P. C. (2017) · F1000Research · doi:10.12688/f1000research.10318.2 · Cited by 6
Sondervan, J., & Stigter, F. (2017) · Learned Publishing · doi:10.1002/leap.1151 · Cited by 6
Falagas, M. E., Kyriakidou, M., Spais, G., Argiti, E., & Vardakas, K. Z. (2018) · Rambam Maimonides Medical Journal · doi:10.5041/rmmj.10332 · Cited by 6
Development of a tool to accurately predict UK REF funding allocation
Al‐Janabi, S., Lim, L. W., & Aquili, L. (2021) · Scientometrics · doi:10.1007/s11192-021-04030-w · Cited by 6
Open Access in Vocational Education and Training Research
Langenkamp, K., Rödel, B., Taufenbach, K., & Weiland, M. (2018) · Publications · doi:10.3390/publications6030029 · Cited by 6
Open Access in Geochemistry from Preprints to Data Sharing: Past, Present, and Future
Pourret, O., & Irawan, D. E. (2022) · Publications · doi:10.3390/publications10010003 · Cited by 4
Metadata
- Authors
- Callaway, E.
- Corresponding author
- Callaway, Ewen
- Venue
- Nature
- Published
- 2016-07-08
- Volume
- 535
- Issue
- 7611
- Pages
- 210-211
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2473748898
- Cited by
- 220
- References
- 0
- Citations by year
- 2026: 4 · 2025: 9 · 2024: 8 · 2023: 22 · 2022: 16 · 2021: 24 · 2020: 32 · 2019: 38 · 2018: 27 · 2017: 31 · 2016: 9
- Type
- other
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- impact factor, journal impact factor, scholarly publishing, research evaluation, scientific journals, journal editors, bibliometric analysis
- MeSH terms
- Periodicals as Topic, Publishing, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review