Over-optimization of academic publishing metrics: observing Goodhart's Law in action
Open accessThe DOI matches its Crossref record; 70 of the 77 references it cites were found in a registry or an index.
Abstract
Background: The academic publishing world is changing significantly, with ever-growing numbers of publications each year and shifting publishing patterns. However, the metrics used to measure academic success, such as the number of publications, citation number, and impact factor, have not changed for decades. Moreover, recent studies indicate that these metrics have become targets and follow Goodhart's Law, according to which, “when a measure becomes a target, it ceases to be a good measure.” Results: In this study, we analyzed >120 million papers to examine how the academic publishing world has evolved over the last century, with a deeper look into the specific field of biology. Our study shows that the validity of citation-based measures is being compromised and their usefulness is lessening. In particular, the number of publications has ceased to be a good metric as a result of longer author lists, shorter papers, and surging publication numbers. Citation-based metrics, such citation number and h-index, are likewise affected by the flood of papers, self-citations, and lengthy reference lists. Measures such as a journal's impact factor have also ceased to be good metrics due to the soaring numbers of papers that are published in top journals, particularly from the same pool of authors. Moreover, by analyzing properties of >2,600 research fields, we observed that citation-based metrics are not beneficial for comparing researchers in different fields, or even in the same department. Conclusions: Academic publishing has changed considerably; now we need to reconsider how we measure success.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures















![Figure 16: The mean number of citations [Citation Number/Documents Number (2 years)] over time. The mean number of citations values have almost doubled in the past 18 years; additionally, their distributions have changed considerably.](https://figures.cochat.ai/paper-figures/03933677bbea423b8340291d60efccd5/over-optimization-of-academic-publishing-metrics-observing-goodhart-s-law-in-figure-16.jpg)






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As articles that describe miR functions have also been shown to be highly cited (60)”
From Identification of human gene research articles with wrongly identified nucleotide sequences (2022) · cites this paper as [60]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, the number of academic papers published per year is more than 7 million (Fire and Guestrin, 2019).”
From ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models (2025) · cites this paper as Fire and Guestrin, 2019
In the citing paper
“Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role in scientific advancement (23).”
From Misinformation in and about science (2021) · cites this paper as [23]
In the citing paper
“Much of the present pathology of hype, hyperbole, and publication bias is associated with an overreliance on productivity metrics (23).”
From Misinformation in and about science (2021) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Observation of Gravitational Waves from a Binary Black Hole Merger
Abbott, B. P., Abbott, R., Abbott, T. D., Abernathy, M. R., Acernese, F., Ackley, K., Adams, C., Adams, T., Addesso, P., Adhikari, R. X., et al. (2016) · Physical Review Letters · doi:10.1103/physrevlett.116.061102 · Cited by 14,151 · cited 1×
“For example, the recent Laser Interferome-ter Gravitational-Wave Observatory paper [37] listed > 1,000 authors [38].”
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · cited 2×
“Another common metric to measure a researcher’s output or a journal’s impact is the h-index, which measures an author’s or a journal’s number of papers that have at least h citations each [3].”
BackgroundMethodThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447 · cited 1×
“Even with their many known shortcomings [8, 24, 55, 68– 70], measures such as the impact factor, citation number, and h-index are still widely used.”
ArnetMiner: extraction and mining of academic social networks
Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., & Su, Z. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1402008 · Cited by 2,231 · cited 1×
“The AMiner open academic graph dataset [77] contains data from > 154 million papers.”
Fortunato, S., Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., Petersen, A. M., Radicchi, F., Sinatra, R., Uzzi, B., et al. (2018) · Science · doi:10.1126/science.aao0185 · Cited by 1,497 · cited 1×
“This research is a large-scale scientometrics study (also referred to as the “science of science” [30]).”
The Extent and Consequences of P-Hacking in Science
Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002106 · Cited by 1,388 · cited 2×
“…of the measures can be compromised, and unwelcome and unethical behaviors may develop, such as salami publications [17], ghost author-ships [18], p-hacking [19], metrics manipulation [20], faking research data [21], faking of peer reviews [22], and even plagiariz-ing by a peer reviewer [23].”
Does the h index have predictive power?
Hirsch, J. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0707962104 · Cited by 973 · cited 1×
“It has been shown that the h-index can predict academic achievements [57].”
Assessing the impact of planned social change
Campbell, D. T. (1979) · Evaluation and Program Planning · doi:10.1016/0149-7189(79)90048-x · Cited by 957 · cited 2×
“Good-hart’s Law, and the closely related Campbell’s Law [11], influence many systems in our everyday life, including educational [11], biological [12], and other decision-making systems [13, 14].”
The “Gender Gap” in Authorship of Academic Medical Literature — A 35-Year Perspective
Jagsi, R., Guancial, E. A., Worobey, C. C., Henault, L. E., Chang, Y., Starr, R., Tarbell, N. J., & Hylek, E. M. (2006) · New England Journal of Medicine · doi:10.1056/nejmsa053910 · Cited by 870 · cited 2×
“Additionally, Gwilym Lockwood observed that “articles with positively-framed titles, interesting phrasing, and no word-play get more attention online” [45].”
Research works printed but not linked: 6
- 2003, Central Banking, Monetary Theory and Practice: Essays in honour of Charles Goodhart, 221
- Francescani, 2012, NYPD report confirms manipulation of crime stats, Reuters
- Economist, 2016, Why research papers have so many authors, The Economist
- Gálvez, 2000, Scientific publication trends and the developing world: What can the volume and authorship of scientific articles tell us about scientific progress in various regions?, American Sci, 88, 526
- 2016, KDD Cup 2016: Whose papers are accepted the most: towards measuring the impact of research institutions
- Low, 2014, Graphlab: A new framework for parallel machine learning, 1006.4990
Cited by
Items 201–300 of 356
Alunno‐Bruscia, M., Duquennoi, C., Goulletquer, P., Jaligot, E., Kremer, A., Ruphy, S., & Simon-Plas, F. (2023) · Éditions Quæ eBooks · doi:10.35690/978-2-7592-3718-0 · Cited by 1
Inclusion of Librarians and Information Professionals in Canadian Knowledge Synthesis Grant Funding
Henshaw, B., Bradshaw, R., & Geyer, A. (2024) · Journal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · doi:10.29173/jchla29701 · Cited by 2
“The increasing prevalence of knowledge synthesis research in and beyond the health and medical fields has offered opportunities for librarians to step into additional research roles in academic and special libraries [3,4].”
BackgroundGabirondo-López, J., Gabirondo-López, I., Tasci, E. S., & Madariaga, G. (2024) · Journal of Applied Crystallography · doi:10.1107/s1600576724007908 · Cited by 1
SyROCCo: enhancing systematic reviews using machine learning
Fang, Z., Arana‐Catania, M., van Lier, F.-A., Velarde, J. O., Bregazzi, H., Airoldi, M., Carter, E., & Procter, R. (2024) · Data & Policy · doi:10.1017/dap.2024.33 · Cited by 3
“With an exponential increase in the number of articles published in the past 20 years (Fire and Guestrin, 2019), however, it has become increasingly difficult for researchers to systematically review all of the publications that are relevant to a specific topic.”
BackgroundChen, E. Y., Trudnowska, E., & Błachowiak‐Samołyk, K. (2024) · Journal of Biogeography · doi:10.1111/jbi.15046 · Cited by 1
“With an exponential surge in academic papers being published annually from approximately 1 million papers in 1980 to over 7 million papers in 2014 (Fire and Guestrin 2019), the rise in disjunct distribution studies may be explained in part by a temporal increase in scientific publications.”
Mamedov, V. Y., Kovalevsky, D. A., Morozov, D. A., Stolyarov, S. S., & Ospichev, S. (2025) · Modeling and Analysis of Information Systems · doi:10.18255/1818-1015-2025-1-80-94 · Cited by 2
Alexiou, C., & Saridakis, G. (2025) · Journal of Entrepreneurship and Innovation in Emerging Economies · doi:10.1177/23939575251335084 · Cited by 4
“This notion has been extensively discussed in the context of academia (e.g., Fire & Guestrin, 2019).”
Wade, S. A., Skovhus, T. L., & Lee, J. S. (2025) · CORROSION · doi:10.5006/4710 · Cited by 2
Toward a Values-Driven Research Culture: Passion, Collaboration, and Decency
Borghi, M., & Viglia, G. (2025) · Journal of Travel Research · doi:10.1177/00472875251359513 · Cited by 1
“For example, the pressure to satisfy metric-based criteria can encourage practices like focusing on safe, incremental studies that are easier to publish but contribute less to advancing knowledge (Fire & Guestrin, 2019; Kozlov, 2023).”
Integrating Large Citation Datasets
Yueksel-Erguen, I., Litzel, I., & Peng, H. (2025) · Lecture notes in operations research · doi:10.1007/978-3-031-92575-7_7 · Cited by 1
Towards Scalable Evaluation of Software Understanding: A Methodology Proposal
Magin, F., Wache, M., Scherf, F., Fischer, C., & Zabel, J. (2025) · doi:10.1145/3733822.3764672 · Cited by 3
“This observation has been attributed to Charles Goodhart [9] and consequently, it is commonly called Goodhart’s Law [4, 6].”
The Architecture of Academic Overproduction: Toward Post-AI Scholarship
Lang, C., Moffett, C., & Vasudevan, L. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-11108-1_36 · Cited by 1
Spagert, L. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-06241-5 · Cited by 1
“…academic system ’ s reliance on quantitative indicators, such as the number of publications, h-index or impact factors as the main measure of success has been criticised for incentivising quantity over quality and leading to a culture of “ publish or perish ” (Fire and Guestrin 2019; Allen 2025).”
Tran, D.-Q., Ho, M.-T., Tran, T. T.-T., Hoang, T. T.-D., Phan, H. T., Nguyen, N. N., Vo, V.-T., Tran, H. P., & Tran, L.-G. (2025) · Asian Pacific Journal of Reproduction · doi:10.4103/apjr.apjr_128_25 · Cited by 1
Making Research Public. Ethics, Politics, and the Power of Plural Dissemination
Page, T. (2026) · Matter Journal of New Materialist Research · doi:10.1344/jnmr.v11i.49942 · Cited by 2
Structural Evolution of the Ecuadorian Scopus-Indexed Journal Ecosystem During 2016–2025
Quelal, O. M., & Taimal, A. L. Y. (2026) · Publications · doi:10.3390/publications14030049 · Cited by 1
“…relative expansion of technological areas within the Ecuadorian publishing ecosystem, aligned with digitization, artificial intelligence, and technological innovation, as has been reported in emerging economies with strategies focused on strengthening applied science (Fire & Guestrin, 2019).”
Pozitivist-Ampirik Araştırmalarda İnsan: Yanıltmacanın Dünü, Bugünü ve Yarını - 2
Yüksel, A. (2020) · Seyahat ve Otel İşletmeciliği Dergisi · doi:10.24010/soid.720112 · Cited by 1
A herpetologia no Estado do Tocantins, Norte do Brasil: um estudo cientométrico
Neto, D. J. D. C., Dantas, S. P., de Almeida, J. A., & Malvásio, A. (2022) · Acta Biológica Paranaense · doi:10.5380/abp.v51i1.84052 · Cited by 1
There are many ways for research to be influential, not just citations
Calver, M. (2022) · Pacific Conservation Biology · doi:10.1071/pc22041 · Cited by 1
Bibrecord-Based Literature Management with Interactive Latent Space Learning
Watanabe, S., Ito, H., Matsubara, M., & Morishima, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21756-2_13 · Cited by 1
The bibliometric journey of IJATE from local to global
Karamustafaoğlu, O., Orbay, M., & Kara, İ. (2023) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.1212539 · Cited by 1
Research Networks and Publications in Economics: Evidence from a Small Developing Country
Amarante, V., Bucheli, M., & Rodriguez, M. (2023) · Journal of the Knowledge Economy · doi:10.1007/s13132-023-01282-0 · Cited by 1
“The limitations and distortions that these metrics may create in a hypercompetitive environment are being discussed at present for all sciences (see, e.g., Fire & Guestrin, 2019; Paulus et al., 2015, 2018), and to some extent, also concerning Economics (Heckman & Moktan, 2020; Ham-mermesh, 2021).”
She is an Expert in this Research Field: The Signal of Recent Publications' Relevance
Zeevi, G., & Mokryn, O. (2023) · Northeast Journal of Complex Systems · doi:10.22191/nejcs/vol5/iss1/7/ · Cited by 1
The commodification of academic publishing – Relevance to cancer palliative care literature
Ghoshal, A. (2023) · Current Medicine Research and Practice · doi:10.4103/cmrp.cmrp_111_23 · Cited by 1
Japanese national university faculty publication: A time trend analysis
Gallagher, N., & Muller, T. (2023) · Open Linguistics · doi:10.1515/opli-2022-0244 · Cited by 1
Human-in-the-loop latent space learning for biblio-record-based literature management
Watanabe, S., Ito, H., Matsubara, M., & Morishima, A. (2024) · International Journal on Digital Libraries · doi:10.1007/s00799-023-00389-8 · Cited by 1
Evaluation of Placename Geoparsers
Kenyon, J., Karl, J. W., & Godfrey, B. (2023) · Journal of Map & Geography Libraries · doi:10.1080/15420353.2024.2357115 · Cited by 1
“With millions of research papers being published every year in tens of thousands of journals (Fire and Guestrin 2019), map-based discovery and searching for scientific literature will remain a novelty unless effective strategies for geolocating studies en masse are developed.”
JUFOn vaikutus yliopistoissa työskentelevien tutkijoiden julkaisukanavia koskeviin päätöksiin
Aarnikoivu, M., Mathies, C., & Piattoeva, N. (2024) · Tiedepolitiikka · doi:10.58957/tp.142821 · Cited by 1
“Kuten Goodhartin laki toteaa, ”kun mit-tarista tulee tavoite, se menettää merkityksensä” (Fire & Guestrin, 2019, s. 1).”
Emmer, A. (2024) · Geoenvironmental disaster reduction · doi:10.1007/978-3-031-58421-3_5 · Cited by 1
Alcances y límites educativos de la IA: control e ideología en el uso de ChatGPT
Jarquín-Ramírez, M.-R., Martínez, H. A., & Gutiérrez, E. J. D. (2024) · DIDAC · doi:10.48102/didac.2024..84_jul-dic.217 · Cited by 4
“…similares puedan cambiar la forma en que se difunden y verifican los resultados de la investigación en la ya de por sí saturada inflación de papers (Dwivedi et al., 2023), lo cual resulta relevante ante el excesivo incremento en la publicación de artículos científicos (Fire & Guestrin, 2019).”
BackgroundA influência de autocitações em decisões editoriais baseado na simulação de rankings de periódicos
Correia, L. G., & Mena‐Chalco, J. P. (2024) · Ciência da Informação · doi:10.18225/ci.inf.v53i.6924 · Cited by 1
Chandrabhatla, A. S., Narahari, A. K., Qiu, K. T., Vasiliadis, T. G., Nguyen, J. D. K., Singh, A., Gray, K., Strobel, R. J., Yount, K. W., Yarboro, L. T., et al. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.08.017 · Cited by 1
Lechner, I. M., Ajdari, E. N., van Woudenberg, R., de Ridder, J., Bouter, L. M., & Tijdink, J. K. (2024) · Policy Reviews in Higher Education · doi:10.1080/23322969.2024.2431744 · Cited by 1
“Perhaps participants worried that any evaluation could be turned into another ranking (Fire and Guestrin 2019).”
Determinanty produkcie znalostí na európskych univerzitách
Šimčisko, J. (2025) · Ekonomika a spoločnosť · doi:10.24040/eas.2025.26.1.124-141 · Cited by 1
Goodhart’s Law and The Meritocratic Illusion
Bosco, L. (2025) · International Journal of Humanities and Social Science · doi:10.30845/ijhss.v15p37
Shrestha, S. R., Olivetti, L., Pandey, S., Worou, K., & Raffetti, E. (2025) · Progress in Disaster Science · doi:10.1016/j.pdisas.2025.100503 · Cited by 3
“Goodhart ’ s Law which states that ‘when a measure becomes a target, it ceases to become a measure ’ has become pertinent in academia [3] and demands critical introspection from academics, funding agencies, and universities alike.”
Paper Mills for research writing and publication: A threat to the integrity of science
Shah, J. N., & Shah, J. (2021) · Journal of Kathmandu Medical College · doi:10.3126/jkmc.v10i4.43865 · Cited by 3
Recherche et dogmatisme : de l’improductivité du productivisme
Blanchard, E., & Boubli, Z. (2022) · Questions de communication · doi:10.4000/questionsdecommunication.29994 · Cited by 2
Digi-flash pedagogy confronts new emerging technologies - Maturity level evaluation case study
Liljaniemi, A., Paavilainen, H., & Tuominen, T. (2023) · Cogent Engineering · doi:10.1080/23311916.2023.2186201 · Cited by 1
Economically rational sample-size choice and irreproducibility.Preprint
Braganza, O. (2019) · arXiv (Cornell University) · Cited by 1
Scientometric correlates of high-quality reference lists in ecological papersPreprint
Mammola, S., Fontaneto, D., Martínez, A., & Chichorro, F. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.27.011106 · Cited by 1
Scientific civility and academic performancePreprint
Camacho, E., Dragotakes, Q., Hartshorn, I., Casadevall, A., & Buccino, D. L. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.26.525747 · Cited by 1
Improving the scientific cycle
Zhang, H., & Zhu, J. (2023) · The Innovation Life · doi:10.59717/j.xinn-life.2023.100002 · Cited by 1
Publications! Where are we going?
Sivapathasundharam, B. (2024) · Journal of Oral and Maxillofacial Pathology · doi:10.4103/jomfp.jomfp_77_24 · Cited by 1
“[1] Presently, there is an inundation of journals and articles, which often perplexes rather than help the readers and authors.”
BackgroundGaming the Metrics? Bibliometric Anomalies and the Integrity Crisis in Global University RankingsPreprint
Meho, L. I. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.09.653229 · Cited by 4
The Good, the Bad and the Constructive: Automatically Measuring Peer Review’s Utility for Authors
Sadallah, A., Baumgärtner, T., Gurevych, I., & Briscoe, T. (2025) · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2025.emnlp-main.1476 · Cited by 1
The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors
Sadallah, A., Baumgärtner, T., Gurevych, I., & Briscoe, T. (2025) · arXiv · doi:10.48550/arxiv.2509.04484
“However, with the rapidly growing number of submissions to conferences and journals (Fire and Guestrin, 2019; Bornmann et al., 2020), the peer review process is Figure 1: An example from our RevUtil dataset.”
Lyon, D. (2019) · Oncology nursing forum · doi:10.1188/20.onf.13-14
Quality control of the peer-review process by Forensic Sciences Research
Li, S. (2019) · Forensic Sciences Research · doi:10.1080/20961790.2019.1700886
Padovani, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04778
“1%, down from even higher values in previous years [12].”
BackgroundPadovani, P. (2020) · Multifrequency Behaviour of High Energy Cosmic Sources Workshop (MULTIF) · doi:10.22323/1.362.0078
TeamTree analysis: a new approach to evaluate scientific productionPreprint
Pfrieger, F. W. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.01.128355
Mind the gap in university rankings: a complex network approach towards fairnessPreprint
Bellantuono, L., Monaco, A., Amoroso, N., Aquaro, V., Bardoscia, M., Loiotile, A. D., Lombardi, A., Tangaro, S., & Bellotti, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.01341
“The first problem is reactivity to rankings, namely the development of adaptation strategies to gain competitive advantages with respect to the evaluation criteria, leading to academic conformism (13,18-22).”
Backgroundメディアとパトリの島・奄美--地域から情報発信とその文化的苗床との連環を焦点にして
加藤, 晴., & 寺岡, 伸. (2010) · Medical Entomology and Zoology
Fifty years of Nordic social medicine and public health: snapshots of a journal
Allebeck, P., & Janlert, U. (2022) · Scandinavian Journal of Public Health · doi:10.1177/14034948221083108
“Data from other public health journals are difficult to find, but the general appreciation of the increase in scientific articles confirms that a six-fold increase in the number of publications throughout the period is a general phenomenon in the scientific world [1].”
BackgroundVandersickel, N. (2022) · The Project Repository Journal · doi:10.54050/prj1318816
Why You Earned It: Fighting the Impostor
Ayres, Z. J. (2022) · Springer eBooks · doi:10.1007/978-3-031-14194-2_7
Escrever, Rever e Editar em Ciência
Subtil, J. (2022) · Gazeta Médica · doi:10.29315/gm.v9i3.681
The tyranny of bogus numbers in academia
Doozandeh, P. (2022) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/3558187
“Researchers and faculty are increasingly being hired and promoted based on these statistics [1] and institutions with higher rankings are more likely to receive government funding [2].”
BackgroundJung, J., Lee, J., Choi, S., & Baek, W. (2022) · Energies · doi:10.3390/en16010033
Evaluating Keyphrase Extraction Methods for Clustering Influenza-Related Scientific Papers
Forghani, M., Firstkov, A., AlyanNezhadi, M. M., & Forghani, K. (2022) · Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS) · doi:10.1109/icspis56952.2022.10043863
“Statistics show that the volume of published articles has increased from less than 1 million in 1980 to more than 7 million articles in 2014 [1], which makes it difficult for researchers to find fresh relevant articles without using specific search tools.”
BackgroundPlan for Constructing DataDiscoveryLab: Creating DataBases for Well-Rounded SearchesPreprint
Keskinoglu, E. (2023) · Preprints.org · doi:10.20944/preprints202304.1074.v2
Mantoan, D., Fischer, F., & Tramelli, B. (2023) · magazén · doi:10.30687/mag/2724-3923/2023/07
(2023) · The MIT Press eBooks · doi:10.7551/mitpress/14922.003.0016
La comunicación académica en un mundo de plataformas
Giordanino, E. P. (2023) · Biblioteca Universitaria · doi:10.22201/dgbsdi.0187750xp.2023.1.1487 · Cited by 3
Late to the Party: Articulating Time and Care in Interdisciplinary Projects
Croissant, J. L. (2023) · Catalyst Feminism Theory Technoscience · doi:10.28968/cftt.v9i2.39341 · Cited by 1
Moosa, I. A. (2024) · Edward Elgar Publishing eBooks · doi:10.4337/9781035307807.00019
Sucaldito, M. S. F. P., & Yu, K. C. (2024) · doi:10.2196/preprints.57648 · Cited by 1
Overview of Approaches for Increasing Coherence in Extractive Summaries
Akhmetova, D., & Akhmetov, I. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-53963-3_41
Introduction to clinical research
Bindi, V. E., Hones, K. M., & Hao, K. A. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-85663-8.00033-7
Compton, W., Dennis, B., Clark, P., Smith, C., Nees, D., Hughes, G. K., & Vassar, M. B. (2024) · BJGP Open · doi:10.3399/bjgpo.2023.0183
Roos, M. W. M. (2024) · Classroom companion: economics · doi:10.1007/978-3-031-51436-4_1
Reeve, C. (2024) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2024-16104
Samyoung, Y. U., Ahn, J., & Choi, M. (2024) · Science Editing · doi:10.6087/kcse.335
Braet, F., Romani, R., Hofer, F., Kaiser, U. A., & Egerton, R. F. (2024) · Micron · doi:10.1016/j.micron.2024.103727
Why Do Researchers Falsify Data or Manipulate Study Findings?
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.ch7
Historiography of Scientific Publishing across Cultures and Disciplines
Hosur, B., Tripathi, M., Vyas, S., Shaikh, S., & Ahuja, C. K. (2025) · Indian journal of radiology and imaging - new series/Indian journal of radiology and imaging/Indian Journal of Radiology & Imaging · doi:10.1055/s-0044-1800865 · Cited by 3
Exploring the science and data foundation for Federal public lands decisions
Foster, A. C., Canchola, A. T., Haby, T. S., & Carter, S. K. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316013
Demarcation that Makes the Layperson Smart
Makuła, S. (2025) · Journal for General Philosophy of Science · doi:10.1007/s10838-024-09693-6
“In 2014, the number of scientific journals with a peer-review system exceeded 34,000, the number of published papers surpassed 7,000,000 (Fire and Guestrin 2019 ), and it continues to grow as the vol - ume of scientific literature tends to double roughly every twelve years (Price 1986 ).”
Las prácticas cuestionables de investigación en la comunidad científica hispanohablante
García, A. M. R., Artigas, W., Romero, I. I. C., & Puga, J. L. (2025) · Revista española de Documentación Científica · doi:10.3989/redc.2025.1.1605
The Fall of Scientometrics: Its Political Rise and Scientific Demise
Šumonja, M. (2025) · Etnoantropološki problemi / Issues in Ethnology and Anthropology · doi:10.21301/eap.v20i1.11
Gaming the Metrics? Bibliometric Anomalies and the Integrity Crisis in Global University RankingsPreprint
Meho, L. I. (2025) · Research Square · doi:10.21203/rs.3.rs-6632378/v1
Park, K.-R., Lee, K., & Park, S. (2025) · Early Childhood Education Journal · doi:10.1007/s10643-025-01932-9
Towards an Open Science—An Academic Recommendation Cloud Platform
Kobusińska, A., Tabaczyński, D., & Chang, V. I. C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-97635-3_34
Kanaparthy, N. S., Possick, S. E., Teng, W., Maulion, C., & Kim, N. V. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330188
“With seven million articles published annually, clinicians struggle to keep pace with new evidence [14].”
Pernagallo, G. (2025) · Economics of Governance · doi:10.1007/s10101-025-00335-1
“Analysis of historical data (Fortunato et al. 2018; Fire and Guestrin 2019) showed an exponential growth in the number of articles published over the years.”
Andersen, P. L., Jemec, G. B. E., & Polesie, S. (2025) · Journal of Dermatological Treatment · doi:10.1080/09546634.2025.2559004
“Seemingly, our data demonstrates a rise in the number of published manuscripts over time (Table S2), in accordance with scientific publication tendency as such (57).”
Yüksel, A. (2025) · CABI eBooks · doi:10.1079/9781800628076.0001
A Modular Approach to Research Quality
Bekkers, R. (2025) · doi:10.59350/03g1k-nc619
Drinking from the firehose? Write more and Publish Less (Version 2)
Marcum, C. S. (2025) · doi:10.54900/tvby7-zsx87 · Cited by 1
The False Currency of Authorship.
Montero, J. A. (2025) · American Journal of Medicine · doi:10.1016/j.amjmed.2025.10.001
Mamun, M. A., Huraira, M. A., Begum, M., Jitu, M. H. I., Muntashir, N., Khan, M. M., Das, P., Rahman, S., Misma, U. Z., Nath, S. K., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-19488-4 · Cited by 1
Muller, T., & Adamson, J. L. (2025) · Journal of Second Language Studies · doi:10.1075/jsls.00057.mul · Cited by 1
A Modular Approach to Research Quality
Bekkers, R. (2025) · doi:10.59350/yaj6t-tcx28
Metadata
- Authors
- Fire, M., & Guestrin, C.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- University of Washington (US)
- Corresponding author
- Fire, Michael
- Guestrin, Carlos
- Venue
- GigaScience
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-05-30
- Volume
- 8
- Issue
- 6
- ISSN
- 2047-217X (ISSN-L)
- PMC
- PMC6541803
- OpenAlex
- W2890107153
- Cited by
- 351
- References
- 77
- Citations by year
- 2026: 52 · 2025: 74 · 2024: 65 · 2023: 65 · 2022: 46 · 2021: 18 · 2020: 20 · 2019: 9
- FWCI
- 15.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- GigaScience (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Washington Research Foundation
- University of Washington
- Amazon Web Services
- Microsoft Azure Research Award
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- Goodhart's law, citation metrics, impact factor, h-index, publication counts, self-citation, author list, research evaluation, biology research, bibliometric analysis
- MeSH terms
- Publishing, Bibliometrics, Benchmarking, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.