Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2)
Open accessThe DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Abstract
The expansion of university rankings has intensified competition among institutions and reshaped research priorities worldwide. Bibliometric indicators underpin many of these rankings, and their growing influence has raised concerns about systemic distortions in scholarly behavior. This study investigates publication and authorship patterns among the world’s 88 fastest-growing research universities across two periods (2018–2019 and 2023–2024) to assess whether rapid rank mobility coincides with bibliometric anomalies indicative of metric-driven practices. The analysis identified 21 institutions with trajectories sharply diverging from global and regional norms, characterized by steep declines in first and corresponding authorship, disproportionate surges in STEM output, rising numbers of hyper-prolific authors, and elevated exposure to integrity-related risks. To systematically identify and quantify such risks, the study introduces the Research Integrity Risk Index (RI 2 ). This field-normalized composite metric integrates publications in delisted journals, retractions, and self-citation shares, and classifies institutions across five integrity-risk tiers. Applied to the study cohort, RI 2 clearly distinguishes high-risk from benchmark institutions, providing a transparent framework for detecting systemic vulnerabilities, strengthening accountability in global research evaluation, and shifting the focus from performance maximization to integrity-sensitive assessment and governance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The parallel Research Integrity Risk Index uses similar signal categories”
From Artificial intelligence to enhance research integrity in evidence-based medicine: toward scalable trustworthiness assessment (2026) · cites this paper as Meho, 2025
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
3 retracted
Abalkina, A. (2023) · Learned Publishing · doi:10.1002/leap.1574 · Cited by 101 · cited 3×
“…2024; Li et al., 2019; Silva et al., 2020) to authorship abuses, such as gift, guest, ghost, and sold authorship and multi-affiliation inflation (Abalkina, 2023; Chirico & Bramstedt, 2023; Halevi et al., 2023; Hottenrott et al., 2021; Kuan et al., 2024; Morreim & Winer, 2023; Pruschak & Hopp,…”
RetractedCandal‐Pedreira, C., Guerra-Tort, C., Ruano‐Raviña, A., Freijedo-Farinas, F., Rey‐Brandariz, J., Ross, J. S., & Pérez‐Ríos, M. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111397 · Cited by 40 · cited 3×
“Measures the proportion of an institution’s research output that has been retracted, serving as a critical marker of research integrity (Candal-Pedreira et al., 2024; Fang et al., 2012; Feng et al., 2024; Gedik et al., 2024; Ioannidis et al., 2025).”
RetractedSebo, P., & Sebo, M. (2025) · Accountability in Research · doi:10.1080/08989621.2025.2465621 · Cited by 7 · cited 1×
“• Retraction Watch Database (Crossref) was the principal source for identifying retracted publications (Sebo & Sebo, 2025a, 2025b).”
RetractedDiMaggio, P. J., & Powell, W. W. (1983) · American Sociological Review · doi:10.2307/2095101 · Cited by 38,435 · cited 1×
“This tendency is reinforced by institutional isomorphism (DiMaggio & Powell, 1983), whereby institutions emulate perceived leaders even when such strategies conflict with local missions or capacities.”
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · cited 2×
“Metadata deficiencies such as missing affiliation and DOI data further undermine reliability (Chinchilla-Rodríguez et al., 2024; Culbert et al., 2025; Liu & Wang, 2025; Pranckutė, 2021; Singh et al., 2024).”
The Journal Coverage of Web of Science, Scopus and Dimensions: A Comparative Analysis
Singh, V. K., Singh, P., Karmakar, M., Leta, J., & Mayr, P. (2021) · Scientometrics · doi:10.1007/s11192-021-03948-5 · Cited by 2,342 · cited 2×
“…and Web of Science—exhibit well-documented asymmetries by coverage, document type, discipline, and language, with database choice considerably altering publication counts, field distributions, and national shares (Alshrai-deh & Abdelgawad, 2025; Li, 2025; Singh et al., 2021; Visser et al., 2021).”
Baas, J., Schotten, M., Plume, A., Côté, G., & Karimi, R. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00019 · Cited by 2,093 · cited 1×
“• Scopus and Web of Science served as primary sources for publication and citation data, retractions, and publications in delisted journals (Baas et al., 2020; Birkle et al., 2020; Pranckutė, 2021).”
Web of Science as a Data Source for Research on Scientific and Scholarly Activity
Birkle, C., Pendlebury, D. A., Schnell, J., & Adams, J. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00018 · Cited by 1,283 · cited 1×
“• Scopus and Web of Science served as primary sources for publication and citation data, retractions, and publications in delisted journals (Baas et al., 2020; Birkle et al., 2020; Pranckutė, 2021).”
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 2×
“Measures the proportion of an institution’s research output that has been retracted, serving as a critical marker of research integrity (Candal-Pedreira et al., 2024; Fang et al., 2012; Feng et al., 2024; Gedik et al., 2024; Ioannidis et al., 2025).”
Visser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865 · cited 1×
“…and Web of Science—exhibit well-documented asymmetries by coverage, document type, discipline, and language, with database choice considerably altering publication counts, field distributions, and national shares (Alshrai-deh & Abdelgawad, 2025; Li, 2025; Singh et al., 2021; Visser et al., 2021).”
Research works printed but not linked: 3
- Fauzi, M. A., Tan, C. N. L., Daud, M., & Awalludin, M. M. N. (2020). University rankings: A review of methodological flaws. Issues in Educational Research, 30(1), 79–96.
- Hottenrott, H., Rose, M. E., & Lawson, C. (2021). The rise of multiple institutional affiliations in academia. Journal of the Association for Information Science and Technology, 72(8), 1039–1058. https://doi.org/10.1002/asi.24472 · DOI
- Stack, M. (2021). Global university rankings and the politics of knowledge [Book]. University of Toronto Press. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85116047916&partnerID=40&md5=9bcce848c8b033b600d8084dca1c30c7
Cited by
Eltaybani, S. (2026) · Intensive and Critical Care Nursing · doi:10.1016/j.iccn.2026.104387 · Cited by 5
Jiménez, R. S., Rodríguez, J., Guerrero‐Bote, V. P., & de Moya-Anegon, F. (2026) · Journal of Informetrics · doi:10.1016/j.joi.2026.101803 · Cited by 3
Makhmetov, A., & Yessenbekova, K. (2026) · Asian Education and Development Studies · doi:10.1108/aeds-08-2025-0424 · Cited by 3
Beyond Retractions: A Topic-Based Analysis of the Impact and Lifespan of Retracted Papers
Lou, Y., Zhou, Z., & Li, M. (2026) · Journal of Data and Information Science · doi:10.1515/jdis-2026-0064 · Cited by 2
“Retraction count and retraction rate have thus emerged as primary indicators for assessing research integrity (Fang et al. 2012; Van Noorden 2023; Li and Shen 2024; Zhou et al. 2026; Meho 2025; Lou et al. 2026b).”
Mo, M., Arora, R., Cao, C., Tricco, A. C., & Moher, D. (2026) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2026.1833223
“The parallel Research Integrity Risk Index uses similar signal categories (Meho, 2025).”
Metadata
- Authors
- Meho, L. I.
- Affiliations
- American University of Beirut (LB)
- Corresponding author
- Meho, Lokman I.
- ORCID
- Meho, Lokman I.
- Venue
- Scientometrics
- Published
- 2025-11
- Volume
- 130
- Issue
- 11
- Pages
- 6683-6726
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W4416199265
- Semantic Scholar
- 3a519ccc055ec1666d37a47269c8f00c97013329
- Cited by
- 27
- References
- 95
- Citations by year
- 2026: 27
- FWCI
- 17.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 11 d)
- Locations
- Scientometrics (publishedVersion, cc-by)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- university rankings, research integrity, publication metrics, authorship patterns, retraction, self-citation, research evaluation, research governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2). https://app.cochat.ai/papers/10.1007/s11192-025-05480-2
- The paper
- Meho, L. I. (2025). Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2). Scientometrics. https://doi.org/10.1007/s11192-025-05480-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.