CoChat

Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2)

Open access
Meho, Lokman I. · 2025 · Scientometrics

The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.

Abstract

The expansion of university rankings has intensified competition among institutions and reshaped research priorities worldwide. Bibliometric indicators underpin many of these rankings, and their growing influence has raised concerns about systemic distortions in scholarly behavior. This study investigates publication and authorship patterns among the world’s 88 fastest-growing research universities across two periods (2018–2019 and 2023–2024) to assess whether rapid rank mobility coincides with bibliometric anomalies indicative of metric-driven practices. The analysis identified 21 institutions with trajectories sharply diverging from global and regional norms, characterized by steep declines in first and corresponding authorship, disproportionate surges in STEM output, rising numbers of hyper-prolific authors, and elevated exposure to integrity-related risks. To systematically identify and quantify such risks, the study introduces the Research Integrity Risk Index (RI 2 ). This field-normalized composite metric integrates publications in delisted journals, retractions, and self-citation shares, and classifies institutions across five integrity-risk tiers. Applied to the study cohort, RI 2 clearly distinguishes high-risk from benchmark institutions, providing a transparent framework for detecting systemic vulnerabilities, strengthening accountability in global research evaluation, and shifting the focus from performance maximization to integrity-sensitive assessment and governance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11192-025-05480-2

Cites

96 of 96 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY · From the PDF
Fig. 3 Research growth of study, regional, and international universities (2018-2019 to 2023-2024). A blank space separates the study group (left) from the regional group (middle) and international group (right). The percentages of increase for AUB, UC Berkeley, and UMD do not appear because they dropped in research output by 5%, 2%, and 7%, respectively. Data Source: SciVal (August 20, 2025)
Fig. 3 Research growth of study, regional, and international universities (2018-2019 to 2023-2024). A blank space separates the study group (left) from the regional group (middle) and international group (right). The percentages of increase for AUB, UC Berkeley, and UMD do not appear because they dropped in research output by 5%, 2%, and 7%, respectively. Data Source: SciVal (August 20, 2025)CC-BY · From the PDF
Fig. 4 Global research output rankings of study, regional, and international universities (2018-2019 vs. 2023-2024). The figure shows sharp upward mobility in rankings among study group universities compared with modest or declining movement among most regional and international comparators. Data Source: SciVal (September 1, 2025)
Fig. 4 Global research output rankings of study, regional, and international universities (2018-2019 vs. 2023-2024). The figure shows sharp upward mobility in rankings among study group universities compared with modest or declining movement among most regional and international comparators. Data Source: SciVal (September 1, 2025)CC-BY · From the PDF
Fig. 5 Mismatch between faculty size and publication growth . The percent change in faculty count is plotted against the percent change in publication output (2018-2019 to 2023-2024). The diagonal orange line (y = x) represents proportional growth; points above this line reflect output increases that outpace faculty growth. Faculty data were compiled from official institutional fact books, annual reports, and national databases (e.g., India's NIRF and the U.S. Common Data Sets)
Fig. 5 Mismatch between faculty size and publication growth . The percent change in faculty count is plotted against the percent change in publication output (2018-2019 to 2023-2024). The diagonal orange line (y = x) represents proportional growth; points above this line reflect output increases that outpace faculty growth. Faculty data were compiled from official institutional fact books, annual reports, and national databases (e.g., India's NIRF and the U.S. Common Data Sets)CC-BY · From the PDF
Fig. 6 Subject-specific 2023-2024 world rankings of study group universities (top 100). IMAMU = AlImam Muhammad Ibn Saud Islamic University, KKU = King Khalid University, KSU = King Saud University, LAU = Lebanese American University, PNU = Princess Nourah Bint Abdulrahman University, PSAU = Prince Sattam Bin Abdulaziz University, QU = Qassim University, SIMATS = Saveetha Institute of Medical and Technical Sciences. Data source: Essential Science Indicators, via InCites (September 1, 2025)
Fig. 6 Subject-specific 2023-2024 world rankings of study group universities (top 100). IMAMU = AlImam Muhammad Ibn Saud Islamic University, KKU = King Khalid University, KSU = King Saud University, LAU = Lebanese American University, PNU = Princess Nourah Bint Abdulrahman University, PSAU = Prince Sattam Bin Abdulaziz University, QU = Qassim University, SIMATS = Saveetha Institute of Medical and Technical Sciences. Data source: Essential Science Indicators, via InCites (September 1, 2025)CC-BY · From the PDF
Fig. 7 Changes in first and corresponding authorship rates among study, regional, and international universities (2018-2019 vs. 2023-2024). The figure illustrates steep declines in first and corresponding authorship rates at all study group universities, in contrast to increases or more modest declines among regional and international comparators. In the corresponding authorship rate, MIT and UC Berkeley plot to the exact coordinates, so they look like a single line. Data Source: SciVal (September 1, 2025)
Fig. 7 Changes in first and corresponding authorship rates among study, regional, and international universities (2018-2019 vs. 2023-2024). The figure illustrates steep declines in first and corresponding authorship rates at all study group universities, in contrast to increases or more modest declines among regional and international comparators. In the corresponding authorship rate, MIT and UC Berkeley plot to the exact coordinates, so they look like a single line. Data Source: SciVal (September 1, 2025)CC-BY · From the PDF
Image 7
CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

3 retracted

Show all 96 references

Research works printed but not linked: 3

  1. Fauzi, M. A., Tan, C. N. L., Daud, M., & Awalludin, M. M. N. (2020). University rankings: A review of methodological flaws. Issues in Educational Research, 30(1), 79–96.
  2. Hottenrott, H., Rose, M. E., & Lawson, C. (2021). The rise of multiple institutional affiliations in academia. Journal of the Association for Information Science and Technology, 72(8), 1039–1058. https://doi.org/10.1002/asi.24472 · DOI
  3. Stack, M. (2021). Global university rankings and the politics of knowledge [Book]. University of Toronto Press. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85116047916&partnerID=40&md5=9bcce848c8b033b600d8084dca1c30c7

Cited by

See all 27

Metadata

Authors
Meho, L. I.
Affiliations
American University of Beirut (LB)
Corresponding author
Meho, Lokman I.
Venue
Scientometrics
Published
2025-11
Volume
130
Issue
11
Pages
6683-6726
ISSN
  • 0138-9130 (ISSN-L)
  • 1588-2861
OpenAlex
W4416199265
Cited by
27
References
95
Citations by year
2026: 27
FWCI
17.36
Type
journal article
Language
en
Open access
Licence
Locations
Scientometrics (publishedVersion, cc-by)
Topics
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
  • Social Sciences › Education › Academic integrity and plagiarism
  • Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
Keywords
university rankings, research integrity, publication metrics, authorship patterns, retraction, self-citation, research evaluation, research governance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2). https://app.cochat.ai/papers/10.1007/s11192-025-05480-2
The paper
Meho, L. I. (2025). Gaming the metrics: bibliometric anomalies in global university rankings and the research integrity risk index (RI2). Scientometrics. https://doi.org/10.1007/s11192-025-05480-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.