Regional and institutional trends in assessment for academic promotion
Open accessPublished version of a preprint
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
The assessment of research performance is widely seen as a vital tool in upholding the highest standards of quality, with selection and competition believed to drive progress. Academic institutions need to take critical decisions on hiring and promotion, while facing external pressure by also being subject to research assessment 1–4 . Here we present an outlook on research assessment for career progression with specific focus on promotion to full professorship, based on 314 policies from 190 academic institutions and 218 policies from 58 government agencies, covering 32 countries in the Global North and 89 countries in the Global South. We investigated how frequently various promotion criteria are mentioned and carried out a statistical analysis to infer commonalities and differences across policies. Although quantitative methods of assessment remain popular, in agreement with what is found in more geographically restricted studies 5–9 , they are not omnipresent. We find differences between the Global North and the Global South as well as between institutional and national policies, but less so between disciplines. A preference for bibliometric indicators is more marked in upper-middle-income countries. Although we see some variation, many promotion policies are based on the assumption of specific career paths that become normative rather than embracing diversity. In turn, this restricts opportunities for researchers. These results challenge current practice and have strategic implications for researchers, research managers and national governments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The pressures of the “publish or perish” culture are enhanced by academic policies that count publications and value journal impact factor (JIF) metrics as surrogates for scientific excellence and make salary increases, promotion, or scientific reputation dependent on these which varies among disciplines, institutions, and national policies (Van Dalen and Henkens 2012; Lim et al. 2025).”
From Fake publications in biomedical science: red-flagging method indicates mass production (2026) · cites this paper as Lim et al. 2025
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity
White, H. (1980) · Econometrica · doi:10.2307/1912934 · Cited by 25,861
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · cited 1×
“In the Leiden Manifesto, experts on sci-entometrics raised concerns that evaluation has increasingly become led by data rather than by judgement and warned of the misapplication of indicators, with the journal impact factor being a prime example 20,21 .”
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 1×
“However, the pursuit of ‘excellence’ through quantitative metrics often drives unethical behaviour 24,25 .”
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S. A., Jones, R. D., Kain, R. J. P., Kerridge, S., Thelwall, M. A., et al. (2015) · Digital Education Resource Archive (University College London) · doi:10.13140/rg.2.1.4929.1363 · Cited by 728
The Hong Kong Principles for assessing researchers: Fostering research integrity
Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M. H., Barbour, V., Coriat, A.-M., Foeger, N., & Dirnagl, U. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000737 · Cited by 540
Hall, K. L., Vogel, A. L., Huang, G. C., Serrano, K. J., Rice, E. L., Tsakraklides, S. P., & Fiore, S. M. (2018) · American Psychologist · doi:10.1037/amp0000319 · Cited by 497
(2021) · doi:10.54677/mnmh8546 · Cited by 448
Muller, J. Z. (2019) · Princeton University Press eBooks · doi:10.1515/9780691191263 · Cited by 444
Problems of Monetary Management: The UK Experience
Goodhart, C. A. E. (1984) · Monetary Theory and Practice · doi:10.1007/978-1-349-17295-5_4 · Cited by 416
The Perverse Effects of Competition on Scientists’ Work and Relationships
Anderson, M. S., Ronning, E. A., De Vries, R., & Martinson, B. C. (2007) · Science and Engineering Ethics · doi:10.1007/s11948-007-9042-5 · Cited by 384
Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations
McKiernan, E. C., Schimanski, L. A., Muñoz Nieves, C., Matthias, L., Niles, M. T., & Alperin, J. P. (2019) · eLife · doi:10.7554/elife.47338 · Cited by 347
Ter Bogt, H. J., & Scapens, R. W. (2012) · European Accounting Review · doi:10.1080/09638180.2012.668323 · Cited by 325
“Excellence R Us”: university research and the fetishisation of excellence
Moore, S., Neylon, C., Paul Eve, M., Paul O’Donnell, D., & Pattinson, D. (2017) · Palgrave Communications · doi:10.1057/palcomms.2016.105 · Cited by 264
Rice, D. B., Raffoul, H., Ioannidis, J. P. A., & Moher, D. (2020) · BMJ · doi:10.1136/bmj.m2081 · Cited by 241 · cited 1×
“However, performance indicators can become ends in themselves, and assessments lose effectiveness when misaligned with their original purpose 7,12 .”
Bumblebees learn foraging routes through exploitation-exploration cycles
Johnson, C., Prior, L., Archibald, S., Poulos, H., Barton, A., Williamson, G., & Bowman, D. (2018) · UTAS Research Repository · doi:10.6084/m9 · Cited by 190
Scientific misbehavior in economics
Necker, S. (2014) · Research Policy · doi:10.1016/j.respol.2014.05.002 · Cited by 181
Comparing Research and Teaching in University Promotion Criteria
Parker, J. (2008) · Higher Education Quarterly · doi:10.1111/j.1468-2273.2008.00393.x · Cited by 142
UNESCO Recommendation on Open Science
UNESCO (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5741832 · Cited by 140
UNESCO Recommendation on Open Science
UNESCO (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5741831 · Cited by 129
How Latin American researchers suffer in science
Valenzuela‐Toro, A. M., & Viglino, M. (2021) · Nature · doi:10.1038/d41586-021-02601-8 · Cited by 100
A survey-based analysis of the academic job market
Fernandes, J. D., Sarabipour, S., Smith, C. T., Niemi, N. M., Jadavji, N. M., Kozik, A. J., Holehouse, A. S., Pejaver, V. R., Symmons, O., Bisson‐Filho, A. W., et al. (2020) · eLife · doi:10.7554/elife.54097 · Cited by 94
Pontika, N., Klebel, T., Correia, A., Metzler, H., Knoth, P., & Ross‐Hellauer, T. (2022) · Quantitative Science Studies · doi:10.1162/qss_a_00224 · Cited by 87
How bullying becomes a career tool
Täuber, S., & Mahmoudi, M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01311-z · Cited by 85
Publish or be ethical? Publishing pressure and scientific misconduct in research
Paruzel‐Czachura, M., Baran, L. N., & Spendel, Z. (2020) · Research Ethics · doi:10.1177/1747016120980562 · Cited by 82
The role of collegiality in academic review, promotion, and tenure
Dawson, D., Morales, E., McKiernan, E. C., Schimanski, L. A., Niles, M. T., & Alperín, J. P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265506 · Cited by 70
Measuring research ‘impact’ for academic promotion: issues from the literature
Smith, K. M., Crookes, E., & Crookes, P. A. (2013) · Journal of Higher Education Policy and Management · doi:10.1080/1360080x.2013.812173 · Cited by 68
Mis-Measuring Our Universities: Why Global University Rankings Don’t Add Up
Gadd, E. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.680023 · Cited by 58
Mryglod, O., Kenna, R., Holovatch, Y. V., & Berche, B. (2013) · Scientometrics · doi:10.1007/s11192-013-1058-9 · Cited by 57
Advancing science or advancing careers? Researchers’ opinions on success indicators
Aubert Bonn, N., & Pinxten, W. (2021) · PLOS ONE · doi:10.1371/journal.pone.0243664 · Cited by 54
Excellence by Nonsense: The Competition for Publications in Modern Science
Binswanger, M. (2013) · Springer eBooks · doi:10.1007/978-3-319-00026-8_3 · Cited by 53
Kulczycki, E. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009351218 · Cited by 53
Curry, S., Gadd, E., & Wilsdon, J. (2022) · Figshare · doi:10.6084/m9.figshare.21701624 · Cited by 50
työryhmä, V. T. (2020) · Vastuullisen tieteen julkaisusarja · doi:10.23847/isbn.9789525995282 · Cited by 47
Mryglod, O., Ralph Kenna, B., Holovatch, Y. V., & Berche, B. (2013) · Coventry University Open Collections (Coventry university) · Cited by 45
United Nations Educational, S. A. C. O. (2021) · World science report · doi:10.18356/9789210058575 · Cited by 43
Tracing data: A survey investigating disciplinary differences in data citation
Gregory, K., Ninkov, A., Ripp, C., Roblin, E., Peters, I., & Haustein, S. (2023) · Quantitative Science Studies · doi:10.1162/qss_a_00264 · Cited by 43
United Nations Educational, S. A. C. O. (2015) · World science report · doi:10.18356/9789210059053 · Cited by 40
Many-Citednesss: Citations Measure More than Just Scientific Impact
D’Ippoliti, C. (2017) · Journal of Economic Surveys · doi:10.1111/joes.12416 · Cited by 34
Self-citationAbramo, G., Cicero, T., & D’Angelo, C. A. (2012) · Scientometrics · doi:10.1007/s11192-012-0875-6 · Cited by 32
Diversity of backgrounds and ideas: The case of research evaluation in economics
Corsi, M., D’Ippoliti, C., & Zacchia, G. (2019) · Research Policy · doi:10.1016/j.respol.2019.103820 · Cited by 31
Self-citationSeeber, M., Debacker, N., Meoli, M., & Vandevelde, K. (2022) · Higher Education · doi:10.1007/s10734-022-00878-w · Cited by 31
Ross‐Hellauer, T., Klebel, T., Knoth, P., & Pontika, N. (2023) · Science and Public Policy · doi:10.1093/scipol/scad073 · Cited by 24
Pudovkin, A. I. (2018) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2018.00002 · Cited by 23
Rice, D. B., Raffoul, H., Ioannidis, J. P. A., & Moher, D. (2021) · FACETS · doi:10.1139/facets-2020-0044 · Cited by 20
The Future of Research Evaluation: a synthesis of current debates and developments
de Rijcke, S., Cosentino, C., Crewe, R., D’Ippoliti, C., Motala‐Timol, S., Rahman, N. B. A., Rovelli, L., Vaux, D. L., & Yupeng, Y. (2023) · doi:10.24948/2023.06 · Cited by 20
Self-citationThe role of collegiality in academic review, promotion, and tenurePreprint
Dawson, D., Morales, E., McKiernan, E. C., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.01.05.475103 · Cited by 17
Dominik, M., Nzweundji, J. G., Ahmed, N., Carnicelli, S., Jalaluddin, N. S. M., Rivas, D. F., Narita, V., Enany, S., & Rojas, C. J. R. (2022) · Data Science Journal · doi:10.5334/dsj-2022-001 · Cited by 16
Self-citationLópez‐Vergès, S., Valiente‐Echeverría, F., Godoy‐Faúndez, Á., Rivas, D. F., Urbani, B., Berger, J., & Carmona-Mora, P. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.657120 · Cited by 15
Bonn, N. A., Vries, R. G. D., & Pinxten, W. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06191-0 · Cited by 12
Development Status as a Measure of Development
Hoffmeister, O. (2020) · UNCTAD research paper · doi:10.18356/a29d2be8-en · Cited by 6
What Does a Successful Postdoctoral Fellowship Publication Record Look Like?
Pepper, J. A., Krupinska, O., Stassun, K. G., & Gelino, D. (2018) · Publications of the Astronomical Society of the Pacific · doi:10.1088/1538-3873/aaea7f · Cited by 3
Research Diversity and Public Policy Toward InventionPreprint
Scott, J. T. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4251768 · Cited by 2
The evaluation game how publication metrics shape scholarly communication
Kulczycki, E. (2023) · Cited by 2
Research Assessment: Recognising the asset of diversity for scholarship serving society
Dominik, M. (2022) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.6246171 · Cited by 1
Self-citation
Research works printed but not linked: 7
- Fauzi, M. A., Tan, C. N. L., Daud, M. & Awalludin, M. M. N. University rankings: a review of methodological flaws. Issues Educ. Res.30, 79–96 (2020).
- INORMS Research Evaluation Group. The SCOPE Framework: A Five-Stage Process for Evaluating Research Responsibly (Emerald Publishing, 2021); https://inorms.net/wp-content/uploads/2022/03/21655-scope-guide-v10.pdf.
- Towards a Reform of the Research Assessment System: Scoping Report (European Commission, Directorate-General for Research and Innovation, 2021); https://data.europa.eu/doi/10.2777/707440. · doi:10.2777/707440
- Aubert Bonn, N. & Bouter, L. in Handbook of Bioethical Decisions Vol. II. Collaborative Bioethics, Vol. 3 (eds Valdés, E. & Lecaros, J. A.) (Springer, 2023).
- D’Ippoliti, C. Democratizing the Economics Debate: Pluralism and Research Evaluation (Routledge, 2022).
- Harman, H. H. Modern Factor Analysis 3rd edn (Univ. Chicago Press, 1976).
- Huber, P. J. The behavior of maximum likelihood estimates under nonstandard conditions. In Proc. 5th Berkeley Symposium on Mathematical Statistics and Probability Vol. 1, 221–233 (Univ. California Press, 1967).
Cited by
Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
Sabel, B. A., Knaack, E., Gigerenzer, G., & Bilc, M. (2023) · doi:10.1101/2023.05.06.23289563 · Cited by 51
Fake publications in biomedical science: red-flagging method indicates mass production
Sabel, B. A., Knaack, E., Gigerenzer, G., & Bilc, M.-I. (2026) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/s00210-025-04275-9 · Cited by 51
“…publications and value journal impact factor (JIF) metrics as surrogates for scientific excellence and make salary increases, promotion, or scientific reputation dependent on these which varies among disciplines, institutions, and national policies (Van Dalen and Henkens 2012; Lim et al. 2025).”
Unraveling topic switching and innovation in science
Yang, A. J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104171 · Cited by 18
How the Global South is reshaping scholarly communication
Debat, H., Okafor, I. A., Shitindo, M., Amaral, O. B., Izzati, N., Mallick, C. B., Henry, A., Dine, R. D., & Santacruz-Pérez, C. (2025) · eLife · doi:10.7554/elife.108426 · Cited by 18
Systemic territoriality in academia: The Gollum effect’s impact on scientific research and careers
Valdez, J. W., Sharma, S., & Gould, J. (2025) · One Earth · doi:10.1016/j.oneear.2025.101314 · Cited by 16
Metadata
- Authors
- Lim, B. H., D’Ippoliti, C., Dominik, M., Hernández-Mondragón, A. C., Vermeir, K., Chong, K. K., Hussein, H., Morales-Salgado, V. S., Cloete, K. J., Kimengsi, J. N., Balboa, L., Mondello, S., dela Cruz, T. E., Lopez-Verges, S., Sidi Zakari, I., Simonyan, A., Palomo, I., Režek Jambrak, A., Germo Nzweundji, J., Molnar, A., Saktiawati, A. M. I., Elagroudy, S., Kumar, P., Enany, S., Narita, V., Backes, M., Siciliano, V., Egamberdieva, D., & Flores Bueso, Y.
- Affiliations
- Universiti Tunku Abdul Rahman Sungai Long Campus (MY)
- Accademia Nazionale dei Lincei (IT)
- University of St Andrews (GB)
- Centre National de la Recherche Scientifique (FR)
- University of Oxford (GB)
- University of South Africa (ZA)
- University of Bamenda (CM)
- Academia Nacional de Medicina (AR)
- University of Messina (IT)
- University of Sussex (GB)
- Institut polytechnique de Grenoble (FR)
- Swinburne University of Technology (AU)
- Universitas Gadjah Mada (ID)
- Ain Shams University (EG)
- University of the Witwatersrand (ZA)
- Suez Canal University (EG)
- University of Namibia (NA)
- Italian Institute of Technology (IT)
- Tashkent Institute of Irrigation and Agricultural Mechanization Engineers (UZ)
- ORCID
- Lim, B. H.
- D’Ippoliti, C.
- Dominik, M.
- Vermeir, K.
- Chong, K. K.
- Hussein, H.
- Morales-Salgado, V. S.
- Cloete, K. J.
- Kimengsi, J. N.
- Balboa, L.
- Mondello, S.
- dela Cruz, T. E.
- Lopez-Verges, S.
- Sidi Zakari, I.
- Palomo, I.
- Molnar, A.
- Saktiawati, A. M. I.
- Elagroudy, S.
- Kumar, P.
- Enany, S.
- Narita, V.
- Backes, M.
- Siciliano, V.
- Egamberdieva, D.
- Flores Bueso, Y.
- Venue
- Nature
- Published
- 2025-01-22
- Volume
- 638
- Issue
- 8050
- Pages
- 459-468
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC11821531
- OpenAlex
- W4406732442
- Cited by
- 53
- References
- 54
- Citations by year
- 2026: 31 · 2025: 21
- FWCI
- 33.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HAL (submittedVersion, other-oa)
- HAL (submittedVersion, cc-by)
- St Andrews Research Repository (St Andrews Research Repository) (submittedVersion, cc-by)
- Conicet (submittedVersion, cc-by)
- HAL (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- IRIS Research product catalog (Sapienza University of Rome) (submittedVersion)
- Funders
- Breakthrough Cancer Research (18/SP/3522)
- Research Ireland
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Social Sciences › Education › Higher Education Governance and Development
- Keywords
- research evaluation, academic promotion, full professorship, promotion policy, bibliometric indicators, institutional policy, career development, diversity in academia
- MeSH terms
- Academies and Institutes, Career Mobility, Faculty, Humans, Research Personnel, Universities, Bibliometrics, Organizational Policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.