Bibliometrics: The Leiden Manifesto for Research Metrics
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In 2015, Nature published 'The Leiden Manifesto for research metrics', which established ten principles of best practice in metrics-based research assessments.
“In 2015, Nature published 'The Leiden Manifesto for research metrics' [291], which established the main ten principles of the best practice in metrics-based research assessments.”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [291]
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · see citing works
The History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · see citing works
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447 · see citing works
Which h-index? — A comparison of WoS, Scopus and Google Scholar
Bar‐Ilan, J. (2007) · Scientometrics · doi:10.1007/s11192-008-0216-y · Cited by 720 · see citing works
The Leiden ranking 2011/2012: Data collection, indicators, and interpretation
Waltman, L., Calero‐Medina, C., Kosten, J., Noyons, E., Tijssen, R., van Eck, N. J., van Leeuwen, T. N., van Raan, A. F. J., Visser, M. S., & Wouters, P. F. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22708 · Cited by 452 · see citing works
Self-citationButler, L. (2002) · Research Policy · doi:10.1016/s0048-7333(02)00007-0 · Cited by 450 · see citing works
Beyond bibliometrics: harnessing multidimensional indicators of scholarly impact
(2014) · Choice Reviews Online · doi:10.5860/choice.186316 · Cited by 211 · see citing works
Rivals for the crown: Reply to Opthof and Leydesdorff
van Raan, A. F. J., van Leeuwen, T. N., Visser, M. S., van Eck, N. J., & Waltman, L. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.03.008 · Cited by 108 · see citing works
Self-citationThe outflow of academic papers from China: why is it happening and can it be stemmed?
Jufang, S., & Shen, H. (2011) · Learned Publishing · doi:10.1087/20110203 · Cited by 96 · see citing works
The Citation: From Culture to Infrastructure
Wouters, P. F. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9445.003.0006 · Cited by 76 · see citing works
Self-citationPineiro, C. L., & Hicks, D. (2014) · Research Evaluation · doi:10.1093/reseval/rvu030 · Cited by 51 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356 · see citing works
Self-citationCitations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019) · Sage Open · doi:10.1177/2158244019829575 · Cited by 1,257 · see citing works
Self-citationVisser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865 · see citing works
Self-citationBibliometrics: Tracking Research Impact by Selecting the Appropriate Metrics
Agarwal, A., Durairajanayagam, D., Tatagari, S., Esteves, S., Harlev, A., Henkel, R., Roychoudhury, S., Homa, S., Puchalt, N., Ramasamy, R., et al. (2016) · Asian Journal of Andrology · doi:10.4103/1008-682x.171582 · Cited by 639 · see citing works
Hutchins, B. I., Yuan, X., Anderson, J. M., & Santangelo, G. M. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002541 · Cited by 500 · see citing works
Assessing scientists for hiring, promotion, and tenure
Moher, D., Naudet, F., Cristea, I. A., Miedema, F., Ioannidis, J. P. A., & Goodman, S. N. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2004089 · Cited by 462 · see citing works
Web of Science and Scopus Language Coverage
Vera-Baceta, M.-A., Thelwall, M., & Kousha, K. (2019) · Scientometrics · doi:10.1007/s11192-019-03264-z · Cited by 423 · see citing works
A standardized citation metrics author database annotated for scientific field
Ioannidis, J. P. A., Baas, J., Klavans, R., & Boyack, K. W. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000384 · Cited by 356 · see citing works
Dimensions: Building Context for Search and Evaluation
Hook, D. W., Porter, S. J., & Herzog, C. (2018) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2018.00023 · Cited by 325 · see citing works
“There is now a significant body of literature that seeks to guide the sector and argues for diverse metrics and indicators to support rather than replace reviewers (DORA, 2013; Hicks et al., 2015; Wilsdon, 2015; Leydesdorff et al., 2016; Waltman, 2016; Sugimoto and Lariviére, 2018).”
BackgroundThe FAIR guiding principles for data stewardship: fair enough?
Boeckhout, M., Zielhuis, G. A., & Bredenoord, A. L. (2018) · European Journal of Human Genetics · doi:10.1038/s41431-018-0160-0 · Cited by 290 · see citing works
Reale, E., Avramov, D., Canhial, K., Donovan, C., Flecha, R., Holm, P., Larkin, C., Lepori, B., Mosoni-Fried, J., Oliver, E., et al. (2018) · Research Evaluation · doi:10.1093/reseval/rvx025 · Cited by 258 · see citing works
The Application of Bibliometric Analysis: Disciplinary and User Aspects
Ellegaard, O. (2018) · Scientometrics · doi:10.1007/s11192-018-2765-z · Cited by 253 · see citing works
Moylan, E. C., & Kowalczuk, M. K. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012047 · Cited by 212 · see citing works
Researchers’ Individual Publication Rate Has Not Increased in a Century
Fanelli, D., & Larivière, V. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149504 · Cited by 205 · see citing works
Ravenscroft, J., Liakata, M., Clare, A., & Duma, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0173152 · Cited by 202 · see citing works
The changing forms and expectations of peer review
Horbach, S. P. J. M., & Halffman, W. (. W. (2018) · Research Integrity and Peer Review · doi:10.1186/s41073-018-0051-5 · Cited by 179 · see citing works
Leydesdorff, L., Wouters, P., & Bornmann, L. (2016) · Scientometrics · doi:10.1007/s11192-016-2150-8 · Cited by 173 · see citing works
Self-citationQuantity and/or Quality? The Importance of Publishing Many Papers
Sandström, U., & van den Besselaar, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166149 · Cited by 146 · see citing works
How the publish-or-perish principle divides a science: the case of economists
van Dalen, H. P. (2021) · Scientometrics · doi:10.1007/s11192-020-03786-x · Cited by 128 · see citing works
Editors’ JIF-boosting stratagems – Which are appropriate and which not?
Martin, B. R. (2016) · Research Policy · doi:10.1016/j.respol.2015.09.001 · Cited by 128 · see citing works
To what extent is inclusion in the Web of Science an indicator of journal ‘quality’?
Chavarro, D., Ràfols, I., & Tang, P. (2018) · Research Evaluation · doi:10.1093/reseval/rvy001 · Cited by 115 · see citing works
Self-citationBornmann, L. (2017) · Higher Education · doi:10.1007/s10734-016-9995-x · Cited by 117 · see citing works
A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations
Chorus, C., & Waltman, L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161021 · Cited by 92 · see citing works
Self-citationPromoting public access to clinical trial protocols: challenges and recommendations
Chan, A.-W., & Hróbjartsson, A. (2018) · Trials · doi:10.1186/s13063-018-2510-1 · Cited by 84 · see citing works
Who games metrics and rankings? Institutional niches and journal impact factor inflation
Siler, K., & Larivière, V. (2022) · Research Policy · doi:10.1016/j.respol.2022.104608 · Cited by 70 · see citing works
Bornmann, L., & Leydesdorff, L. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2016.12.001 · Cited by 72 · see citing works
Academic Evaluation: Universal Instrument? Tool for Development?
Bianco, M., Gras, N., & Sutz, J. (2016) · Minerva · doi:10.1007/s11024-016-9306-9 · Cited by 70 · see citing works
The Pricing of Open Access Journals: Diverse Niches and Sources of Value in Academic Publishing
Siler, K., & Frenken, K. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00016 · Cited by 64 · see citing works
CiteScore Metrics: Creating Journal Metrics from the Scopus Citation Index
James, C., Colledge, L., Meester, W., Azoulay, N., & Plume, A. (2019) · Learned Publishing · doi:10.1002/leap.1246 · Cited by 63 · see citing works
On the Stability of Citation-Based Journal Rankings
Pajić, D. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.08.005 · Cited by 62 · see citing works
Sampling Issues in Bibliometric Analysis
Williams, R., & Bornmann, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2015.11.004 · Cited by 58 · see citing works
Bordignon, F. (2020) · Scientometrics · doi:10.1007/s11192-020-03536-z · Cited by 51 · see citing works
Regional and institutional trends in assessment for academic promotion
Lim, B. H., D’Ippoliti, C., Dominik, M., Hernández-Mondragón, A. C., Vermeir, K., Chong, K. K., Hussein, H., Morales-Salgado, V. S., Cloete, K. J., Kimengsi, J. N., et al. (2025) · Nature · doi:10.1038/s41586-024-08422-9 · Cited by 53 · see citing works
Lei, L., & Sun, Y. (2020) · Scientometrics · doi:10.1007/s11192-019-03338-y · Cited by 43 · see citing works
Haddawy, P., Hassan, S.-U., Asghar, A., & Amin, S. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2015.12.005 · Cited by 45 · see citing works
Increasing value and reducing waste in stroke research
Berge, E., Salman, R. A.-S., van der Worp, H. B., Stapf, C., Sandercock, P., Sprigg, N., Macleod, M. R., Kelly, P. J., Nederkoorn, P. J., Ford, G. A., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30078-9 · Cited by 41 · see citing works
Critical Rationalism and the Search for Standard (Field-Normalized) Indicators in Bibliometrics
Bornmann, L., & Marx, W. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.05.002 · Cited by 41 · see citing works
Bibliometric reports for institutions: Best practices in a responsible metrics scenario
Cabezas-Clavijo, A., & Torres-Salinas, D. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.696470 · Cited by 36 · see citing works
Citation Success Index − An Intuitive Pair-Wise Journal Comparison Metric
Milojević, S., Radicchi, F., & Bar-Ilan, J. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2016.12.006 · Cited by 33 · see citing works
Bornmann, L., & Haunschild, R. (2016) · Online Information Review · doi:10.1108/oir-09-2015-0314 · Cited by 21 · see citing works
Bornmann, L., Adams, J., & Leydesdorff, L. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.07.009 · Cited by 19 · see citing works
The darker side of quantitative academic performance metrics
Crous, C. J. (2019) · South African Journal of Science · doi:10.17159/sajs.2019/5785 · Cited by 14 · see citing works
Estimating the quality of academic books from their descriptions with ChatGPT
Thelwall, M., & Cox, A. (2025) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2025.103023 · Cited by 9 · see citing works
What are innovations in peer review and editorial assessment for?
Halffman, W., & Horbach, S. P. J. M. (2020) · Genome Biology · doi:10.1186/s13059-020-02004-4 · Cited by 5 · see citing works
Scaling Scientometrics: Dimensions on Google BigQuery as an Infrastructure for Large-Scale Analysis
Hook, D. W., & Porter, S. J. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.656233 · Cited by 8 · see citing works
Mani, N. S., Hayes, B. E., Dodd, A., Yu, F., & Cawley, M. A. (2021) · Advances in Library and Information Science · doi:10.4018/978-1-7998-7258-0.ch017 · Cited by 4 · see citing works
- Authors
- Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I.
- Affiliations
- Georgia Institute of Technology (US)
- Leiden University (NL)
- Corresponding author
- Hicks, Diana
- Venue
- Nature
- Published
- 2015-04-22
- Volume
- 520
- Issue
- 7548
- Pages
- 429-431
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068452509
- Cited by
- 2,828
- References
- 11
- Citations by year
- 2026: 425 · 2025: 300 · 2024: 275 · 2023: 284 · 2022: 299 · 2021: 273 · 2020: 232 · 2019: 231 · 2018: 184 · 2017: 145 · 2016: 127 · 2015: 52 · 2012: 1
- FWCI
- 154.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- research metrics, research evaluation, bibliometric analysis, Leiden Manifesto, citation analysis
- MeSH terms
- Achievement, Career Mobility, Research, Research Personnel, Reproducibility of Results, Bibliometrics, Guidelines as Topic, Access to Information, History, 20th Century, History, 21st Century, Journal Impact Factor, Blogging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review