The DOI matches its Crossref record; 253 of the 253 references it cites were found in a registry or an index.
A review of theory and practice in scientometrics
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This issue is even more obvious when applying JIF in subject fields where citations mature slower or are delayed, as in Mathematics, Social Sciences and Humanities [26,46,224,229].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [46]
Experimental — accuracy not yet measuredIn the citing paper
“For example, it is well known that, in Computer sciences, the research findings tend to be published in conference papers [86,87], while books and text-books are more important sources in social sciences and even more so in humanities [26,46].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [46]
In the citing paper
“In this way, JIF also shows a certain level of discrimination against less popular publication types that, in certain disciplines, are as important as original research articles [2,26,45,46,224,225,229].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [46]
In the citing paper
“not all articles read are cited, although they may have had a significant impact on the study [46].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [46]
In the citing paper
“it is a mistake to assume that articles with zero citation have no scientific value, because they first had to go through a peer-review process to be published [46].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Software survey: VOSviewer, a computer program for bibliometric mapping
van Eck, N. J., & Waltman, L. (2010) · Scientometrics · doi:10.1007/s11192-009-0146-3 · Cited by 21,484
Fast unfolding of communities in large networks
Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/10/p10008 · Cited by 21,424
The fifth discipline, the art and practice of the learning organization
Senge, P. M. (1991) · Performance + Instruction · doi:10.1002/pfi.4170300510 · Cited by 20,060
Finding and evaluating community structure in networks
Newman, M. E. J., & Girvan, M. (2004) · Physical Review E · doi:10.1103/physreve.69.026113 · Cited by 13,931
(1999) · Cited by 12,854
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Aad, G., Abajyan, T., Abbott, B., Abdallah, J., Khalek, S. A., Abdelalim, A. A., Abdinov, O., Aben, R. Z., Abi, B., Abolins, M., et al. (2012) · Physics Letters B · doi:10.1016/j.physletb.2012.08.020 · Cited by 10,498
THE STRUCTURE OF SCIENTIFIC REVOLUTIONS
McGuire, J. E. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00813.x · Cited by 8,547
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720 · cited 1×
“…of networks of papers and authors and also began to analyse scientometric processes, leading to the idea of cumulative advantage (Price, 1976), a version of “success to the successful” (Senge, 1990) or “success breeds success (SBS)” also known as the Matthew 4 effect (Merton, 1968; Merton, 1988).”
Research works printed but not linked: 13
- Braam, 1991, Mapping of science by combined co-citation and word analysis. II: Dynamical aspects, Journal of the American Society for Information Science, 42, 252, 10.1002/(SICI)1097-4571(199105)42:4<252::AID-ASI2>3.0.CO;2-G · DOI
- Chapman, 1989, Assessing research: Citation-count shortcomings, The Psychologist: Bulletin of the British Psychological Society, 8, 339
- Egghe, 1990, Introduction to Informetrics
- Garfield, 1998, The impact factor and using it correctly, Der Unfallchirug, 48, 413
- Holmes, R. (2014). How to win citations and rise in the rankings University Ranking Watch (Vol. 2014).
- Jacso, 2005, As we may search – Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases, Current Science, 89, 1537
- Jin, 2006, The h-index: An evaluation indicator proposed by scientist, Science Focus, 1, 8
- Jin, 2007, The AR-index: Complementing the h-index, ISSI Newsletter, 3, 6
- Lotka, 1926, Statistics: The frequency distribution of scientific productivity, Journal of the Washington Academy of Sciences, 16, 317
- Marshakova, 1973, Bibliographic coupling system based on references, Nauchno-Tekhnicheskaya Informatsiya Seriya, 2, 3
- Moxham, 1992, Peer review: A view from the inside, Science and Technology Policy, 5, 7
- Nacke, 1979, Informetrie: Ein neuer Name fur eine neue Disziplin, Nachrichten fur Dokumentation, 30, 219
- Wilson, 1999, Informetrics, Annual Review of Information Science and Technology, 34, 107
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Bibliometric indicators: opportunities and limits
Belter, C. W. (2015) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.103.4.014 · Cited by 315
Mingers, J., & Yang, L. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.07.058 · Cited by 184
Self-citationLeydesdorff, L., Wouters, P., & Bornmann, L. (2016) · Scientometrics · doi:10.1007/s11192-016-2150-8 · Cited by 173
Self-citationRevisiting the Scientometric Conceptualization of Impact and Its Measurement
Abramo, G. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.05.001 · Cited by 80
Carlson, J., & Harris, K. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000860 · Cited by 61
Peer Review versus Bibliometrics: Which Method Better Predicts the Scholarly Impact of Publications?
Abramo, G., D’Angelo, C. A., & Reale, E. (2019) · Scientometrics · doi:10.1007/s11192-019-03184-y · Cited by 50
Gaggero, G., Bonassi, A., Dellantonio, S., Pastore, L., Aryadoust, V., & Esposito, G. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.611489 · Cited by 40
Campanario, J. M. (2018) · Scientometrics · doi:10.1007/s11192-018-2660-7 · Cited by 9
Metadata
- Authors
- Mingers, J., & Leydesdorff, L.
- Affiliations
- University of Kent (GB)
- Corresponding author
- Mingers, John
- Venue
- European Journal of Operational Research
- Publisher
- Elsevier BV
- Published
- 2015-10
- Volume
- 246
- Issue
- 1
- Pages
- 1-19
- ISSN
- 0377-2217 (ISSN-L)
- OpenAlex
- W2070242399
- Cited by
- 1,002
- References
- 253
- Citations by year
- 2026: 80 · 2025: 117 · 2024: 124 · 2023: 150 · 2022: 112 · 2021: 138 · 2020: 79 · 2019: 68 · 2018: 55 · 2017: 42 · 2016: 23 · 2015: 14
- FWCI
- 40.75
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- European Journal of Operational Research (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- scientometrics, citation analysis, citation metrics, research performance evaluation, journal impact factor, journal metrics, normalization, mapping sciences, science policy, history of scientometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
