On the Stability of Citation-Based Journal Rankings
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Wider inclusion of journals into Scopus is associated with a higher number of journals removed, but the overall proportion of short-lived journals included and excluded in a relatively short period appears higher in WoS.
“although the wider inclusion of journals into Scopus is also associated with the higher number of journals being removed, the overall proportion of 'short-lived' journals that have been included and excluded from coverage in a relatively short period appears to be higher in WoS [58].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [58]
A significant share of journals ranking in the highest positions in Scopus were not indexed by WoS.
“Moreover, it was also shown that a significant share of journals ranking in highest positions in Scopus DB were not even indexed by WoS [51,58].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [58]
Other authors have not determined any significant differences in the quality of journals indexed in both WoS and Scopus.
“Meanwhile, other authors have not determined any significant differences in the quality of journals that were indexed in both DBs [58,85].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [58]
While generally high correlation between journal ranks between WoS and Scopus were observed, considerable variations in rank for individual journals were also noticed.
“while generally high correlation between journal ranks between WoS and Scopus were observed to be high, considerable variations in rank for individual journals were also noticed”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [58]
Journals in Scopus are usually assigned with a higher number of categories, and there are significantly more 'multidisciplinary' categories in Scopus classification compared to WoS.
“journals in Scopus are usually assigned with a higher number of categories, and there are significantly more 'multidisciplinary' categories in Scopus classification when compared to WoS”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [58]
In both DBs, journals are often assigned to multidisciplinary categories or with more than one subject field, but these practices were much more frequent in Scopus than in WoS.
“In both DBs, journals are often being assigned to multidisciplinary categories or with more than one subject field, but these practices were much more frequent in Scopus than in WoS.”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [58]
Cites
Gephi: An Open Source Software for Exploring and Manipulating Networks
Bastian, M., Heymann, S., & Jacomy, M. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13937 · Cited by 11,675 · see citing works
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · see citing works
(2007) · Cited by 3,005 · see citing works
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · see citing works
Boyack, K. W., & Klavans, R. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21419 · Cited by 1,439 · see citing works
A new approach to the metric of journals’ scientific prestige: The SJR indicator
González-Pereira, B., Guerrero‐Bote, V. P., & Anegón, F. D. M. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.03.002 · Cited by 867 · see citing works
Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review
Nederhof, A. J. (2006) · Scientometrics · doi:10.1007/s11192-006-0007-2 · Cited by 785 · see citing works
Measuring Contextual Citation Impact of Scientific Journals
Moed, H. F. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.01.002 · Cited by 628 · see citing works
Ràfols, I., Loet Leydesdorff, A., O’Hare, A., Nightingale, P., & Stirling, A. (2012) · Research Policy · doi:10.1016/j.respol.2012.03.015 · Cited by 581 · see citing works
New developments in the use of citation analysis in research evaluation
Moed, H. F. (2009) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-009-0001-5 · Cited by 507 · see citing works
Butler, L. (2002) · Research Policy · doi:10.1016/s0048-7333(02)00007-0 · Cited by 450 · see citing works
A Further Step Forward in Measuring Journals’ Scientific Prestige: The SJR2 Indicator
Guerrero-Bote, V. P., & Moya-Anegón, F. (2012) · Journal of Informetrics · doi:10.1016/j.joi.2012.07.001 · Cited by 406 · see citing works
San Francisco Declaration on Research Assessment
Cagan, R. L. (2013) · Disease Models & Mechanisms · doi:10.1242/dmm.012955 · Cited by 324 · see citing works
Larivière, V., Archambault, É., Gingras, Y., & Vignola-Gagné, É. (2006) · J. Assoc. Inf. Sci. Technol. · doi:10.1002/asi.20349 · Cited by 294 · see citing works
Differences in impact factor across fields and over time
Althouse, B. M., West, J. D., Bergstrom, C. T., & Bergstrom, T. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20936 · Cited by 270 · see citing works
Changing publication patterns in the Social Sciences and Humanities, 2000–2009
Engels, T., Ossenblok, T. L. B., & Spruyt, E. H. J. (2012) · Scientometrics · doi:10.1007/s11192-012-0680-2 · Cited by 225 · see citing works
Some Modifications to the SNIP Journal Impact Indicator
Waltman, L., van Eck, N. J., van Leeuwen, T. N., & Visser, M. S. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2012.11.011 · Cited by 191 · see citing works
Journal Evaluation: Technical and Practical Issues
Rousseau, R. (2002) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 158 · see citing works
A Theoretical and Empirical Analysis of Journal Rankings: The Case of Formal Lists
Fleet, D. D. V., McWilliams, A., & Siegel, D. S. (2000) · Journal of Management · doi:10.1016/s0149-2063(00)00060-x · Cited by 149 · see citing works
Extracellular Microbial Polysaccharides
Sandford, P. A., & Laskin, A. I. (1977) · ACS symposium series · doi:10.1021/bk-1977-0045 · Cited by 131 · see citing works
A Theoretical and Empirical Analysis of Journal Rankings: The Case of Formal Lists
Fleet, D. D. V., McWilliams, A., & Siegel, D. S. (2000) · Journal of Management · doi:10.1177/014920630002600505 · Cited by 115 · see citing works
DELGADO‐LÓPEZ‐CÓZAR, E., & CABEZAS‐CLAVIJO, Á. (2013) · Learned Publishing · doi:10.1087/20130206 · Cited by 107 · see citing works
Davis, P. M. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20943 · Cited by 105 · see citing works
The controversial policies of journal ratings: evaluating social sciences and humanities
Pontille, D., & Torny, D. (2010) · Research Evaluation · doi:10.3152/095820210x12809191250889 · Cited by 103 · see citing works
Long-term vs. short-term journal impact: does it matter?
Garfield, E. (1998) · PubMed · Cited by 99 · see citing works
Hybrid clustering for validation and improvement of subject-classification schemes
Janssens, F., Zhang, L., Moor, B. D., & Glänzel, W. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.06.003 · Cited by 91 · see citing works
Pajić, D. (2014) · Scientometrics · doi:10.1007/s11192-014-1510-5 · Cited by 86 · see citing works
Self-citationImpact factor bias and proposed adjustments for its determination
Fassoulaki, A., Papilas, K., Paraskeva, A., & Patris, K. (2002) · Acta Anaesthesiologica Scandinavica · doi:10.1034/j.1399-6576.2002.460723.x · Cited by 77 · see citing works
A new method for ranking academic journals in accounting and finance
BEATTIE, V. A., & Goodacre, A. (2006) · Accounting and Business Research · doi:10.1080/00014788.2006.9730011 · Cited by 73 · see citing works
Dorta–González, P., & Dorta-González, M. I. (2012) · Scientometrics · doi:10.1007/s11192-012-0929-9 · Cited by 69 · see citing works
Campanario, J. M. (2010) · Scientometrics · doi:10.1007/s11192-010-0334-1 · Cited by 62 · see citing works
Subdiscipline-specific journal rankings: whither Applied Economics?
Barrett, C. B., Olia, A., & Bailey, D. (2000) · Applied Economics · doi:10.1080/000368400322921 · Cited by 60 · see citing works
Journal Impact Factors and Self-Citations: Implications for Psychology Journals.
Anseel, F., Duyck, W., Baene, W. D., & Brysbaert, M. (2004) · American Psychologist · doi:10.1037/0003-066x.59.1.49 · Cited by 58 · see citing works
Hicks, D. M. (2012) · Confero Essays on Education Philosophy and Politics · doi:10.3384/confero13v1121207b · Cited by 55 · see citing works
Franceschet, M. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2009.12.002 · Cited by 50 · see citing works
An evaluation of the Australian Research Council's journal ranking
Vanclay, J. K. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2010.12.001 · Cited by 44 · see citing works
Accounting for research quality: Research audits and the journal rankings debate
Rowlinson, M., Harvey, C. E., Kelly, A., et al. (2013) · Critical Perspectives on Accounting · doi:10.1016/j.cpa.2013.05.012 · Cited by 43 · see citing works
An evaluation of the Australian Research Council's journal ranking
Vanclay, J. K. (2011) · Cross Connect (Southern Cross University) · Cited by 42 · see citing works
Tools for Evaluating Research Output
Sutter, M., & Kocher, M. G. (2001) · Evaluation Review · doi:10.1177/0193841x0102500503 · Cited by 40 · see citing works
Research assessment and monetary rewards: the overemphasized impact factor in China
Shao, J., & Shen, H. (2012) · Research Evaluation · doi:10.1093/reseval/rvs011 · Cited by 39 · see citing works
Koczkodaj, W. W., Kułakowski, K., & Ligęza, A. (2014) · Scientometrics · doi:10.1007/s11192-014-1258-y · Cited by 38 · see citing works
Google Scholar Metrics evolution: an analysis according to languages
Orduña‐Malea, E., & López‐Cózar, E. D. (2013) · Scientometrics · doi:10.1007/s11192-013-1164-8 · Cited by 38 · see citing works
Campanario, J. M. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21457 · Cited by 36 · see citing works
Segalla, M. (2008) · European J of International Management · doi:10.1504/ejim.2008.017765 · Cited by 36 · see citing works
FACTORS AFFECTING BIBLIOMETRIC INDICATORS OF SCIENTIFIC QUALITY; pp. 199–214
Allïk, J. (2013) · Trames Journal of the Humanities and Social Sciences · doi:10.3176/tr.2013.3.01 · Cited by 35 · see citing works
Globally national - locally international: Bibliometric analysis of a SEE psychology journal
Pajić, D., & Jevremov, T. (2014) · Psihologija · doi:10.2298/psi1402263p · Cited by 31 · see citing works
Self-citationCommentary on the Mort et al. Paper: Journal Rankings: How Much Credence Should We Give Them?
Uncles, M. (2004) · Australasian Marketing Journal (AMJ) · doi:10.1016/s1441-3582(04)70100-7 · Cited by 25 · see citing works
Science Evaluation in the Czech Republic: The Case of Universities
Fiala, D. (2013) · Societies · doi:10.3390/soc3030266 · Cited by 20 · see citing works
A quick and easy method to estimate the random effect on citation measures
Nieuwenhuysen, P., & Rousseau, R. (1988) · Scientometrics · doi:10.1007/bf02095762 · Cited by 17 · see citing works
How variable are the journal impact measures?
Haghdoost, A. A., Zare, M., & Bazrafshan, A. (2014) · Online Information Review · doi:10.1108/oir-05-2014-0102 · Cited by 16 · see citing works
How Much Do Core Journals Change over a Decade?
Black, S. (2012) · Library Resources and Technical Services · doi:10.5860/lrts.56n2.80 · Cited by 12 · see citing works
Accounting journals and theABS Guide: a review of evidence and inference
Kelly, A., Harvey, C. E., Morris, H., et al. (2013) · Management & Organizational History · doi:10.1080/17449359.2013.837829 · Cited by 9 · see citing works
On the temporal stability of Garfield’s Impact Factor and its suitability to identify hot papers
Gorraiz, J. I., Gumpenberger, C., Schlögl, C., et al. (2012) · Phaidra (Universität Wien) · Cited by 8 · see citing works
Pajić, D. (2012) · doi:10.5937/bioac-76 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
Campanario, J. M. (2018) · Scientometrics · doi:10.1007/s11192-018-2660-7 · Cited by 9 · see citing works
- Authors
- Pajić, D.
- Affiliations
- University of Novi Sad (RS)
- Corresponding author
- Pajić, Dejan
- ORCID
- Pajić, Dejan
- Venue
- Journal of Informetrics
- Publisher
- Elsevier BV
- Published
- 2015-10
- Volume
- 9
- Issue
- 4
- Pages
- 990-1006
- ISSN
- 1751-1577 (ISSN-L)
- OpenAlex
- W2249348384
- Cited by
- 62
- References
- 54
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 6 · 2023: 7 · 2022: 9 · 2021: 8 · 2020: 5 · 2019: 7 · 2018: 8 · 2017: 5 · 2014: 1
- FWCI
- 3.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Informetrics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- journal rankings, ranking stability, citation impact measures, impact factor, Source Normalized Impact per Paper, h-index, Article Influence Score, temporal stability, humanities and social sciences journals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review