Impact Factors and the Central Limit Theorem: Why Citation Averages Are Scale Dependent

Antonoyiannakis, Manolis

doi:10.1016/j.joi.2018.08.011

Cited by 31scientometrics and bibliometrics researchWeb visibility and informetricsPsychology Research and Bibliometrics

Impact Factors and the Central Limit Theorem: Why Citation Averages Are Scale Dependent

Open access

Antonoyiannakis, Manolis·2018·Journal of Informetrics

DOI 10.1016/j.joi.2018.08.011

Open this paper in CoChat — free account Open PDF

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.joi.2018.08.011

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

When journals are compared by impact indicators, differences in journal size should be taken into account.
“Even when journals are being compared by the values of impact indicators, the differences in size of the journals should be also taken into account [261].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [261]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720 · see citing works
Untitled work
Newman (2005) · doi:10.1080/00107510500052444 · Cited by 5,749 · see citing works
Untitled work
(1968) · PubMed · Cited by 4,803 · see citing works
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447 · see citing works
How popular is your paper? An empirical study of the citation distribution
Redner, S. (1998) · The European Physical Journal B · doi:10.1007/s100510050359 · Cited by 1,509 · see citing works
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356 · see citing works
Citation Analysis in Research Evaluation
Moed, H. F. (2005) · Springer eBooks · doi:10.1007/1-4020-3714-7 · Cited by 1,334 · see citing works
Universality of citation distributions: Toward an objective measure of scientific impact
Radicchi, F., Fortunato, S., & Castellano, C. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0806977105 · Cited by 828 · see citing works
Impact factors: use and abuse.
Amin, M., & Mabe, M. A. (2003) · PubMed · Cited by 491 · see citing works
The Leiden ranking 2011/2012: Data collection, indicators, and interpretation
Waltman, L., Calero‐Medina, C., Kosten, J., Noyons, E., Tijssen, R., van Eck, N. J., van Leeuwen, T. N., van Raan, A. F. J., Visser, M. S., & Wouters, P. F. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22708 · Cited by 452 · see citing works
Psychological relevance and information science
Harter, S. P. (1992) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199210)43:9 · Cited by 415 · see citing works
San Francisco Declaration on Research Assessment
Cagan, R. L. (2013) · Disease Models & Mechanisms · doi:10.1242/dmm.012955 · Cited by 308 · see citing works
Show me the data
Rossner, M., Epps, H. V., & Hill, E. (2007) · The Journal of Experimental Medicine · doi:10.1084/jem.20072544 · Cited by 278 · see citing works
Differences in impact factor across fields and over time
Althouse, B. M., West, J. D., Bergstrom, C. T., & Bergstrom, T. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20936 · Cited by 270 · see citing works
Show me the data
Rossner, M., Epps, H. V., & Hill, E. (2007) · The Journal of Cell Biology · doi:10.1083/jcb.200711140 · Cited by 248 · see citing works
Learning networks: A field guide to teaching and learning online
Wittorf, R. (1996) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199610)47:10 · Cited by 217 · see citing works
The most influential journals: Impact Factor and Eigenfactor
Fersht, A. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903307106 · Cited by 190 · see citing works
Reviewers are blinkered by bibliometrics
Stephan, P. E., Veugelers, R., & Wang, J. (2017) · Nature · doi:10.1038/544411a · Cited by 189 · see citing works
The San Francisco Declaration on Research Assessment
Raff, J. W. (2013) · Biology Open · doi:10.1242/bio.20135330 · Cited by 179 · see citing works
Integrated impact indicators compared with impact factors: An alternative research design with policy implications
Loet Leydesdorff, A., & Bornmann, L. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21609 · Cited by 164 · see citing works
Scale-independent indicators and research evaluation
Katz, J. S. (2000) · Science and Public Policy · doi:10.3152/147154300781782156 · Cited by 133 · see citing works
Opinion paper: thoughts and facts on bibliometric indicators
Glänzel, W., & Moed, H. F. (2012) · Scientometrics · doi:10.1007/s11192-012-0898-z · Cited by 116 · see citing works
Stats: Data and Models
Veaux, R. D. D., Velleman, P. F., & Bock, D. E. (2007) · Cited by 102 · see citing works
The Most Dangerous Equation
Wainer, H. (2007) · American Scientist · doi:10.1511/2007.65.1026 · Cited by 89 · see citing works
Geometric journal impact factors correcting for individual highly cited articles
Thelwall, M. A., & Fairclough, R. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.02.004 · Cited by 74 · see citing works
Skewness of Citation Impact Data and Covariates of Citation Distributions: A Large-Scale Empirical Analysis Based on Web of Science Data
Bornmann, L., & Leydesdorff, L. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2016.12.001 · Cited by 72 · see citing works
Teaching Statistics: A Bag of TricksPreprint
Gelman, A., & Nolan, D. (2002) · RePEc: Research Papers in Economics · Cited by 68 · see citing works
Bibliometric statistical properties of the 100 largest European research universities: Prevalent scaling rules in the science system
van Raan, A. F. J. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20761 · Cited by 67 · see citing works
Count highly-cited papers instead of papers with h citations: use normalized citation counts and compare “like with like”!
Bornmann, L., & Loet Leydesdorff, A. (2018) · Scientometrics · doi:10.1007/s11192-018-2682-1 · Cited by 54 · see citing works
Evidence That Smaller Schools Do Not Improve Student Achievement
Wainer, H., & Zwerling, H. L. (2006) · Phi Delta Kappan · doi:10.1177/003172170608800411 · Cited by 45 · see citing works
Positive correlation between quality and quantity in academic journals
Huang, D.-W. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.002 · Cited by 35 · see citing works
Don't Get Skewed Over by Journal Rankings
Wall, H. J. (2009) · The B E Journal of Economic Analysis & Policy · doi:10.2202/1935-1682.2280 · Cited by 29 · see citing works
The Citation Merit of Scientific Publications
Crespo, J. A., Ortuño-Ortı́n, I., & Ruiz‐Castillo, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049156 · Cited by 25 · see citing works
High Impact Factor Journals have More Publications than Expected
Liu, F., Guo, W., & Zuo, C. (2018) · Current Science · doi:10.18520/cs/v114/i05/955-956 · Cited by 20 · see citing works
The Most Dangerous Equation
Wainer, H. (2007) · American Scientist · doi:10.1511/2007.65.249 · Cited by 13 · see citing works
Positive correlation between journal production and journal impact factors
Rousseau, R. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.04.012 · Cited by 9 · see citing works
Few UK universities have adopted rules against impact-factor abuse
Gaind, N. (2018) · Nature · doi:10.1038/d41586-018-01874-w · Cited by 7 · see citing works
Editorial: Is PRL Too Large to Have an “Impact”?
Antonoyiannakis, M., & Mitra, S. (2009) · Physical Review Letters · doi:10.1103/physrevlett.102.060001 · Cited by 6 · see citing works
Self-citation
Citation analysis: Beyond the Journal Impact Factor
Antonoyiannakis, M. (2008) · Bulletin of the American Physical Society · Cited by 2 · see citing works
Self-citation
Median Citation Index vs Journal Impact Factor
Antonoyiannakis, M. (2015) · Bulletin of the American Physical Society · Cited by 2 · see citing works
Self-citation
Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science dataPreprint
Bornmann, L., & Leydesdorff, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01935 · Cited by 1 · see citing works

Flagged first, then by citations

2 of the 43 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

Antonoyiannakis, M., (2015a). Impact Facts & Impact Factors: A view from the Physical Review. PQE - The 45th Winter Colloquium on the Physics of Quantum Electronics, Available at http: // www.pqeconference.com / pqe2015 / Abstracts / 345p.pdf.
Rousseau, R., Van Hooydonk, G., (1996). Journal production and journal impact factors, Journal of the American Society for Information Science, 47 , 775-780.
Seglen, P. O., (1992). The skewness of science. Journal of the American Society for Information Science, 43 , 628-638.

Sorted by citations

Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
UAV-Enabled Secure Communications via Collaborative Beamforming With Imperfect Eavesdropper Information
Sun, G., Zheng, X., Sun, Z., Wu, Q., Li, J., Liu, Y., & Leung, V. C. M. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3273293 · Cited by 50 · see citing works
Metrics and mechanisms: Measuring the unmeasurable in the science of science
Wu, L., Kittur, A., Youn, H., Milojević, S., Leahey, E., Fiore, S. M., & Ahn, Y. (2022) · Journal of Informetrics · doi:10.1016/j.joi.2022.101290 · Cited by 41 · see citing works
Citation patterns between impact-factor and questionable journals
Kulczycki, E., Hołowiecki, M., Taşkın, Z., & Krawczyk, F. (2021) · Scientometrics · doi:10.1007/s11192-021-04121-8 · Cited by 35 · see citing works
Association between productivity and journal impact across disciplines and career age
Sunahara, A. S., Perc, M., & Ribeiro, H. V. (2021) · Physical Review Research · doi:10.1103/physrevresearch.3.033158 · Cited by 30 · see citing works
Association between productivity and journal impact across disciplines and career age
Sunahara, A. S., Perc, M., & Ribeiro, H. V. (2021) · University of Maribor digital library (University of Maribor) · Cited by 25 · see citing works
Impact factor volatility due to a single paper: A comprehensive analysis
Antonoyiannakis, M. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00037 · Cited by 18 · see citing works
Self-citation
Collaborative WSN-UAV Data Collection in Smart Agriculture: A Bi-objective Optimization Scheme
Sun, G., Zheng, X., Li, J., Kang, H., & Liang, S. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3597025 · Cited by 16 · see citing works
The integrated impact indicator revisited (I3*): a non-parametric alternative to the journal impact factor
Loet Leydesdorff, A., Bornmann, L., & Adams, J. R. (2019) · Scientometrics · doi:10.1007/s11192-019-03099-8 · Cited by 16 · see citing works
Cooperative UAV-Mounted RISs-Assisted Energy-Efficient Communications
Pan, H., Liu, Y., Sun, G., Wu, Q., Gong, T., Wang, P., Niyato, D. T., & Yuen, C. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3579597 · Cited by 14 · see citing works
t-index: entropy based random document and citation analysis using average h-index
Singh, P. K. (2022) · Scientometrics · doi:10.1007/s11192-021-04222-4 · Cited by 14 · see citing works
On some properties of medians, percentiles, baselines, and thresholds in empirical bibliometric analysis
Pislyakov, V. V. (2022) · Journal of Informetrics · doi:10.1016/j.joi.2022.101322 · Cited by 10 · see citing works
Building journal’s long-term impact: using indicators detected from the sustained active articles
Wang, M., Jiao, S., Chai, K., & Chen, G. (2019) · Scientometrics · doi:10.1007/s11192-019-03196-8 · Cited by 6 · see citing works
How a Single Paper Affects the Impact Factor: Implications for Scholarly PublishingPreprint
Antonoyiannakis, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02660 · Cited by 5 · see citing works
Self-citation
The growth-adjusted impact factors of Physics of Fluids
Zatloukal, M., Giacomin, A. J., & Phan-Thien, N. (2024) · Physics of Fluids · doi:10.1063/5.0224881 · Cited by 5 · see citing works
The Consistency Measurement in Document Publications and Citation Using t-Index
Singh, P. K. (2022) · Journal of Applied Mathematics and Physics · doi:10.4236/jamp.2022.103067 · Cited by 4 · see citing works
Scale-dependent stratification: a skyline–shoreline scatter plot
Prathap, G. (2019) · Scientometrics · doi:10.1007/s11192-019-03038-7 · Cited by 4 · see citing works
Publication activity, a role and contribution of V.I. Starostenko to the scientific result
Yakimchik, A. I. (2020) · Geofizicheskiy Zhurnal · doi:10.24028/gzh.0203-3100.v42i4.2020.210680 · Cited by 3 · see citing works
Harnessing Artificial Intelligence for Sustainable Agriculture: A Comprehensive Scientometric Review
Kaur, H., Priya, B., & Singh, K. (2025) · Recent Advances in Food Nutrition & Agriculture · doi:10.2174/012772574x355955250212112211 · Cited by 1 · see citing works
On an approach to boosting a journal’s citation potential
Lyu, G., & Ganwei, S. (2019) · Scientometrics · doi:10.1007/s11192-019-03172-2 · Cited by 1 · see citing works
The "Journal of the National Collegiate Honors Council": A Bibliometric Study.
Walshe, E. (2020) · Lincoln (University of Nebraska) · Cited by 1 · see citing works
I3: A Non-Parametric Alternative to the Journal Impact Factor.Preprint
Loet Leydesdorff, A., Bornmann, L., & Adams, J. R. (2018) · arXiv (Cornell University)
The Integrated Impact Indicator (I3) Revisited: A Non-Parametric Alternative to the Journal Impact FactorPreprint
Loet Leydesdorff, A., Bornmann, L., & Adams, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03448
Proposing an indigenous sustainable methodology for evaluating the effectiveness of industrial parks: A real-life application in IranPreprint
Moghimi, F., Baradaran, V., & Hosseinian, A. H. (2022) · Research Square · doi:10.21203/rs.3.rs-1748386/v1
Keberkesanan Kaedah Main Peranan dalam Penguasaan Kemahiran Bertutur Subjek Bahasa Inggeris Pelajar Tingkatan 2 di Sebuah Sekolah di Daerah Asajaya/Sadong Jaya
Nawas, A. A. A. A., & Hamid, A. H. A. (2023) · Jurnal Dunia Pendidikan · doi:10.55057/jdpd.2023.5.1.31
Design flaws in the Polish science quality evaluation system: A technical analysis of latent properties
Pawlak, T. P. (2026) · Journal of Informetrics · doi:10.1016/j.joi.2026.101773
Mapping the global research landscape of sustainable supply chains in the industry 4.0 era through a triple bottom line perspective
Anurag, A. S., & Johnpaul, M. (2026) · Cleaner Logistics and Supply Chain · doi:10.1016/j.clscn.2026.100323
Gender shapes the relationship between productivity and journal prestige in science
Ribeiro, V. H., Sunahara, A. S., Shahtahmassebi, G., Perc, M., & Ribeiro, H. V. (2026) · Scientific Reports · doi:10.1038/s41598-026-45844-z
Sustainable development of the drone industry: Toward an integrated support system
Chen, J., Ren, Y., & Qiu, R. (2026) · Research in Transportation Business & Management · doi:10.1016/j.rtbm.2026.101799
Φ index: A standardized scale-independent and field-normalized citation indicator
Antonoyiannakis, M. (2026) · Quantitative Science Studies · doi:10.1162/qss.a.500
Self-citation
When Coverage Expansion Coincides With Reversed Journal-Metric Trends: A Multidimensional Robustness Analysis of a Provisional JCR Snapshot
Dong, D.-Y. (2026) · IEEE Access · doi:10.1109/access.2026.3740118

Authors: Antonoyiannakis, M.
Affiliations: American Physical Society (US)
Corresponding author: Antonoyiannakis, Manolis
ORCID: Antonoyiannakis, Manolis
Venue: Journal of Informetrics
Publisher: Elsevier BV
Published: 2018-11
Volume: 12
Issue: 4
Pages: 1072-1088
ISSN: 1751-1577 (ISSN-L)
DOI: 10.1016/j.joi.2018.08.011
OpenAlex: W2890727842
Cited by: 31
References: 43
Citations by year: 2026: 6 · 2025: 2 · 2024: 1 · 2023: 3 · 2022: 5 · 2021: 4 · 2020: 3 · 2019: 5 · 2018: 2
FWCI: 2.67
Type: journal article
Language: en
Open access: green
arxiv.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Journal of Informetrics (publishedVersion)
arXiv (Cornell University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Keywords: journal impact factor, central limit theorem, scale dependence, journal size, citation distribution, physics journals, Journal Citation Reports

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Impact Factors and the Central Limit Theorem: Why Citation Averages Are Scale Dependent

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks