Revisiting the Scientometric Conceptualization of Impact and Its Measurement
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Only part of citations in a publication's reference list are dedicated to the main idea of the paper; other sources are frequently mentioned as simple recognition of similar works or as persuasion on scientific ground.
“only part of citations, as listed in publication's reference list, are dedicated to the main idea of the paper, while other sources are frequently only being mentioned as a simple recognition of other similar works, or as a persuasion on the scientific ground of the study [1,269].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [1]
Scientific impact of any evaluated entity cannot be determined solely by citations due to different citing behaviors and incompatible citation counts between disciplines.
“It is often argued that the scientific impact of any evaluated entity cannot be determined solely by citations due to the different citing behaviors and resulting incompatible citation counts between disciplines [1-3,5,260,267].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [1]
The simple amount of publications does not reflect scientific impact, because publication counts measure productivity rather than quality.
“The simple amount of publications does not reflect the scientific impact, since publication counts measure productivity, rather than quality [1,2].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [1]
Citations may be appropriate for assessing scientific impact of research, but they do not show impact outside the scientific community.
“Citations may be appropriate in assessing the scientific impact of the research, but they do not show the impact of the research outside the scientific community [1,3,5,6,260,264,265].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [1]
Publication data and citation metrics continue to play the most important role in research assessments worldwide, so indicator-based research assessments remain at the center of global debate about their validity and influence.
“because publication data and citation metrics continue to play the most important role in research assessments worldwide, indicator-based research assessments also remain at the center of the global debate, not only about their validity, but also about their influence on research activities, scientific output, and its quality [1,5-7,44,260,265,289].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Science in Action: How to Follow Scientists and Engineers through Society
Bijker, W. E., & Latour, B. (1988) · Technology and Culture · doi:10.2307/3105094 · Cited by 10,768 · see citing works
(1987) · Cited by 8,955 · see citing works
Corporate Social Performance Revisited
Wood, D. J. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4279616 · Cited by 5,116 · see citing works
The Sociology of Science: Theoretical and Empirical Investigations
Kaplan, N. M., Merton, R. Κ., & Storer, N. W. (1974) · Technology and Culture · doi:10.2307/3102264 · Cited by 4,056 · see citing works
Market value and patent citationsPreprint
Hall, B. H., Jaffe, A. B., & Trajtenberg, M. (2005) · RePEc: Research Papers in Economics · Cited by 3,314 · see citing works
Carrier, J. G., & Bloor, D. (1977) · British Journal of Sociology · doi:10.2307/590007 · Cited by 2,368 · see citing works
Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334 · see citing works
What do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607 · see citing works
Citation Analysis in Research Evaluation
Moed, H. F. (2005) · Springer eBooks · doi:10.1007/1-4020-3714-7 · Cited by 1,334 · see citing works
Social Stratification in Science
Cole, J. R., Cole, S., & Beaver, D. D. (1974) · American Journal of Physics · doi:10.1119/1.1987897 · Cited by 1,146 · see citing works
A Review of Theory and Practice in Scientometrics
Mingers, J., & Leydesdorff, L. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.04.002 · Cited by 1,002 · see citing works
Factors Affecting Number of Citations: A Comprehensive Review of the Literature
Tahamtan, I., Safipour Afshar, A., & Ahamdzadeh, K. (2016) · Scientometrics · doi:10.1007/s11192-016-1889-2 · Cited by 912 · see citing works
Quantifying Long-Term Scientific Impact
Wang, D., Song, C., & Barabási, A.-Ĺ. (2013) · Science · doi:10.1126/science.1237825 · Cited by 850 · see citing works
Problems of citation analysis: A critical review
MacRoberts, M. H., & MacRoberts, B. R. (1989) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(198909)40:5 · Cited by 807 · see citing works
What is societal impact of research and how can it be assessed? a literature survey
Bornmann, L. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22803 · Cited by 732 · see citing works
Costas, R., Zahedi, Z., & Wouters, P. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23309 · Cited by 711 · see citing works
Nigel Gilbert, G. (1977) · Social Studies of Science · doi:10.1177/030631277700700112 · Cited by 691 · see citing works
van Raan, A. F. J. (2006) · Scientometrics · doi:10.1556/scient.67.2006.3.10 · Cited by 627 · see citing works
Social Stratification in Science
Whitley, R. D., Cole, J. R., & Cole, S. (1974) · British Journal of Sociology · doi:10.2307/590178 · Cited by 603 · see citing works
Assessment, evaluations, and definitions of research impact: A review
Penfield, T., Baker, M., Scoble, R., & Wykes, M. C. (2013) · Research Evaluation · doi:10.1093/reseval/rvt021 · Cited by 573 · see citing works
Scholarly use of social media and altmetrics: A review of the literature
Sugimoto, C. R., Work, S., Larivière, V., & Haustein, S. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23833 · Cited by 573 · see citing works
(1976) · doi:10.5840/philstudies19762524 · Cited by 529 · see citing works
Martin, B. R., & Irvine, J. M. (1983) · Research Policy · doi:10.1016/0048-7333(83)90005-7 · Cited by 529 · see citing works
MacRoberts, M. H., & MacRoberts, B. R. (1996) · Scientometrics · doi:10.1007/bf02129604 · Cited by 503 · see citing works
Rodenticidal Effect on Pine Mice of Endrin Used as a Ground Spray
Horsfall, F. (1956) · Science · doi:10.1126/science.123.3185.61-a · Cited by 437 · see citing works
New factors in the evaluation of scientific literature through citation indexing
Garfield, E., & Sher, I. H. (1963) · American Documentation · doi:10.1002/asi.5090140304 · Cited by 429 · see citing works
Citation time window choice for research impact evaluation
Wang, J. (2012) · Scientometrics · doi:10.1007/s11192-012-0775-9 · Cited by 427 · see citing works
Mulkay, M. (1976) · Social Science Information · doi:10.1177/053901847601500406 · Cited by 338 · see citing works
How do you define and measure research productivity?
Abramo, G., & D’Angelo, C. A. (2014) · Scientometrics · doi:10.1007/s11192-014-1269-8 · Cited by 325 · see citing works
Self-citationThe roles of science in technological innovation
Gibbons, M., & Johnston, R. J. (1974) · Research Policy · doi:10.1016/0048-7333(74)90008-0 · Cited by 269 · see citing works
How and why scholars cite on Twitter
Priem, J. R., & Costello, K. L. (2010) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504701201 · Cited by 265 · see citing works
Private acts and public objects: An investigation of citer motivations
Brooks, T. A. (1985) · Journal of the American Society for Information Science · doi:10.1002/asi.4630360402 · Cited by 256 · see citing works
The norms of citation behavior: Prolegomena to the footnote
Kaplan, N. (1965) · American Documentation · doi:10.1002/asi.5090160305 · Cited by 244 · see citing works
Evidence of complex citer motivations
Brooks, T. A. (1986) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(198601)37:1 · Cited by 225 · see citing works
Report to the National Science Foundation
Norris, D. F. (1980) · Cited by 210 · see citing works
Comparative analysis of a set of bibliometric indicators and central peer review criteria
Rinia, E. J., van Leeuwen, T. N., van Vuren, H. G., & van Raan, A. F. J. (1998) · Research Policy · doi:10.1016/s0048-7333(98)00026-2 · Cited by 193 · see citing works
Real options valuation: the new frontier in R&D project evaluation?
Perlitz, M., Peske, T., & Schrank, R. (1999) · R and D Management · doi:10.1111/1467-9310.00135 · Cited by 192 · see citing works
Glänzel, W., Schlemmer, B., & Thijs, B. (2003) · Scientometrics · doi:10.1023/b:scie.0000006881.30700.ea · Cited by 184 · see citing works
Peer reviews and bibliometric indicators: a comparative study at a Norwegian university
Aksnes, D. W., & Taxt, R. E. (2004) · Research Evaluation · doi:10.3152/147154404781776563 · Cited by 179 · see citing works
Early citation counts correlate with accumulated impact
Adams, J. R. (2005) · Scientometrics · doi:10.1007/s11192-005-0228-9 · Cited by 163 · see citing works
Tweets vs. Mendeley readers: How do these two social media metrics differ?
Haustein, S., Larivière, V., Thelwall, M. A., Amyot, D., & Peters, I. (2014) · it - Information Technology · doi:10.1515/itit-2014-1048 · Cited by 160 · see citing works
A Statistical Procedure for Evaluating the Importance of Scientific Papers
Virgo, J. A. (1977) · The Library Quarterly · doi:10.1086/620723 · Cited by 151 · see citing works
Core Elements in the Process of Citing Publications: Conceptual Overview of the Literature
Tahamtan, I., & Bornmann, L. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.01.002 · Cited by 149 · see citing works
Citations: Indicators of Quality? The Impact Fallacy
Loet Leydesdorff, A., Bornmann, L., Comins, J. A., & Milojević, S. (2016) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2016.00001 · Cited by 142 · see citing works
Sherwin, C. W., & Isenson, R. S. (1967) · Science · doi:10.1126/science.156.3782.1571 · Cited by 140 · see citing works
Oppenheim, C. (1997) · Journal of Documentation · doi:10.1108/eum0000000007207 · Cited by 136 · see citing works
Evidence of complex citer motivations
Brooks, T. A. (1986) · Journal of the American Society for Information Science · doi:10.1002/asi.4630370106 · Cited by 135 · see citing works
Abramo, G., D’Angelo, C. A., & Felici, G. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.11.003 · Cited by 134 · see citing works
Self-citationBornmann, L. (2017) · Higher Education · doi:10.1007/s10734-016-9995-x · Cited by 117 · see citing works
The first Italian research assessment exercise: A bibliometric perspective
Franceschet, M., & Costantini, A. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2010.12.002 · Cited by 114 · see citing works
Predicting the long-term citation impact of recent publications
Stegehuis, C., Litvak, N., & Waltman, L. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.06.005 · Cited by 109 · see citing works
Abramo, G., Cicero, T., & D’Angelo, C. A. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.06.004 · Cited by 108 · see citing works
Self-citationBornmann, L., Loet Leydesdorff, A., & Wang, J. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.11.005 · Cited by 107 · see citing works
The Negational Reference: or the Art of Dissembling
MacRoberts, M. H., & MacRoberts, B. R. (1984) · Social Studies of Science · doi:10.1177/030631284014001006 · Cited by 104 · see citing works
National research assessment exercises: a comparison of peer review and bibliometrics rankings
Abramo, G., D’Angelo, C. A., & Costa, F. D. (2011) · Scientometrics · doi:10.1007/s11192-011-0459-x · Cited by 104 · see citing works
Self-citationCitation counts and the Research Assessment Exercise V
Norris, M. W., & Oppenheim, C. (2003) · Journal of Documentation · doi:10.1108/00220410310698734 · Cited by 103 · see citing works
The Mismeasure of Science: Citation Analysis
MacRoberts, M. H., & MacRoberts, B. R. (2018) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23970 · Cited by 101 · see citing works
A combined bibliometric indicator to predict article impact
Levitt, J. M., & Thelwall, M. A. (2010) · Information Processing & Management · doi:10.1016/j.ipm.2010.09.005 · Cited by 88 · see citing works
Bibliometric evaluation vs. informed peer review: Evidence from Italy
Bertocchi, G., Gambardella, A., Jappelli, T., Nappi, C. A., & Peracchi, F. (2015) · Research Policy · doi:10.1016/j.respol.2014.08.004 · Cited by 86 · see citing works
Citations versus journal impact factor as proxy of quality: could the latter ever be preferable?
Abramo, G., D’Angelo, C. A., & Costa, F. D. (2010) · Scientometrics · doi:10.1007/s11192-010-0200-1 · Cited by 80 · see citing works
Self-citationTweeting Links to Academic Articles
Thelwall, M. A., Tsou, A., Weingart, S., Holmberg, K., & Haustein, S. (2013) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · Cited by 76 · see citing works
A farewell to the MNCS and like size-independent indicators
Abramo, G., & D’Angelo, C. A. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.04.006 · Cited by 75 · see citing works
Self-citationBaumgartner, S. E., & Loet Leydesdorff, A. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23009 · Cited by 71 · see citing works
Altmetrics and Other Novel Measures for Scientific Impact
Fenner, M. H. (2013) · Springer eBooks · doi:10.1007/978-3-319-00026-8_12 · Cited by 68 · see citing works
Abramo, G., Cicero, T., & D’Angelo, C. A. (2011) · RePEc: Research Papers in Economics · Cited by 65 · see citing works
Self-citationAre Mendeley reader counts useful impact indicators in all fields?
Thelwall, M. A. (2017) · Scientometrics · doi:10.1007/s11192-017-2557-x · Cited by 63 · see citing works
Meho, L. I., & Sonnenwald, D. H. (2000) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(2000)51:2 · Cited by 59 · see citing works
Citation analysis and the science policy arena
MacRoberts, M. H., & MacRoberts, B. R. (1989) · Trends in Biochemical Sciences · doi:10.1016/0968-0004(89)90077-7 · Cited by 53 · see citing works
High-Ranked Social Science Journal Articles Can Be Identified from Early Citation Information
Stern, D. I. (2014) · PLoS ONE · doi:10.1371/journal.pone.0112520 · Cited by 51 · see citing works
Thomas, P. R., & Watkins, D. S. (1998) · Scientometrics · doi:10.1007/bf02459050 · Cited by 48 · see citing works
A farewell to the MNCS and like size-independent indicators
Abramo, G., & D’Angelo, C. A. (n.d.) · RePEc: Research Papers in Economics · Cited by 48 · see citing works
Self-citationAuthor motivation for not citing influences: A methodological note
MacRoberts, M. H., & MacRoberts, B. R. (1988) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(198811)39:6 · Cited by 46 · see citing works
Exploring the dynamics of journal citations: Modelling with s-curves
Mingers, J. (2007) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602428 · Cited by 45 · see citing works
Is there currently a scientific revolution in Scientometrics?
Bornmann, L. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23073 · Cited by 37 · see citing works
Abramo, G., & D’Angelo, C. A. (2016) · Scientometrics · doi:10.1007/s11192-016-2153-5 · Cited by 37 · see citing works
Self-citationLarge-scale assessment of research outputs through a weighted combination of bibliometric indicators
Anfossi, A., Ciolfi, A., Costa, F., Giorgio Parisi, A., & Benedetto, S. (2016) · Scientometrics · doi:10.1007/s11192-016-1882-9 · Cited by 27 · see citing works
A farewell to the MNCS and like size-independent indicators: Rejoinder
Abramo, G., & D’Angelo, C. A. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.01.011 · Cited by 23 · see citing works
Self-citationComment on “Quantifying long-term scientific impact”
Wang, J., Mei, Y., & Hicks, D. M. (2014) · Science · doi:10.1126/science.1248770 · Cited by 21 · see citing works
Response to Comment on “Quantifying long-term scientific impact”
Wang, D., Song, C., Shen, H.-W., et al. (2014) · Science · doi:10.1126/science.1248961 · Cited by 20 · see citing works
Measuring the impact of research
Marsh, R. (2010) · Library Management · doi:10.1108/lm.2010.01531aaa.001 · Cited by 20 · see citing works
Technology Transfer: Some British Data
Langrish, J. Z. (1971) · R and D Management · doi:10.1111/j.1467-9310.1971.tb00071.x · Cited by 15 · see citing works
Peer review for the evaluation of the academic research: the Italian experiencePreprint
Reale, E., Anna, B., & Costantini, A. (2006) · RePEc: Research Papers in Economics · Cited by 5 · see citing works
Measuring the impact of research
Marsh, R. (2009) · Managerial Auditing Journal · doi:10.1108/maj.2010.05125aaa.001 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Garfield E., (1955). Citation indexes for science. Science , 122(3159), 108-111.
- Moravcsik, M.J. (1977). A progress report on the quantification of science, Journal of Scientific and Industrial Research , 36(5), 195-203
- Rousseau, R. (1988), Citation distribution of pure mathematics journals. In: Egghe, L., Rousseau, R. (Ed.) Informetrics, Belgium: Diepenbeek, 87/88 , 249-262, Proceedings 1st International Conference on Bibliometrics and Theoretical Aspects of Information Retrieval.
- Sugimoto, C.R., & Larivière, V. (2018). Measuring Research . Oxford University Press, Oxford.
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
Peer Review versus Bibliometrics: Which Method Better Predicts the Scholarly Impact of Publications?
Abramo, G., D’Angelo, C. A., & Reale, E. (2019) · Scientometrics · doi:10.1007/s11192-019-03184-y · Cited by 50 · see citing works
Self-citation
- Authors
- Abramo, G.
- Affiliations
- National Research Council (IT)
- Corresponding author
- Abramo, Giovanni
- ORCID
- Abramo, Giovanni
- Venue
- Journal of Informetrics
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 12
- Issue
- 3
- Pages
- 590-597
- ISSN
- 1751-1577 (ISSN-L)
- OpenAlex
- W2806133181
- Cited by
- 80
- References
- 84
- Citations by year
- 2026: 8 · 2025: 6 · 2024: 10 · 2023: 4 · 2022: 11 · 2021: 13 · 2020: 9 · 2019: 15 · 2018: 4
- FWCI
- 7.82
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Journal of Informetrics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- research impact, scientometric indicators, impact measurement, research evaluation, bibliometric analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
