Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
Open accessAbstract
An extensive analysis of the presence of different altmetric indicators provided by Altmetric.com across scientific fields is presented, particularly focusing on their relationship with citations. Our results confirm that the presence and density of social media altmetric counts are still very low and not very frequent among scientific publications, with 15%–24% of the publications presenting some altmetric activity and concentrated on the most recent publications, although their presence is increasing over time. Publications from the social sciences, humanities, and the medical and life sciences show the highest presence of altmetrics, indicating their potential value and interest for these fields. The analysis of the relationships between altmetrics and citations confirms previous claims of positive correlations but is relatively weak, thus supporting the idea that altmetrics do not reflect the same kind of impact as citations. Also, altmetric counts do not always present a better filtering of highly‐cited publications than journal citation scores. Altmetric scores (particularly mentions in blogs) are able to identify highly‐cited publications with higher levels of precision than journal citation scores ( JCS ), but they have a lower level of recall. The value of altmetrics as a complementary tool of citation analysis is highlighted, although more research is suggested to disentangle the potential meaning and value of altmetric indicators for research evaluation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Costas et al. found that Altmetrics coverage of Mathematical and Computer Science papers tends to be much lower than disciplines like Biomedicine and Health or Natural Sciences and engineering.
“A recent study by Costas et al. also found that Altmetrics coverage of Mathematical and Computer Science papers tends to be much lower than disciplines like Biomedicine and Health or Natural Sciences and engineering [29].”
From Measuring scientific impact beyond academia: An assessment of existing impact metrics and proposed improvements (2017) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Why the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447 · see citing works
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907 · see citing works
The Leiden ranking 2011/2012: Data collection, indicators, and interpretation
Waltman, L., Calero‐Medina, C., Kosten, J., Noyons, E., Tijssen, R., van Eck, N. J., van Leeuwen, T. N., van Raan, A. F. J., Visser, M. S., & Wouters, P. F. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22708 · Cited by 452 · see citing works
Self-citationTowards a new crown indicator: Some theoretical considerations
Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. J. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.08.001 · Cited by 438 · see citing works
Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature
Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M. A., & Larivière, V. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23101 · Cited by 434 · see citing works
Zahedi, Z., Costas, R., & Wouters, P. F. (2014) · Scientometrics · doi:10.1007/s11192-014-1264-0 · Cited by 386 · see citing works
Self-citationAltmetrics in the wild: Using social media to explore scholarly impactPreprint
Priem, J. R., Piwowar, H., & Hemminger, B. M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.4745 · Cited by 360 · see citing works
Sud, P., & Thelwall, M. A. (2013) · Scientometrics · doi:10.1007/s11192-013-1117-2 · Cited by 255 · see citing works
Altmetric: enriching scholarly content with article‐level discussion and metrics
Adie, E. A., & William, R. O. E. (2012) · Learned Publishing · doi:10.1087/20130103 · Cited by 224 · see citing works
Shema, H., Bar‐Ilan, J., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23037 · Cited by 209 · see citing works
Users, narcissism and control – tracking the impact of scholarly publications in the 21st century
Costas, R., & Wouters, P. F. (2012) · Cited by 195 · see citing works
Self-citationResearch Blogs and the Discussion of Scholarly Information
Shema, H., Bar‐Ilan, J., & Thelwall, M. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035869 · Cited by 187 · see citing works
Costas, R., van Leeuwen, T. N., & Bordons, M. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21348 · Cited by 185 · see citing works
Self-citationBeyond citations: Scholars' visibility on the social WebPreprint
Bar‐Ilan, J., Haustein, S., Peters, I., Priem, J. R., Shema, H., & Terliesner, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.5611 · Cited by 169 · see citing works
The effect of “open access” on citation impact: An analysis of ArXiv's condensed matter section
Moed, H. F. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20663 · Cited by 164 · see citing works
Altmetrics: Rethinking the Way We Measure
Galligan, F., & Dyas-Correia, S. (2013) · Serials Review · doi:10.1016/j.serrev.2013.01.003 · Cited by 155 · see citing works
Altmetrics: Rethinking the Way We Measure
Galligan, F., & Dyas-Correia, S. (2013) · Serials Review · doi:10.1080/00987913.2013.10765486 · Cited by 155 · see citing works
Self-citations at the meso and individual levels: Effects of different calculation methods
Costas, R., van Leeuwen, T. N., & Bordons, M. (2010) · Scientometrics · doi:10.1007/s11192-010-0187-7 · Cited by 148 · see citing works
Self-citationWaltman, L., & Costas, R. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23040 · Cited by 132 · see citing works
Self-citationRising Publication Delays Inflate Journal Impact Factors
Tort, A. B. L., Targino, Z. H., & Amaral, O. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0053374 · Cited by 109 · see citing works
The power of altmetrics on a CV
Piwowar, H., & Priem, J. R. (2013) · Bulletin of the American Society for Information Science and Technology · doi:10.1002/bult.2013.1720390405 · Cited by 86 · see citing works
The praxis of acknowledgement: from bibliometrics to influmetrics
Cronin, B., & Weaver, S. (1995) · Revista española de Documentación Científica · doi:10.3989/redc.1995.v18.i2.654 · Cited by 77 · see citing works
Studying Scientific Discourse on the Web using Bibliometrics: A Chemistry Blogging Case Study
Groth, P. T., & Gurney, T. (2010) · Data Archiving and Networked Services (DANS) · Cited by 60 · see citing works
A multi-metric approach for research evaluation
Ronald, R., & Fred, Y. Y. (2013) · Chinese Science Bulletin · doi:10.1007/s11434-013-5939-3 · Cited by 59 · see citing works
Effects of Print Publication Lag in Dual Format Journals on Scientometric Indicators
Heneberg, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059877 · Cited by 39 · see citing works
On the relation between altmetrics and citations in medicine
Haustein, S. (2013) · Cited by 6 · see citing works
On the relation between altmetrics and citations in medicine
Larivière, V. (2013) · Cited by 1 · see citing works
Kellerer, A. M., & Lange, R. (2002) · Radiation and Environmental Biophysics · doi:10.1007/s00411-001-0126-3 · Cited by 1 · see citing works
Wu, X. (2003) · Knowledge and Information Systems · doi:10.1007/s10115-003-0113-x · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Bar-Ilan, J. (2012). JASIST@ Mendeley. Presented at ACM Web Science Conference Workshop on Altmetrics , Evanston, IL, 21 June 2012. Retrieved from: http://altmetrics.org/altmetrics12/bar-ilan/
- Schmidt, M. (2012). Development and Evaluation of a Match Key for Linking References to Cited Articles. In Proceedings of the 17th International Conference on Science and Technology Indicators , Montréal; Science-Metrix and OST, Volume 2, (pp:707-718).
Cited by
Sorted by citations
Fortunato, S., Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., Petersen, A. M., Radicchi, F., Sinatra, R., Uzzi, B., et al. (2018) · Science · doi:10.1126/science.aao0185 · Cited by 1,497 · see citing works
The Academic, Economic and Societal Impacts of Open Access: An Evidence-Based Review
Tennant, J. P., Waldner, F., Jacques, D. C., Masuzzo, P., Collister, L. B., & Hartgerink, C. H. J. (2016) · F1000Research · doi:10.12688/f1000research.8460.3 · Cited by 560 · see citing works
Scholarly use of social media and altmetrics: A review of the literature
Sugimoto, C. R., Work, S., Larivière, V., & Haustein, S. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23833 · Cited by 573 · see citing works
Cheng, A., Nadkarni, V., Mancini, M. B., Hunt, E. A., Sinz, E. H., Merchant, R. M., Donoghue, A. J., Duff, J. P., Eppich, W., Auerbach, M. A., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000583 · Cited by 430 · see citing works
OECD (2015) · OECD science, technology and industry policy papers · doi:10.1787/5jrs2f963zs1-en · Cited by 419 · see citing works
Swedberg, R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.002 · Cited by 408 · see citing works
Haustein, S., Costas, R., & Larivière, V. (2015) · PLoS ONE · doi:10.1371/journal.pone.0120495 · Cited by 362 · see citing works
Self-citationExploring Topics in Bibliometric Research Through Citation Networks and Semantic Analysis
Mejía, C., Wu, M., Zhang, Y., & Kajikawa, Y. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.742311 · Cited by 319 · see citing works
Dimensions: A competitor to Scopus and the Web of Science?
Thelwall, M. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.03.006 · Cited by 294 · see citing works
Grand challenges in altmetrics: heterogeneity, data quality and dependencies
Haustein, S. (2016) · Scientometrics · doi:10.1007/s11192-016-1910-9 · Cited by 241 · see citing works
Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R., & Larivière, V. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23456 · Cited by 231 · see citing works
Ravenscroft, J., Liakata, M., Clare, A., & Duma, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0173152 · Cited by 202 · see citing works
Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics
Bornmann, L. (2015) · Scientometrics · doi:10.1007/s11192-015-1565-y · Cited by 202 · see citing works
Who reads research articles? An altmetrics analysis of M endeley user categories
Mohammadi, E., Thelwall, M. A., Haustein, S., & Larivière, V. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23286 · Cited by 196 · see citing works
Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media
Erdt, M., Nagarajan, A., Sin, S. J., & Theng, Y. (2016) · Scientometrics · doi:10.1007/s11192-016-2077-0 · Cited by 193 · see citing works
The academic, economic and societal impacts of Open Access: an evidence-based review
Tennant, J., Waldner, F., Jacques, D., Masuzzo, P., Collister, L., & Hartgerink, C. H. J. (2016) · F1000Research · doi:10.12688/f1000research.8460.1 · Cited by 182 · see citing works
A systematic identification and analysis of scientists on Twitter
Ke, Q., Ahn, Y.-Y., & Sugimoto, C. R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0175368 · Cited by 175 · see citing works
Academic information on Twitter: A user survey
Mohammadi, E., Thelwall, M. A., Kwasny, M., & Holmes, K. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197265 · Cited by 177 · see citing works
Measuring Science: Basic Principles and Application of Advanced Bibliometrics
van Raan, A. F. J. (2019) · Springer handbooks · doi:10.1007/978-3-030-02511-3_10 · Cited by 166 · see citing works
Twitter Predicts Citation Rates of Ecological Research
Peoples, B. K., Midway, S. R., Sackett, D. K., Lynch, A. J., & Cooney, P. B. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166570 · Cited by 158 · see citing works
Ortega, J. L. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2014.11.004 · Cited by 155 · see citing works
The relationship between tweets, citations, and article views for PLOS ONE articles
de Winter, J. (2014) · Scientometrics · doi:10.1007/s11192-014-1445-x · Cited by 147 · see citing works
Bornmann, L., & Haunschild, R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197133 · Cited by 143 · see citing works
Haustein, S., Bowman, T. D., & Costas, R. (2016) · De Gruyter eBooks · doi:10.1515/9783110308464-022 · Cited by 150 · see citing works
Self-citationOrtega, J. L. (2018) · Scientometrics · doi:10.1007/s11192-018-2838-z · Cited by 137 · see citing works
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519 · Cited by 135 · see citing works
The unbearable emptiness of tweeting—About journal articles
Robinson‐García, N., Costas, R., Isett, K. R., Melkers, J. E., & Hicks, D. M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0183551 · Cited by 130 · see citing works
Self-citationWhen are readership counts as useful as citation counts? S copus versus M endeley for LIS journals
Maflahi, N., & Thelwall, M. A. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23369 · Cited by 128 · see citing works
M endeley readership altmetrics for medical articles: An analysis of 45 fields
Thelwall, M. A., & Wilson, P. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23501 · Cited by 127 · see citing works
The Effects of Academic Incubators on University Innovation
Kolympiris, C., & Klein, P. G. (2016) · Strategic Entrepreneurship Journal · doi:10.1002/sej.1242 · Cited by 126 · see citing works
Could scientists use Altmetric.com scores to predict longer term citation counts?
Thelwall, M. A., & Nevill, T. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.01.008 · Cited by 124 · see citing works
Public use and public funding of science
Yin, Y., Dong, Y., Wang, K., Wang, D., & Jones, B. F. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01397-5 · Cited by 123 · see citing works
A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals
Huang, W., Wang, P., & Wu, Q. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194962 · Cited by 122 · see citing works
Can M endeley bookmarks reflect readership? A survey of user motivations
Mohammadi, E., Thelwall, M. A., & Kousha, K. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23477 · Cited by 119 · see citing works
The Use of Social Media to Increase the Impact of Health Research: Systematic Review
Bardus, M., Rassi, R. E., Chahrour, M. A., Akl, E. W., Raslan, A. S., Meho, L. I., & Akl, E. A. (2020) · Journal of Medical Internet Research · doi:10.2196/15607 · Cited by 113 · see citing works
Product Placement in Mass Media: A Review and Bibliometric Analysis
Guo, F., Ye, G., Hudders, L., Lv, W., Li, M., & Duffy, V. G. (2019) · Journal of Advertising · doi:10.1080/00913367.2019.1567409 · Cited by 112 · see citing works
Early Mendeley readers correlate with later citation counts
Thelwall, M. (2018) · Scientometrics · doi:10.1007/s11192-018-2715-9 · Cited by 113 · see citing works
Predicting the long-term citation impact of recent publications
Stegehuis, C., Litvak, N., & Waltman, L. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.06.005 · Cited by 109 · see citing works
Overton: A bibliometric database of policy document citations
Szomszor, M., & Adie, E. A. (2022) · Quantitative Science Studies · doi:10.1162/qss_a_00204 · Cited by 120 · see citing works
Haustein, S. (2019) · Springer handbooks · doi:10.1007/978-3-030-02511-3_28 · Cited by 105 · see citing works
Kousha, K., & Thelwall, M. A. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00066 · Cited by 103 · see citing works
Díaz‐Faes, A. A., Bowman, T. D., & Costas, R. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216408 · Cited by 102 · see citing works
Self-citationHassan, S.-U., Imran, M., Gillani, U., Aljohani, N. R., Bowman, T. D., & Didegah, F. (2017) · Scientometrics · doi:10.1007/s11192-017-2512-x · Cited by 100 · see citing works
Bibliometrics and systematic reviews: A comparison between the Proknow-C and the Methodi Ordinatio
de Carvalho, G. D. G., Sokulski, C. C., da Silva, W. V., de Carvalho, H. G., de Moura, R. V., de Francisco, A. C., & da Veiga, C. P. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101043 · Cited by 110 · see citing works
Virtual Laboratories- A historical review and bibliometric analysis of the past three decades
Raghu Raman, R., Achuthan, K., Nair, V. K., & Nedungadi, P. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11058-9 · Cited by 98 · see citing works
Wang, J., Alotaibi, N. M., Ibrahim, G. M., Kulkarni, A. V., & Lozano, A. M. (2017) · World Neurosurgery · doi:10.1016/j.wneu.2017.04.157 · Cited by 97 · see citing works
Kunze, K. N., Polce, E. M., Vadhera, A. S., Williams, B. T., Nwachukwu, B. U., Nho, S. J., & Chahla, J. A. (2020) · The American Journal of Sports Medicine · doi:10.1177/0363546520903703 · Cited by 97 · see citing works
Efficacy and Safety of Saccharomyces boulardii for Acute Diarrhea
Feizizadeh, S., Salehi‐Abargouei, A., & Akbari, V. (2014) · PEDIATRICS · doi:10.1542/peds.2013-3950 · Cited by 95 · see citing works
Twitter Mentions and Academic Citations in the Urologic Literature
Hayon, S., Tripathi, H., Stormont, I. M., Dunne, M. M., Naslund, M. J., & Siddiqui, M. M. (2018) · Urology · doi:10.1016/j.urology.2018.08.041 · Cited by 95 · see citing works
Desrochers, N., Paul-Hus, A., Haustein, S., Costas, R., Mongeon, P., Quan-Haase, A., Bowman, T. D., Pecoskie, J., Tsou, A., & Larivière, V. (2018) · Social Science Information · doi:10.1177/0539018417752089 · Cited by 91 · see citing works
Self-citationDigital Presence of Norwegian Scholars on Academic Network Sites—Where and Who Are They?
Mikki, S., Zygmuntowska, M., Gjesdal, Ø. L., & Ruwehy, H. A. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0142709 · Cited by 85 · see citing works
Social Media Metrics for New Research Evaluation
Wouters, P. F., Zahedi, Z., & Costas, R. (2019) · Springer handbooks · doi:10.1007/978-3-030-02511-3_26 · Cited by 90 · see citing works
Self-citationThe thematic orientation of publications mentioned on social media
Costas, R., Zahedi, Z., & Wouters, P. F. (2015) · Aslib Journal of Information Management · doi:10.1108/ajim-12-2014-0173 · Cited by 84 · see citing works
Self-citationBibliographic Analysis of Nature Based on Twitter and Facebook Altmetrics Data
Xia, F., Su, X., Wang, W. W., Zhang, C., Ning, Z., & Lee, I. (2016) · PLoS ONE · doi:10.1371/journal.pone.0165997 · Cited by 82 · see citing works
Greifeneder, R., Jaffé, M. E., Newman, E. J., & Schwarz, N. (2020) · Routledge eBooks · doi:10.4324/9780429295379 · Cited by 86 · see citing works
Fang, Z., Costas, R., Tian, W., Wang, X., & Wouters, P. (2020) · Scientometrics · doi:10.1007/s11192-020-03564-9 · Cited by 82 · see citing works
Self-citationIf I tweet will you cite? The effect of social media exposure of articles on downloads and citations
Tonia, T., Oyen, H. J. V., Berger, A., Schindler, C. J. A., & Künzli, N. (2016) · International Journal of Public Health · doi:10.1007/s00038-016-0831-y · Cited by 82 · see citing works
Revisiting the Scientometric Conceptualization of Impact and Its Measurement
Abramo, G. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.05.001 · Cited by 80 · see citing works
Web indicators for research evaluation. Part 2: Social media metrics
Thelwall, M. A., & Kousha, K. (2015) · El Profesional de la Informacion · doi:10.3145/epi.2015.sep.09 · Cited by 79 · see citing works
Özkent, Y. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263725 · Cited by 79 · see citing works
Comparing alternative and traditional dissemination metrics in medical education
Amath, A., Ambacher, K., Leddy, J. J., Wood, T. J., & Ramnanan, C. J. (2017) · Medical Education · doi:10.1111/medu.13359 · Cited by 77 · see citing works
The Use of Altmetrics as a Tool for Measuring Research Impact
Barnes, C. (2015) · Australian Academic & Research Libraries · doi:10.1080/00048623.2014.1003174 · Cited by 77 · see citing works
Thelwall, M. A., & Kousha, K. (2015) · El Profesional de la Informacion · doi:10.3145/epi.2015.sep.08 · Cited by 78 · see citing works
Alperín, J. P., Gomez, C., & Haustein, S. (2018) · Public Understanding of Science · doi:10.1177/0963662518761733 · Cited by 76 · see citing works
M endeley readership counts: An investigation of temporal and disciplinary differences
Thelwall, M. A., & Sud, P. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23559 · Cited by 74 · see citing works
D’Este, P., & Robinson‐García, N. (2022) · Research Policy · doi:10.1016/j.respol.2022.104609 · Cited by 74 · see citing works
Geographic variation in social media metrics: an analysis of Latin American journal articles
Alperín, J. P. (2015) · Aslib Journal of Information Management · doi:10.1108/ajim-12-2014-0176 · Cited by 72 · see citing works
MEASURING SOCIETAL IMPACTS OF RESEARCH WITH ALTMETRICS? COMMON PROBLEMS AND MISTAKES
Thelwall, M. A. (2020) · Journal of Economic Surveys · doi:10.1111/joes.12381 · Cited by 72 · see citing works
Dimensions: redescubriendo el ecosistema de la información científica
Orduña‐Malea, E., & López‐Cózar, E. D. (2018) · El Profesional de la Informacion · doi:10.3145/epi.2018.mar.21 · Cited by 71 · see citing works
Studying the accumulation velocity of altmetric data tracked by Altmetric.com
Fang, Z., & Costas, R. (2020) · Scientometrics · doi:10.1007/s11192-020-03405-9 · Cited by 70 · see citing works
Self-citationThe Pros and Cons of the Use of Altmetrics in Research Assessment
Thelwall, M. A. (2020) · Scholarly Assessment Reports · doi:10.29024/sar.10 · Cited by 68 · see citing works
Ortega, J. L. (2016) · Scientometrics · doi:10.1007/s11192-016-2113-0 · Cited by 68 · see citing works
Tahamtan, I., & Bornmann, L. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.07.005 · Cited by 68 · see citing works
Predicting literature’s early impact with sentiment analysis in Twitter
Hassan, S., Aljohani, N. R., Idrees, N., Sarwar, R., Nawaz, R., Martínez‐Cámara, E., Ventura, S., & Herrera, F. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105383 · Cited by 65 · see citing works
Marketing científico digital e métricas alternativas para periódicos: da visibilidade ao engajamento
de Araújo, R. F. (2015) · Perspectivas em Ciência da Informação · doi:10.1590/1981-5344/2402 · Cited by 64 · see citing works
Thelwall, M. A. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.08.005 · Cited by 64 · see citing works
Can A mazon.com reviews help to assess the wider impacts of books?
Kousha, K., & Thelwall, M. A. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23404 · Cited by 61 · see citing works
I Like, I Cite? Do Facebook Likes Predict the Impact of Scientific Work?
Ringelhan, S., Wollersheim, J., & Welpe, I. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0134389 · Cited by 62 · see citing works
Martín‐Martín, A., Orduña‐Malea, E., & Delgado López-Cózar, E. (2018) · RePEc: Research Papers in Economics · Cited by 61 · see citing works
Measuring the social impact of nursing research: An insight into altmetrics
Dardas, L. A., Woodward, A. L., Scott, J., Xu, H., & Sawair, F. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13921 · Cited by 61 · see citing works
Do altmetrics work for assessing research quality?
Nuzzolese, A. G., Ciancarini, P., Aldo Gangemi, A., Peroni, S., Poggi, F., & Presutti, V. (2019) · Scientometrics · doi:10.1007/s11192-018-2988-z · Cited by 61 · see citing works
An Overview on Evaluating and Predicting Scholarly Article Impact
Bai, X., Liu, H., Zhang, F., Ning, Z., Kong, X., Lee, I., & Xia, F. (2017) · Information · doi:10.3390/info8030073 · Cited by 61 · see citing works
Carlson, J., & Harris, K. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000860 · Cited by 61 · see citing works
Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics
Wang, Z., Chen, Y., & Glänzel, W. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101097 · Cited by 58 · see citing works
The use of social media for health research purposes: scoping review
Bour, C., Ahne, A., Schmitz, S., Perchoux, C., Dessenne, C., & Fagherazzi, G. (2021) · Journal of Medical Internet Research · doi:10.2196/25736 · Cited by 56 · see citing works
Maggio, L. A., Meyer, H. S., & Artino, A. R. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001897 · Cited by 55 · see citing works
Zenodo in the Spotlight of Traditional and New Metrics
Peters, I., Kraker, P., Lex, E., Gumpenberger, C., & Gorraiz, J. I. (2017) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2017.00013 · Cited by 57 · see citing works
National research impact indicators from Mendeley readers
Fairclough, R., & Thelwall, M. A. (2015) · RePEc: Research Papers in Economics · Cited by 57 · see citing works
Zahedi, Z., Haustein, S., & S. (2018) · RePEc: Research Papers in Economics · Cited by 57 · see citing works
Self-citationThe Pandemic and Gender Inequality in Academia
Kim, E., & Patterson, S. (2020) · PS Political Science & Politics · doi:10.1017/s1049096521001049 · Cited by 56 · see citing works
Scientific Landscape of Citizen Science Publications: Dynamics, Content and Presence in Social Media
Bautista‐Puig, N., Filippo, D. D., Mauleón, E., & Casado, E. S. (2019) · Publications · doi:10.3390/publications7010012 · Cited by 57 · see citing works
Measuring research impact: bibliometrics, social media, altmetrics, and the BJGP
Chavda, J., & Patel, A. (2015) · British Journal of General Practice · doi:10.3399/bjgp16x683353 · Cited by 55 · see citing works
Critical remarks on the Italian research assessment exercise VQR 2011–2014
Franceschini, F., & Maisano, D. A. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.02.005 · Cited by 53 · see citing works
Mendeley readership as a filtering tool to identify highly cited publications
Zahedi, Z., Costas, R., & Wouters, P. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23883 · Cited by 55 · see citing works
Self-citationZahedi, Z., & Haustein, S. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2017.12.005 · Cited by 64 · see citing works
Self-citationBibliometrics and altmetrics literature review
Karanatsiou, D., Misirlis, N., & Vlachopoulou, M. (2017) · Performance Measurement and Metrics · doi:10.1108/pmm-08-2016-0036 · Cited by 54 · see citing works
Zhang, L., Sun, B., Jiang, L., & Huang, Y. (2021) · Research Evaluation · doi:10.1093/reseval/rvab007 · Cited by 53 · see citing works
What are the variables associated with Altmetric scores?
Araújo, A. C., Vanin, A. A., Nascimento, D. P., Gonzalez, G. Z., & Costa, L. O. P. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01735-0 · Cited by 53 · see citing works
Jin, T., Duan, H., Lu, X., Ni, J., & Guo, K. (2021) · Scientometrics · doi:10.1007/s11192-021-04112-9 · Cited by 52 · see citing works
Fang, Z., Costas, R., & Wouters, P. F. (2022) · Scientometrics · doi:10.1007/s11192-022-04468-6 · Cited by 52 · see citing works
Self-citation
- Authors
- Costas, R., Zahedi, Z., & Wouters, P.
- Affiliations
- Leiden University (NL)
- Corresponding author
- Costas, Rodrigo
- Zahedi, Zohreh
- Wouters, Paul
- Venue
- Journal of the Association for Information Science and Technology
- Publisher
- Wiley
- Published
- 2014-07-28
- Volume
- 66
- Issue
- 10
- Pages
- 2003-2019
- ISSN
- 2330-1635 (ISSN-L)
- 2330-1643
- OpenAlex
- W2164277894
- Cited by
- 711
- References
- 29
- Citations by year
- 2026: 27 · 2025: 37 · 2024: 48 · 2023: 55 · 2022: 56 · 2021: 72 · 2020: 96 · 2019: 70 · 2018: 88 · 2017: 63 · 2016: 37 · 2015: 46 · 2014: 16
- FWCI
- 52.66
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Journal of the Association for Information Science and Technology (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- EU FP7 ACUMEN (266632)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- altmetrics, citation analysis, Altmetric.com, social media engagement, research impact, highly cited papers, research evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
